A multimodal physiological dataset for driving behaviour analysis

Tao, Xiaoming; Gao, Dingcheng; Zhang, Wenqi; Liu, Tianqi; Du, Bing; Zhang, Shanghang; Qin, Yanjun · 2024 · openalex

DOI: 10.1038/s41597-024-03222-2

archive: archived pipeline: cataloged verified

Get this paper ↗ (DOI — opens at the source; we link to it, we don't host it)

Summary

This paper introduces the Multimodal Physiological Dataset for Driving Behaviour (MPDB), addressing the critical need for data that links human physiological states to specific driving actions. While existing datasets often rely on vehicle sensors or external cameras, these methods struggle to distinguish between driver operational errors and vehicle performance issues, nor do they capture the internal cognitive states of the driver. The authors argue that integrating physiological signals is essential for understanding the cognitive and decision-making mechanisms underlying driving behavior, which is a primary factor in traffic accidents. The study aims to provide a comprehensive, multimodal dataset that maps physiological responses to explicit driving behaviors, thereby supporting research in traffic psychology, neuroscience, and autonomous driving safety. The study recruited 35 participants (aged 20–60) with valid driving licenses to perform driving tasks in a six-degree-of-freedom driving simulator. The simulation environment replicated an 11-km road section in Beijing, featuring various scenarios such as curves and straight urban roads. Participants engaged in 150-minute sessions where their physiological data was collected using 59-channel EEG, single-channel ECG, 4-channel EMG, single-channel GSR, and eye-tracking devices. Driving behaviors were categorized into five groups: smooth driving, acceleration, deceleration, lane changing, and turning. The experimental design utilized an Event-Related Desynchronization/Synchronization (ERD/ERS) paradigm rather than Event-Related Potentials, allowing for the analysis of decision dynamics in dynamic driving scenarios. Data preprocessing was conducted using EEGLAB, and classification models including Linear Discriminant Analysis (LDA), MMPNet, and EEGNet were developed to analyze the correlation between physiological data and driving behaviors. The results demonstrated that the collected physiological and vehicle data met the requirements for behavior analysis. The study successfully classified the five driving behaviors using the developed models. Specifically, the classification accuracy varied by behavior and model type, with LDA achieving accuracies ranging from 38% for deceleration to 78% for smooth driving when using multimodal physiological data. The findings confirmed a measurable correlation between multimodal physiological signals and specific driving actions, validating the dataset's utility. The MPDB dataset comprises 6,052 annotated events, offering a robust resource for analyzing driver behavior. The significance of this work lies in the creation of the first publicly available multimodal physiological dataset that directly maps physiological signals to driver behavior. By providing high-accuracy, multimodal data, the MPDB dataset offers unprecedented opportunities for researchers to study the cognitive aspects of driving and improve vehicle-human interaction interfaces. This resource supports the development of more comprehensive traffic models that account for human factors, potentially enhancing safety in both human-driven and autonomous driving contexts. The dataset addresses a gap in current research by moving beyond vehicle-centric data to include the internal physiological states of drivers, facilitating deeper insights into the causes of driving errors and accidents.

Key finding

Multimodal physiological data, including EEG, ECG, EMG, and GSR, can effectively classify five distinct driving behaviors with higher accuracy than EEG data alone.

Methodology

simulator

Sample size: 35

Provenance

The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed. Discovered via scout_discovery on 2026-05-08.

StageOutcomeToolModelPromptAttemptsCompleted
discover partial scout 2 2026-05-08
archive success unpaywall 1 2026-06-06
extract success cached 3 2026-06-10
clean success clean 1 2026-06-04
chunk success chunk 1 2026-06-04
embed success embed Qwen/Qwen3-Embedding-8B 1 2026-06-04
enrich success 1 2026-05-08
promote success 1 2026-05-08
summarize success llm qwen3.6-27b-prismaquant summ-v5 2 2026-06-10
tag success vector_similarity 15 2026-06-11
verify success 2 2026-06-10

Summary generated by qwen3.6-27b-prismaquant on 2026-06-10; verification: verified.

Topics

Ranked by relevance to this paper. Hover a topic for its definition.

Information type

What kind of knowledge this paper contributes, grouped by family — independent of topic (what it is about) and method (how it was studied).