Audiovisual messages may improve the processing of traffic information and driver attention during partially automated driving: An EEG study

Pi-Ruano, Marina; Fort, Alexandra; Tejero, Pilar; Jallais, Christophe; Roca, Javier · 2024 · Crossref

DOI: 10.1186/s41235-024-00580-8

archive: archived pipeline: cataloged verified

Get this paper ↗ (DOI — opens at the source; we link to it, we don't host it)

Summary

This study investigates whether adding auditory messages to visual variable message signs (VMS) improves traffic information processing and maintains driver vigilance during partially automated driving. The research addresses the problem of vigilance decrement and mind-wandering, which occur when drivers are freed from active driving subtasks in monotonous environments, potentially compromising their ability to regain control when necessary. The authors hypothesized that auditory cues would not only aid in identifying critical traffic situations but also serve as warning signals that sustain general alertness. The experiment utilized a driving simulator with 39 adult participants who drove in SAE Level 1 automation mode, where the vehicle controlled speed while the driver managed steering. Participants completed two primary tasks: a VMS task requiring them to regain manual control upon seeing a "critical" message (indicating an immediate hazard) versus an "informative" message, and a car-following task involving reactions to a preceding vehicle’s brake lights. The study employed a within-subject design comparing Visual-only versus Audio + Visual message modalities, counterbalanced across participants. Data collection included behavioral metrics (response accuracy and distance), electroencephalography (EEG) to measure theta, alpha, and beta band activity, and self-reported assessments of mind-wandering using the Mindful Attention Awareness Scale. Results indicated that the addition of audio messages significantly improved drivers’ performance in processing VMS information. Drivers in the Audio + Visual condition demonstrated better discrimination between critical and informative messages compared to the Visual-only condition. Furthermore, EEG data revealed that the auditory modality helped maintain higher levels of vigilance, evidenced by distinct patterns in theta, alpha, and beta bands associated with sustained attention. The auditory cues acted as effective warning signals, reducing the vigilance decrement typically observed in low-demand driving scenarios. This enhanced alertness extended beyond the immediate message processing, indirectly improving performance on unrelated driving subtasks, such as reacting to the preceding vehicle’s brake lights. The findings suggest that integrating auditory warnings with visual traffic signs is a viable strategy for enhancing safety in partially automated vehicles. By leveraging multiple sensory modalities, designers can mitigate the risks associated with driver disengagement and mind-wandering. The study concludes that auditory messages provide a complementary communication channel that ensures drivers remain attentive and prepared to intervene, thereby supporting the reliable operation of automated driving systems in monotonous environments.

Provenance

The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed.

Summary generated by qwen3.6-27b-nvidia on 2026-08-10; verification: verified.

Topics

Ranked by relevance to this paper. Hover a topic for its definition.

• auditory
• situational awareness
• peripheral attention
• useful field of view
• vigilance
• attention allocation

Information type

What kind of knowledge this paper contributes, grouped by family — independent of topic (what it is about) and method (how it was studied).

• Empirical Findings: physiological data
• Methodological Resource: tool software
• Theoretical Contribution: theory or model