Using Human-Machine Interfaces To Convey Feedback in Automated Vehicles

Shull, Emily; Gaspar, John G; Schmitt, Rose; Vecera, Shaun · 2019 · ROSA P / Safety Research Using Simulation (SAFER-SIM) University Transportation Center

archive: archived pipeline: cataloged verified

Get this paper ↗ (full text — opens at the source; we link to it, we don't host it)

Summary

This study investigates how human-machine interface (HMI) design influences driver takeover performance in partially automated vehicles (SAE Levels 2 and 3). As automation increases, drivers must act as fallbacks during system failures, yet sustained vigilance is difficult. The research specifically examined whether providing real-time feedback on automation confidence and utilizing multimodal warnings could improve driver awareness, trust, and response times during control transitions. The researchers conducted a simulator study using a 3x2 between-subjects design with 60 licensed drivers. Participants engaged in a 40-minute automated drive while performing a secondary trivia task on a tablet. They were assigned to one of three HMI conditions: (1) Discrete, which provided no changing confidence feedback; (2) Continuous Visual, which displayed a confidence bar that degraded as the system approached its limits; and (3) Continuous Visual and Auditory (AV), which added an auditory chime when confidence dropped. Drivers encountered various events, including standard takeover requests (TORs), silent failures (no warning), and false alarms. Dependent measures included look-up time (time to glance forward after TOR), takeover time (time to regain manual control), steering response time, and post-drive trust ratings. The results demonstrated that continuous feedback significantly improved driver responsiveness compared to discrete feedback. Drivers in both continuous conditions exhibited significantly faster look-up times and takeover times than those in the discrete condition. Furthermore, the multimodal AV condition yielded significantly faster takeover times than the continuous visual-only condition, supporting the efficacy of auditory cues in capturing attention during secondary tasks. However, steering response times were not significantly different across groups, with the discrete group showing faster initial steering movements, potentially due to instinctual rather than prepared responses. Interestingly, participants in the discrete condition reported higher levels of comfort and trust in the automation, despite their slower reaction times. Additionally, most participants failed to detect silent failures without explicit warnings, highlighting the difficulty of passive monitoring. The findings indicate that continuous, multimodal HMI feedback is critical for maintaining driver situation awareness and ensuring timely takeovers in automated vehicles. While discrete feedback may foster higher subjective trust, it compromises safety by delaying driver re-engagement. The study underscores the importance of designing interfaces that prevent "primary task reversal," where drivers prioritize secondary tasks over driving, and suggests that multimodal warnings are superior for mitigating the risks associated with automation complacency and inattention.

Key finding

Drivers in the continuous visual-auditory feedback condition responded significantly faster to takeover requests than those in the discrete or continuous visual-only conditions.

Methodology

simulator

Sample size: 60

Provenance

The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed. Discovered via bulk_ingest_rosap on 2026-05-23 (6 acquisition events logged).

StageOutcomeToolModelPromptAttemptsCompleted
discover success rosap 2 2026-05-23
archive success 1 2026-05-23
extract success cached 2 2026-06-10
clean success 1 2026-06-01
chunk success 1 2026-06-01
embed success 1 2026-06-02
enrich success 1 2026-05-23
promote success 1 2026-05-23
summarize success llm qwen3.6-27b-prismaquant summ-v5 3 2026-06-10
tag success vector_similarity 19 2026-06-11
verify partial 2 2026-06-10

Summary generated by qwen3.6-27b-prismaquant on 2026-06-10; verification: verified_with_issues.

Topics

Ranked by relevance to this paper. Hover a topic for its definition.

Information type

What kind of knowledge this paper contributes, grouped by family — independent of topic (what it is about) and method (how it was studied).