Raising Awareness for Confusion - Stimulating the Discussion About Robustness of Mode Awareness Assessment in Automated Driving
DOI: 10.54941/ahfe1007023
archive: archived pipeline: cataloged verified
Get this paper ↗ (DOI — opens at the source; we link to it, we don't host it)
Summary
This paper addresses the methodological challenges in assessing "mode awareness" within automated driving systems, specifically questioning the robustness of inferences drawn from observable driver behaviors. Mode awareness is defined as a complex, latent psychological construct involving a driver’s understanding of the currently active automation mode and their corresponding responsibilities. The authors argue that current research often relies on manifest variables, such as behavioral metrics or self-reports, to infer this mental state. Typically, behavior deemed adequate for the active mode is attributed to mode awareness, while inadequate behavior is attributed to mode confusion. However, the paper contends that this approach is flawed because human behavior is multi-causal; observed actions may result from factors other than cognitive understanding, such as intentional misuse, distraction, trust issues, or risk tolerance. The authors employ a theoretical and methodological analysis rather than empirical experimentation. They review existing literature on mode awareness in aviation and text editing to contextualize the concept in driving. The core of their argument is illustrated through a tree diagram that maps the cognitive processes leading to observable behavior. This model distinguishes between Type 1 awareness (general knowledge of system modes) and Type 2 awareness (awareness of the currently active mode). The diagram demonstrates that mode adequate behavior can occur even without mode awareness (e.g., through coincidence or system nudging), and mode inadequate behavior can occur despite full mode awareness (e.g., deliberate prioritization of non-driving tasks). This visualization highlights the gap between the latent variable of mode awareness and the manifest variables used to measure it. The primary finding is that single-metric assessments of mode awareness lack validity because they cannot rule out alternative explanations for driver behavior. For instance, a driver texting while using a Level 2 system may be doing so due to mode confusion (believing the car is fully automated) or due to intentional misuse (knowing the mode but ignoring responsibilities). The authors conclude that mode awareness and mode confusion are not binary states but exist on a spectrum influenced by background knowledge, cognitive processing, and situational factors. Consequently, relying solely on behavioral outcomes leads to unreliable conclusions about a driver’s mental state. The significance of this work lies in its call for more rigorous, multi-method approaches to assessing human-machine interaction. The authors advocate for combining various metrics to capture the holistic nature of mode awareness, thereby strengthening the objectivity, reliability, and validity of assessments. They urge the research community to move beyond product-oriented evaluations toward process-oriented methods that account for the complexity of human cognition. By stimulating discussion on test quality and the need to rule out alternative explanations, the paper aims to improve the safety and design of future automated driving systems by ensuring that mode awareness is measured accurately.
Provenance
The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed.
| Stage | Outcome | Tool | Model | Prompt | Attempts | Completed |
|---|---|---|---|---|---|---|
| discover | success | Crossref | — | — | 1 | 2026-08-09 |
| archive | success | canonical_url | — | — | 1 | 2026-08-09 |
| extract | success | pdftotext | — | — | 4 | 2026-08-10 |
| clean | success | clean | — | — | 2 | 2026-08-10 |
| chunk | success | chunk | — | — | 2 | 2026-08-10 |
| embed | success | embed | Qwen/Qwen3-Embedding-8B | — | 2 | 2026-08-10 |
| promote | success | — | — | — | 1 | 2026-08-09 |
| summarize | success | llm | qwen3.6-27b-nvidia | summ-v5 | 2 | 2026-08-10 |
| tag | success | vector_similarity | — | — | 17 | 2026-08-11 |
| verify | partial | — | — | — | 2 | 2026-08-10 |
Summary generated by qwen3.6-27b-nvidia on 2026-08-10; verification: verified_with_issues.
Topics
Ranked by relevance to this paper. Hover a topic for its definition.
- mode awareness
- situational awareness
- automation
- automation surprise
- mental model of traffic
- human error taxonomy
Information type
What kind of knowledge this paper contributes, grouped by family — independent of topic (what it is about) and method (how it was studied).
- Theoretical Contribution: conceptual framework, theory or model, computational model