A review of human-automation interaction and lessons learned
archive: archived pipeline: cataloged verified
Get this paper ↗ (full text — opens at the source; we link to it, we don't host it)
Summary
This report, commissioned by the NASA Airspace Systems Program and authored by Thomas B. Sheridan and Eric D. Nadler, reviews human-automation interaction failures to derive lessons for the Next Generation Air Transportation System (NGATS). The authors argue that most accidents involving automation are not random machine failures or isolated human errors, but rather preventable outcomes of poor human-machine system design. The study aims to identify causal factors related to hardware, software, procedures, management, and training that contribute to these failures. The methodology involves a retrospective analysis of 37 accident and failure events across aviation, other transportation systems, process control, and other complex domains. The authors categorize these incidents to highlight specific interaction flaws. Aviation cases include the Korean Airlines Flight 007 incident, attributed to flawed mode indications; the China Airlines 747 engine malfunction, linked to pilot fatigue and over-reliance on autopilot; and the Simmons Airlines ATR-72 crash, caused by an unexpected autopilot disengagement due to icing. Other significant aviation examples include the Lockheed L-1011 and Airbus A300 accidents, where automation state changes were not adequately communicated to pilots, and the 2002 Überlingen midair collision, where conflicting instructions between air traffic control and the Traffic Collision Avoidance System (TCAS) led to a fatal decision by the pilot. Non-aviation cases include the Bhopal chemical leak, the Three Mile Island nuclear meltdown, and interface failures in medical devices and voting systems. The findings indicate that failures frequently stem from mismatches between the operator’s mental model and the automated system’s behavior, lack of salient feedback regarding automation states, and over-reliance on automation leading to undermonitoring. Specific design deficiencies identified include ambiguous mode indications, passive warning systems that fail to capture attention, and software glitches that provide incorrect data. The report also highlights organizational and procedural failures, such as shortcutting maintenance procedures, poor coordination between agencies, and inadequate training. The authors emphasize that many accidents result from "Swiss cheese" scenarios where multiple latent failures align, rather than a single point of failure. The significance of this review lies in its application to the design of future transportation systems. The authors conclude that improving human-automation interaction requires addressing function allocation, ensuring clear communication of automation states, and mitigating characteristic human biases such as naive trust and mystification of automated systems. They advocate for a shift in safety culture that moves away from blaming individual operators toward recognizing systemic design flaws. The report provides specific caveats and recommendations for engineers and designers, emphasizing that behavioral science insights are essential for creating robust, safe automation interfaces that account for human limitations and operational realities.
Key finding
Most human-automation interaction failures are caused by poor system design elements such as inadequate feedback on automation states and mode confusion, rather than random machine or human error.
Methodology
review
Sample size: 37
Provenance
The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed. Discovered via bulk_ingest_rosap on 2026-05-23 (6 acquisition events logged).
| Stage | Outcome | Tool | Model | Prompt | Attempts | Completed |
|---|---|---|---|---|---|---|
| discover | success | rosap | — | — | 2 | 2026-05-23 |
| archive | success | — | — | — | 1 | 2026-05-23 |
| extract | success | cached | — | — | 2 | 2026-06-10 |
| clean | success | — | — | — | 1 | 2026-06-01 |
| chunk | success | — | — | — | 1 | 2026-06-01 |
| embed | success | — | — | — | 1 | 2026-06-02 |
| enrich | success | — | — | — | 1 | 2026-05-23 |
| promote | success | — | — | — | 1 | 2026-05-23 |
| summarize | success | llm | qwen3.6-27b-prismaquant | summ-v5 | 3 | 2026-06-10 |
| tag | success | vector_similarity | — | — | 19 | 2026-06-11 |
| verify | success | — | — | — | 2 | 2026-06-10 |
Summary generated by qwen3.6-27b-prismaquant on 2026-06-10; verification: verified.
Topics
Ranked by relevance to this paper. Hover a topic for its definition.