A Review of Situation Awareness Assessment Approaches in Aviation Environments
DOI: 10.1109/jsyst.2019.2918283
archive: archived pipeline: cataloged verified
Get this paper ↗ (DOI — opens at the source; we link to it, we don't host it)
Summary
This review paper addresses the critical need for effective Situation Awareness (SA) assessment in aviation environments, where loss of SA is a primary contributor to accidents such as controlled-flight-into-terrain (CFIT) and runway incursions. Motivated by statistics indicating that 70% of air accidents result from flight crew actions, the authors aim to consolidate existing measurement models and theoretical frameworks to improve pilot training and flight safety. The paper examines SA across individual, team, and system levels, providing a comprehensive overview of assessment techniques used in cockpits, air traffic control, and unmanned aerial vehicles. The authors categorize SA measurement approaches into six distinct methods: freeze-probe, real-time probe, post-trial self-rating, observer-rating, performance measures, and process indices. Freeze-probe techniques, such as the Situation Awareness Global Assessment Technique (SAGAT), involve pausing tasks to query subjects, offering objective data but suffering from high intrusion and implementation difficulties in real-world settings. Real-time probes, like SPAM, administer queries during task execution, reducing intrusion but potentially biasing results and burdening subject matter experts. Post-trial self-ratings (e.g., SART) are non-intrusive and cost-effective but rely on subjective recall, which is often inaccurate. Observer-ratings and performance measures are non-intrusive but face validity issues, as external behaviors or task success do not always correlate with internal SA states. Process indices, such as eye-tracking, provide indirect measures of attention but are limited by equipment constraints and the "look but do not see" phenomenon. The review further analyzes theoretical SA models, shifting from early individualistic cognitive models to more complex frameworks. Individual SA models focus on perception, comprehension, and prediction but assume a cognitive phenomenon residing solely in the operator’s mind. Team and shared SA models, such as the Coordinated Awareness of Situations by Teams (CAST), emphasize interactions and mutual beliefs among team members, addressing the limitations of aggregating individual assessments. System and distributed SA models, including Distributed SA (DSA) and Event Analysis of Systemic Teamwork, treat SA as a property of socio-technical systems, distributed among humans and technical artifacts. These models highlight the importance of information flow and transactions within the system rather than individual cognition alone. The significance of this work lies in its systematic comparison of assessment tools and theoretical perspectives, highlighting the shortcomings of current state-of-the-art methods. The authors conclude that no single model is universally superior; rather, the choice of assessment method depends on the specific operational context and the level of SA being measured. The paper identifies future research directions, particularly in addressing the challenges of assessing SA in dynamic, unpredictable environments and in developing methods that can effectively quantify team and system-level awareness without significant intrusion or bias. This synthesis provides a foundational reference for researchers and practitioners aiming to enhance human-machine system reliability in aviation.
Provenance
The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed.
| Stage | Outcome | Tool | Model | Prompt | Attempts | Completed |
|---|---|---|---|---|---|---|
| discover | success | OpenAlex-citations | — | — | 1 | 2026-06-17 |
| archive | success | unpaywall | — | — | 2 | 2026-06-25 |
| extract | success | cached | — | — | 2 | 2026-06-25 |
| clean | success | clean | — | — | 1 | 2026-06-18 |
| chunk | success | chunk | — | — | 1 | 2026-06-18 |
| embed | success | embed | Qwen/Qwen3-Embedding-8B | — | 1 | 2026-06-18 |
| promote | success | — | — | — | 1 | 2026-06-17 |
| summarize | success | llm | qwen3.6-27b-prismaquant | summ-v5 | 1 | 2026-06-25 |
| tag | success | vector_similarity | — | — | 6 | 2026-06-18 |
| verify | partial | — | — | — | 1 | 2026-06-26 |
Summary generated by qwen3.6-27b-prismaquant on 2026-06-25; verification: verified_with_issues.
Topics
Ranked by relevance to this paper. Hover a topic for its definition.
Information type
What kind of knowledge this paper contributes, grouped by family — independent of topic (what it is about) and method (how it was studied).
- Theoretical Contribution: conceptual framework, theory or model