Driver Training for Shared Autonomy Systems Using Mixed Reality
archive: archived pipeline: cataloged verified
Get this paper ↗ (full text — opens at the source; we link to it, we don't host it)
Summary
This research addresses the critical need for safe, accessible driver training for vulnerable populations, specifically teenage novices and older adults experiencing cognitive decline. The study is motivated by the high costs of elder care, the demographic shift toward an aging population, and the persistent risk of motor vehicle crashes among inexperienced teen drivers. Traditional training methods cannot safely expose learners to hazardous scenarios, while the revocation of driving privileges often severely impacts the autonomy and quality of life of seniors. The project aims to develop a Mixed Reality (MR) driver training system that allows users to practice in a stationary real vehicle, using augmented reality passthrough to view real controls while experiencing simulated, risky driving environments. This approach seeks to mediate shared autonomy between human drivers and autonomous systems, ensuring safety while maintaining user control. The researchers developed a prototype simulator using a Meta Quest 3 headset for MR visualization, paired with a Fanatec steering wheel and pedal system to provide realistic force feedback, replacing an earlier Logitech setup that proved inadequate. To enhance immersion and reduce simulator sickness, the system incorporated a real car seat with a seatbelt, a vibration seat cover for tactile feedback, and fans to simulate wind speed. The software was built using Unity 3D and C# scripting, featuring a progressive curriculum with nine levels of increasing difficulty, ranging from basic speed control to complex hazards like fog, ice, and aggressive traffic. The system was piloted at the Driven2Drive driving school in Bala Cynwyd, Pennsylvania, and deployed for self-service use by students. Additionally, a specific pilot study involved 23 participants aged 16–30 who completed a parallel parking scenario and rated the simulator’s efficacy. Results indicate that the simulator was successfully adopted by the driving school and identified as particularly useful for individuals with physical disabilities, high anxiety, or cognitive impairments. In the pilot study, 86% of participants agreed or strongly agreed that the simulator would be helpful for driver education. Survey data revealed strong positive correlations between the simulator’s perceived usefulness and its immersiveness, intuitiveness, and fun factor. However, the team identified simulator sickness—caused by sensory mismatch between visual motion and physical sensation—as a primary challenge. Future work focuses on validating the platform further and transitioning the experience into actual vehicles to leverage real tactile feedback, thereby bridging the gap between simulation and real-world driving.
Key finding
Participants in the pilot study strongly agreed that the mixed reality driving simulator was helpful for driver education, with perceived usefulness significantly correlated with the system's immersion and intuitiveness.
Methodology
lab_experiment
Sample size: 23
Provenance
The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed. Discovered via bulk_ingest_rosap on 2026-05-23 (6 acquisition events logged).
| Stage | Outcome | Tool | Model | Prompt | Attempts | Completed |
|---|---|---|---|---|---|---|
| discover | success | rosap | — | — | 2 | 2026-05-23 |
| archive | success | — | — | — | 1 | 2026-05-23 |
| extract | success | cached | — | — | 2 | 2026-06-10 |
| clean | success | — | — | — | 1 | 2026-06-01 |
| chunk | success | — | — | — | 1 | 2026-06-01 |
| embed | success | — | — | — | 1 | 2026-06-02 |
| enrich | success | — | — | — | 1 | 2026-05-23 |
| promote | success | — | — | — | 1 | 2026-05-23 |
| summarize | success | llm | qwen3.6-27b-prismaquant | summ-v5 | 3 | 2026-06-10 |
| tag | success | vector_similarity | — | — | 19 | 2026-06-11 |
| verify | success | — | — | — | 2 | 2026-06-10 |
Summary generated by qwen3.6-27b-prismaquant on 2026-06-10; verification: verified.
Topics
Ranked by relevance to this paper. Hover a topic for its definition.
- simulator training transfer
- in vehicle coaching
- simulator validity fidelity
- situational awareness
- hud ar windshield
Information type
What kind of knowledge this paper contributes, grouped by family — independent of topic (what it is about) and method (how it was studied).
- Methodological Resource: tool software, validation psychometrics
- Theoretical Contribution: computational model