Augmented Journeys: Interactive Points of Interest for In-Car Augmented Reality
archive: archived pipeline: cataloged verified
Get this paper ↗ (DOI — opens at the source; we link to it, we don't host it)
Summary
This paper addresses the growing need for engaging non-driving related tasks (NDRTs) for vehicle passengers, particularly as autonomous driving shifts users from drivers to passengers. The authors propose an in-car Augmented Reality (AR) system that allows passengers to interact with world-fixed Points of Interest (POIs) in their surroundings. The research aims to determine effective interaction techniques and visualization methods for exploring both upcoming and missed POIs, thereby enhancing passenger engagement with the external environment. The study employed a multi-phase methodology involving a survey, a pre-study, and a main field study. First, a survey of 110 participants revealed that passengers frequently struggle to recall missed POIs and prefer manual saving features, with name, category, and description being critical identification factors. Second, a pre-study with 10 participants evaluated the feasibility of using eye-gaze combined with a hardware button to select world-fixed POIs in a moving vehicle. Third, a main within-subjects field study with 21 participants evaluated a prototype using a video see-through head-mounted display (Varjo XR-3). Participants used eye-gaze and hand pinch gestures to interact with world-fixed POIs and explored passed/upcoming POIs using three distinct seat-fixed visualization techniques: a List, a Timeline, and a Minimap. The pre-study confirmed that eye-gaze with hardware confirmation is a feasible interaction method for world-fixed objects, yielding high usability scores (SUS mean of 86.0) and acceptable workload levels, despite higher error rates compared to car-fixed interactions due to the moving nature of the targets. In the main study, the system was generally accepted by users. The List visualization was identified as the preferred method for exploring POIs, outperforming the Timeline and Minimap. However, the study highlighted significant limitations regarding current AR hardware, specifically noting that vehicle movement negatively impacts the precision of 3D interactions. The findings suggest that in-car AR can effectively support passenger engagement with the environment, provided that interaction techniques account for vehicular motion. The preference for the List visualization indicates that simple, recognizable interfaces are more effective than complex spatial or chronological representations for this use case. The study contributes to the field by validating eye-gaze and pinch interactions for external AR content and providing design guidelines for future automotive user interfaces focused on passenger experience.
Key finding
List visualization was most preferred (71.4%), best usability (SUS M=78.5), and highest task completion rate (88.1%) for in-car POI exploration via AR. Minimap performed worst (SUS 61.1, 59.5% completion). Eye-gaze + button selection achieved 66.7% accuracy in transit (RTLX 24.8, SUS 86.0).
Methodology
field_study
Provenance
The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed. Discovered via unpaywall on 2026-05-08 (4 acquisition events logged).
| Stage | Outcome | Tool | Model | Prompt | Attempts | Completed |
|---|---|---|---|---|---|---|
| discover | success | — | — | — | 1 | 2026-05-07 |
| archive | success | canonical_url | — | — | 3 | 2026-06-03 |
| extract | success | cached | — | — | 2 | 2026-06-10 |
| clean | success | — | — | — | 1 | 2026-06-01 |
| chunk | success | — | — | — | 1 | 2026-06-01 |
| embed | success | — | — | — | 1 | 2026-06-02 |
| enrich | success | — | — | — | 1 | 2026-05-07 |
| promote | success | — | — | — | 3 | 2026-06-06 |
| summarize | success | llm | qwen3.6-27b-prismaquant | summ-v5 | 2 | 2026-06-10 |
| tag | success | vector_similarity | — | — | 18 | 2026-06-11 |
| verify | success | — | — | — | 2 | 2026-06-10 |
Summary generated by qwen3.6-27b-prismaquant on 2026-06-10; verification: verified.
Topics
Ranked by relevance to this paper. Hover a topic for its definition.
Information type
What kind of knowledge this paper contributes, grouped by family — independent of topic (what it is about) and method (how it was studied).
- Applied Guidance: design guidelines
- Methodological Resource: tool software