Expanded Situational Awareness Without Vision

Fink, Paul D. S.; Allaban, Anas Abou; Atekha, Omoruyi E.; Perry, Raymond J.; Sumner, Emily; Corey, Richard R.; Dimitrov, Velin; Giudice, Nicholas A. · 2023 · CHI EA

DOI: 10.1145/3568162.3576975

archive: archived pipeline: cataloged verified

Get this paper ↗ (DOI — opens at the source; we link to it, we don't host it)

Summary

This paper addresses the critical accessibility gap in fully autonomous vehicles (FAVs) for people who are blind or visually impaired (BVI). While FAVs offer significant mobility benefits, current interfaces rely heavily on vision, excluding BVI users from controlling critical trip aspects like route changes or emergency stops. The authors argue that haptic interfaces can provide necessary situational awareness and spatial information without vision. To this end, they present and evaluate a novel ultrasonic haptic interface capable of generating mid-air tactile representations of roadway intersections, aiming to support nonvisual navigation for both BVI and sighted users in eyes-free scenarios. The study utilized an Ultrahaptics device, an array of ultrasonic transducers that creates haptic shapes in mid-air using standing waves. To represent intersections, the device employed a simplified sequence: pulsing in the palm to indicate the number of roads, drawing a line toward the direction of each road, and pulsing at the end of the line. This dynamic approach was compared against the "gold standard" of static embossed hard-copy tactile maps. A user study with 14 blindfolded-sighted participants (aged 20–32) assessed their ability to identify the number of roads and their specific clock-face positions (e.g., 3 o’clock, 12 o’clock) using both the ultrasonic interface and the embossed stimuli. The experimental design included 12 randomized intersection patterns for each condition, with order counterbalanced to mitigate learning effects. Results indicated that participants could accurately identify the number of roads using the ultrasonic interface, with all 14 participants succeeding in this metric. In terms of directional accuracy, statistical analysis using a +/-1 clock face step dead-band showed no significant difference between the ultrasonic and embossed conditions (p=0.781), suggesting functional equivalence in practical application. While participants took slightly longer to respond to the ultrasonic stimuli, the median time differences were minimal, and qualitative feedback suggested this delay was negligible given typical intervals between intersections. Furthermore, 64% of participants believed the ultrasonic device could replace physical tactile feedback, and 71% reported improved performance over time. The significance of this work lies in demonstrating that dynamic ultrasonic haptics can effectively convey complex spatial information, such as intersection layouts, without vision. This supports the development of accessible human-machine interfaces for FAVs that do not rely on visual displays. By leveraging the brain’s ability to process spatial information across sensory modalities, this approach offers a viable path for inclusive autonomous transportation, enabling BVI users to maintain situational awareness and control. The study also validates the use of blindfolded-sighted participants as a proxy for early-stage assistive technology evaluation, highlighting the potential for multimodal interfaces to benefit all users during eyes-free driving situations.

Key finding

Participants using the dynamic ultrasonic haptic interface demonstrated comparable accuracy to those using static embossed tactile maps in identifying intersection layouts, supporting the viability of mid-air haptics for nonvisual situational awareness.

Methodology

lab_experiment

Sample size: 14

Provenance

The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed. Discovered via author_sweep_intake on 2026-05-28.

StageOutcomeToolModelPromptAttemptsCompleted
discover success author_sweep 2 2026-05-28
archive success unpaywall 2 2026-06-04
extract success cached 3 2026-06-10
clean success clean 1 2026-06-04
chunk success chunk 1 2026-06-04
embed success embed Qwen/Qwen3-Embedding-8B 1 2026-06-04
enrich success 1 2026-05-28
promote success 1 2026-06-04
summarize success llm qwen3.6-27b-prismaquant summ-v5 2 2026-06-10
tag success vector_similarity 15 2026-06-11
verify success 2 2026-06-10

Summary generated by qwen3.6-27b-prismaquant on 2026-06-10; verification: verified.

Topics

Ranked by relevance to this paper. Hover a topic for its definition.

Information type

What kind of knowledge this paper contributes, grouped by family — independent of topic (what it is about) and method (how it was studied).