Spatial Gaze Markers: Supporting Effective Task Switching in Augmented Reality

Lystbæk, Mathias N.; Pfeuffer, Ken; Langlotz, Tobias; Grønbæk, Jens Emil Sloth; Gellersen, Hans · 2024 · OpenAlex-citations

DOI: 10.1145/3613904.3642811

archive: archived pipeline: cataloged verified

Get this paper ↗ (DOI — opens at the source; we link to it, we don't host it)

Summary

This paper introduces Spatial Gaze Markers (SGM), an augmented reality (AR) technique designed to support effective task switching by providing implicit spatial reminders. The research addresses the challenge of spatial memory degradation during task interruptions, particularly in complex 3D environments where users must frequently shift attention between different physical spaces. Unlike previous systems that require specific knowledge of tasks or objects, SGM is task-agnostic, relying solely on eye-tracking data to detect when a user’s attention shifts away from a focal point and placing a visual marker at that last gaze position. This marker guides the user back to their previous point of interest upon return, aiming to reduce visual search time and cognitive load without requiring explicit user interaction. The authors implemented SGM using the Microsoft HoloLens 2, leveraging its eye-tracking and 3D environment mapping capabilities. The system detects fixations using a real-time I-DT algorithm and identifies attention shifts when the user’s head turns more than 33 degrees away from the previous fixation. A transparent magenta circle is then rendered at the last fixated location and removed once the user regazes the area. To evaluate the system, the researchers conducted a user study with 20 participants performing two simulated repair and inspection tasks. These tasks required users to inspect a grid of similar-looking objects, switch to a separate tool area to find a matching item, and return to the original location. The study employed a within-subject design comparing SGM against a no-marker baseline, with variations in task distraction (a secondary mathematical task) and task type (highlighted targets vs. manual search). Results demonstrated that SGM significantly improved performance in the repair task. Users employing SGM exhibited faster relocalization times and fewer rechecks compared to the baseline, regardless of whether they were distracted. Specifically, SGM reduced relocalization time from approximately 5.1 to 7.1 seconds (baseline) to 3.0 to 3.4 seconds (SGM). The system also lowered perceived mental demand and effort, as measured by the NASA-TLX questionnaire. In the inspection task, where users built spatial memory through systematic searching, SGM still reduced rechecks significantly, though the difference in relocalization time was not statistically significant. Error rates remained low and did not differ significantly between conditions. The study concludes that Spatial Gaze Markers provide a simple, effective mechanism for supporting task resumption in AR-assisted physical work. By offloading spatial memory demands, SGM allows users to switch tasks with less cognitive effort and faster recovery times, even under distracting conditions. The findings suggest that implicit, gaze-based cues can enhance efficiency in complex, multi-step workflows without requiring detailed task modeling, offering a scalable solution for AR applications in industrial and maintenance contexts.

Provenance

The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed.

Summary generated by qwen3.6-27b-prismaquant on 2026-06-25; verification: verified.

Topics

Ranked by relevance to this paper. Hover a topic for its definition.

• task switching