Accessing Multi-Modal Information on Cell Phones While Sitting and Driving

Fussell, Susan R.; Grenville, Delia; Kiesler, Sara; Forlizzi, Jodi; Wichansky, Anna M. · 2002 · Crossref

DOI: 10.1177/154193120204602207

archive: archived pipeline: cataloged verified

Get this paper ↗ (DOI — opens at the source; we link to it, we don't host it)

Summary

This study investigates the usability and safety of multimodal interfaces on mobile devices, specifically examining whether adding audio output to text-based long lists improves performance and safety for users operating cell phones while stationary versus driving. The research addresses the challenge of designing interfaces for small screens that minimize visual and motor demands, particularly in contexts like vehicle telematics where users must divide attention between the device and their environment. The authors hypothesized that audio might reduce visual load, thereby aiding users who are driving. The researchers conducted a within-subjects factorial experiment with 30 participants who performed hotel reservation tasks on a Mitsubishi T250 cell phone. The design varied three factors: interface modality (text-only vs. text with optional audio), user context (sitting at a desk vs. driving in a car simulator), and task difficulty (low vs. high cognitive complexity). Participants selected hotels from long lists and answered questions about amenities. Data collected included task completion times, driving performance metrics (lane deviation), self-reported workload, and visual attention directed toward the phone. Results indicated that modality preference was highly context-dependent. While seated, participants rarely used the audio option, preferring text. However, while driving, a substantial portion of participants chose to use audio, particularly during high-difficulty tasks. Despite this preference, using audio increased task completion time significantly compared to text-only viewing, as speech presents information sequentially rather than allowing simultaneous scanning. Crucially, the use of audio did not improve driving performance; participants who used audio still veered out of lane frequently during difficult tasks. Furthermore, participants who chose audio directed less visual attention to the phone, but this did not translate to safer driving or faster task completion. The study concludes that adding audio to mobile interfaces is not a straightforward solution for reducing cognitive load or improving safety. While audio reduces visual fixation on the device, it introduces temporal delays that slow down information retrieval without enhancing driving performance. The findings suggest that users will likely continue to prefer text-based interfaces when stationary and may only adopt audio when visually constrained, such as while driving, despite its inefficiencies. The authors recommend further exploration of design alternatives, such as dynamic screen dimming or breaking lists into smaller chunks, to better balance usability and safety in mobile environments.

Provenance

The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed.

Summary generated by qwen3.6-27b-prismaquant on 2026-06-25; verification: verified.

Topics

Ranked by relevance to this paper. Hover a topic for its definition.

• auditory
• mobile phones
• visual manual

Information type

What kind of knowledge this paper contributes, grouped by family — independent of topic (what it is about) and method (how it was studied).

• Applied Guidance: design guidelines
• Empirical Findings: observational prevalence