Using self-reported data to assess the validity of driving simulation data

Reimer, Bryan; Lisa D’Ambrosio; Coughlin, Joseph F.; Kafrissen, Michael E.; Biederman, Joseph · 2006 · OpenAlex-citations

DOI: 10.3758/bf03192783

archive: archived pipeline: cataloged verified

Get this paper ↗ (DOI — opens at the source; we link to it, we don't host it)

Summary

This study addresses the critical issue of measurement validity in driving simulation research, specifically investigating whether behaviors observed in a simulator accurately reflect real-world driving habits. The motivation stems from the National Transportation Safety Board’s concern regarding the impact of medical conditions on driving safety and the limitations of on-road studies, which pose safety risks and lack experimental control. While driving simulators offer a safe, replicable alternative, critics argue that the absence of real-world risk may alter driver behavior. The authors propose using self-reported survey data as a cost-effective method to validate simulator measures, rather than relying on expensive and impractical on-road comparisons. The researchers conducted a pilot study with 48 active drivers, including 25 participants with Attention Deficit Hyperactivity Disorder (ADHD) and 23 controls. Participants completed a long-duration driving simulation consisting of a 10-minute training phase followed by high-stimulus urban and low-stimulus rural segments. To enhance ecological validity and counteract the lack of physical risk, participants received financial incentives for maintaining speed limits, obeying traffic laws, and completing the task within a target time, with penalties for crashes and violations. Before and after the simulation, participants completed written questionnaires assessing their self-reported driving history, including accidents, speeding tickets, and specific behaviors like lane weaving and stop sign compliance. The study assessed validity through face validity (simulator realism), concurrent validity (regressing simulator behaviors on self-reported measures), and discriminant validity (using a multitrait–multimethod matrix). The results demonstrated significant relationships between simulator performance and self-reported behaviors across six key measures: accidents, speeding, velocity, passing, weaving between traffic, and behavior at stop signs. Concurrent validity was further supported by analyzing the relationship between simulator accident involvement and ADHD status. Although the correlation between self-reported behaviors and simulator responses was not perfect, the data indicated that the simulator measures were valid indicators of the behaviors of interest. The study concluded that while simulator data does not perfectly map onto real-world driving, it provides sufficiently valid measures for research purposes. This approach offers a faster and less expensive means for researchers to establish the validity of driving simulation data, facilitating safer and more controlled studies on how medical conditions and interventions affect driving performance.

Provenance

The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed.

Summary generated by qwen3.6-27b-prismaquant on 2026-06-26; verification: verified_with_issues.

Topics

Ranked by relevance to this paper. Hover a topic for its definition.

• simulator validity fidelity
• simulator training transfer
• simulator sickness
• dbq psychometrics
• exposure measurement
• dms validation

Information type

What kind of knowledge this paper contributes, grouped by family — independent of topic (what it is about) and method (how it was studied).

• Methodological Resource: validation psychometrics, tool software
• Theoretical Contribution: computational model