DIRECT Operational Field Test Evaluation: Natural Use Study: Part 2: Driver Satisfaction in DIRECT Controlling for Reliability
archive: archived pipeline: cataloged verified
Get this paper ↗ (full text — opens at the source; we link to it, we don't host it)
Summary
This paper evaluates driver satisfaction with four low-cost Advanced Traveler Information Systems (ATIS) during the DIRECT (Driver Information Radio using Experimental Communication Technologies) operational field test. The study was motivated by the need to assess the relative merits of emerging traffic information technologies compared to standard commercial radio broadcasts, while addressing the challenge that pre-market implementations often suffer from reliability issues that conf user satisfaction metrics. The four systems tested were Automatic Highway Advisory Radio (AHAR), Low Power Highway Advisory Radio (LPHAR), Cellular telephone call-in, and Radio Data System (RDS/SCA). These were compared against a control group using standard radios. The primary research question focused on determining driver preferences and satisfaction levels when the impact of system reliability was statistically controlled, allowing for a fairer comparison of the underlying service features. The study employed a natural-use, quasi-experimental design along the I-75 corridor in Detroit. A total of 150 subjects participated over 15 months, divided into six two-month periods. Participants were randomly assigned to one of the four technology groups or the control group and drove project-supplied vehicles during their daily commutes. Data collection involved surveys and interviews conducted one week and two months into each participant’s tenure, capturing cognitive measures such as perceived accuracy, timeliness, relevance, and satisfaction. To isolate the effect of reliability, the researchers utilized a combination of Principal Component Analysis (PCA) and regression analysis. The PCA reduced 15 system attributes into four principal components accounting for 73% of the total variance: system reliability, information targeting, human factors (ease of use/convenience), and driver distraction. These component scores were then used as explanatory variables in regression models to estimate driver satisfaction. The results indicated that the four principal components positively influenced driver satisfaction, explaining 53% to 66% of the variation in satisfaction scores. A key finding emerged when comparing satisfaction with and without controlling for reliability. Without controlling for reliability, the RDS/SCA system and the control group performed similarly. However, when reliability was statistically equalized across all groups, RDS/SCA emerged as the most preferred system. Additionally, paired samples tests revealed significant mean differences in outcome variables between the controlled and uncontrolled conditions. The four experimental systems showed greater improvement in outcome indicators than the control group when reliability was accounted for, suggesting that the perceived inferiority of some systems was largely driven by technical failures rather than inherent design flaws. The significance of this study lies in its methodological approach to evaluating pre-market technologies. By controlling for reliability, the researchers provided a more grounded assessment of the relative value of different ATIS delivery methods. The findings suggest that RDS/SCA has strong potential for deployment if reliability issues are resolved, and that low-cost, voice-based systems can offer meaningful benefits over traditional radio broadcasts. The study underscores the importance of separating technical reliability from service utility in field tests, offering valuable insights for service providers, automotive manufacturers, and public agencies involved in deploying traveler information systems.
Key finding
When system reliability was statistically controlled, the RDS/SCA system became the most preferred traffic information system, whereas it performed similarly to the standard radio control group when reliability issues were not accounted for.
Methodology
field_study
Sample size: 150
Provenance
The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed. Discovered via bulk_ingest_rosap on 2026-05-23 (6 acquisition events logged).
| Stage | Outcome | Tool | Model | Prompt | Attempts | Completed |
|---|---|---|---|---|---|---|
| discover | success | rosap | — | — | 2 | 2026-05-23 |
| archive | success | — | — | — | 1 | 2026-05-23 |
| extract | success | cached | — | — | 2 | 2026-06-10 |
| clean | success | — | — | — | 1 | 2026-06-01 |
| chunk | success | — | — | — | 1 | 2026-06-01 |
| embed | success | — | — | — | 1 | 2026-06-02 |
| enrich | success | — | — | — | 1 | 2026-05-23 |
| promote | success | — | — | — | 1 | 2026-05-23 |
| summarize | success | llm | qwen3.6-27b-prismaquant | summ-v5 | 3 | 2026-06-10 |
| tag | success | vector_similarity | — | — | 19 | 2026-06-11 |
| verify | success | — | — | — | 2 | 2026-06-10 |
Summary generated by qwen3.6-27b-prismaquant on 2026-06-10; verification: verified.
Topics
Ranked by relevance to this paper. Hover a topic for its definition.
Information type
What kind of knowledge this paper contributes, grouped by family — independent of topic (what it is about) and method (how it was studied).
- Empirical Findings: self report data, observational prevalence
- Methodological Resource: validation psychometrics