The AUTONAV/DOT Project: Baseline Measurement System for Evaluation of Roadway Departure Warning Systems
archive: archived pipeline: cataloged verified
Get this paper ↗ (full text — opens at the source; we link to it, we don't host it)
Summary
This report details the development of a Baseline Measurement System (BMS) designed to quantitatively evaluate the performance of roadway departure warning systems. Sponsored by the National Highway Traffic Safety Administration (NHTSA) and conducted by the National Institute of Standards and Technology (NIST), the project addresses the need for standardized, objective metrics to assess highway safety technologies. The primary challenge is establishing a reference measurement of vehicle position and lane departure that is more accurate than the warning system being tested, allowing for precise comparison of system reliability, failure rates, and false alarms. The BMS integrates two main subsystems: a high-precision navigation unit and a video recording system. The navigation component combines a carrier phase differential Global Positioning System (GPS) with an Inertial Navigation System (INS) to determine vehicle position and velocity. A Kalman filter fuses these data sources to mitigate INS drift and GPS signal dropouts. The second component involves a calibrated, downward-looking camera aimed at the road surface adjacent to the vehicle. This camera captures video data synchronized with GPS/INS coordinates and the warning system’s output. The system records this data digitally, enabling post-run analysis rather than real-time processing. Calibration procedures transform image pixel coordinates into road-surface and GPS coordinates, ensuring spatial accuracy. To evaluate a warning system, the BMS is installed on a test vehicle alongside the system under review. Data collection involves driving maneuvers that simulate various operational conditions, including different lighting, weather, road surfaces, and lane marker types. Drivers perform specific actions, such as maintaining proximity to lane markers and intentionally crossing them, to generate both true departure incidents and non-departure scenarios. Post-collection software automatically analyzes the video to detect lane crossings, which serves as the ground truth. The warning system’s alerts are compared against this baseline to calculate performance metrics. The report defines "general reliability" as the ratio of correct outcomes (true positives and true negatives) to all outcomes, and "critical reliability" as the ratio of true positives to all actual departures (true positives plus false negatives). It also defines failure and false alarm rates based on these comparisons. The study concludes that the BMS is sufficiently mature for evaluating roadway departure warning systems. Validation tests demonstrated that the system could accurately determine the time and position of roadway departures and identify delays in GPS data. By providing a high-accuracy baseline, the BMS enables researchers to quantify system performance objectively, identify causes of failure such as insufficient roadway markings, and assess reliability across diverse driving conditions. This framework supports the broader goal of improving highway safety through the rigorous testing of collision avoidance and driver warning technologies.
Key finding
The Baseline Measurement System successfully provides a high-accuracy reference for vehicle position and lane departure timing, enabling quantitative evaluation of warning system reliability and error rates.
Methodology
field_study
Provenance
The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed. Discovered via bulk_ingest_rosap on 2026-05-23 (6 acquisition events logged).
| Stage | Outcome | Tool | Model | Prompt | Attempts | Completed |
|---|---|---|---|---|---|---|
| discover | success | rosap | — | — | 2 | 2026-05-23 |
| archive | success | — | — | — | 1 | 2026-05-23 |
| extract | success | cached | — | — | 2 | 2026-06-10 |
| clean | success | — | — | — | 1 | 2026-06-01 |
| chunk | success | — | — | — | 1 | 2026-06-01 |
| embed | success | — | — | — | 1 | 2026-06-02 |
| enrich | success | — | — | — | 1 | 2026-05-23 |
| promote | success | — | — | — | 1 | 2026-05-23 |
| summarize | success | llm | qwen3.6-27b-prismaquant | summ-v5 | 3 | 2026-06-10 |
| tag | success | vector_similarity | — | — | 19 | 2026-06-11 |
| verify | success | — | — | — | 2 | 2026-06-10 |
Summary generated by qwen3.6-27b-prismaquant on 2026-06-10; verification: verified.
Topics
Ranked by relevance to this paper. Hover a topic for its definition.
Information type
What kind of knowledge this paper contributes, grouped by family — independent of topic (what it is about) and method (how it was studied).
- Methodological Resource: validation psychometrics