Investigating and Developing Methods for Traditional Participant-based Data Collection with Remote Experimenters
archive: archived pipeline: cataloged verified
Get this paper ↗ (full text — opens at the source; we link to it, we don't host it)
Summary
This report details the development of remote experimentation methods and technologies for participant-based data collection in automotive research, motivated by the disruptions caused by the COVID-19 pandemic. The primary research problem addressed is the challenge of conducting traditional experimenter-conducted studies without physically placing researchers in the vehicle. While remote experimentation was initially conceived as a safety mitigation, the authors identified significant methodological benefits, particularly for studying automated driving systems (ADS). Removing the experimenter from the vehicle eliminates the "safety net" effect, where participants rely on the researcher’s presence, thereby eliciting more naturalistic behavior and better replicating real-world ADS experiences. The methodology involved a multi-stage process beginning with a review of internal Virginia Tech Transportation Institute (VTTI) research protocols to define requirements, including real-time data monitoring, two-way communication, vehicle localization, and privacy protection. A market scan revealed that off-the-shelf solutions like Zoom lacked necessary vehicle telemetry integration and raised privacy concerns, while specialized remote operation platforms were prohibitively expensive. Consequently, the team developed a custom desktop application called "EagleEye." This tool integrates open-source frameworks, including Streetscape.gl for map visualization and the XVIZ data specification, with the MQTT protocol for low-latency data transmission. The system allows remote experimenters to view vehicle cabin video, monitor parameters like speed and acceleration, and communicate with participants via peer-to-peer video conferencing (Jitsi), ensuring data remains on VTTI servers. The results demonstrate that the EagleEye tool successfully supports remote monitoring with end-to-end latencies typically under 100 ms. The system was validated through a test study involving blind and low-vision participants evaluating human-machine interfaces in a simulated ADS environment. The remote setup allowed participants to feel isolated in the vehicle, increasing study realism, while the researcher maintained oversight. However, the team noted limitations: occasional communication losses made the system unsuitable for safety-critical interventions or studies requiring surprise events. Feedback from experienced experimenters highlighted the need for additional features, such as visualizing intended study routes and enabling remote control of vehicle systems. The significance of this work lies in its potential to enhance the fidelity of behavioral research in transportation. By enabling remote experimentation, researchers can conduct studies that yield more natural participant responses, particularly in ADS contexts. The report concludes that while the technology is robust for human behavioral monitoring, it requires careful protocol design to ensure participant safety, emphasizing simple tasks and routes with reliable cellular coverage. The developed tools have already been integrated into other research projects, demonstrating their utility for continuing research during disruptions and improving experimental design for naturalistic driving studies.
Key finding
The developed remote experimenter tool successfully enabled real-time monitoring and interaction with vehicle occupants, improving study realism by removing the in-vehicle experimenter, though it is not suitable for safety-critical interventions due to communication latency and reliability constraints.
Methodology
mixed_methods
Provenance
The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed. Discovered via bulk_ingest_rosap on 2026-05-23 (6 acquisition events logged).
| Stage | Outcome | Tool | Model | Prompt | Attempts | Completed |
|---|---|---|---|---|---|---|
| discover | success | rosap | — | — | 2 | 2026-05-23 |
| archive | success | — | — | — | 1 | 2026-05-23 |
| extract | success | cached | — | — | 2 | 2026-06-10 |
| clean | success | — | — | — | 1 | 2026-06-01 |
| chunk | success | — | — | — | 1 | 2026-06-01 |
| embed | success | — | — | — | 1 | 2026-06-02 |
| enrich | success | — | — | — | 1 | 2026-05-23 |
| promote | success | — | — | — | 1 | 2026-05-23 |
| summarize | success | llm | qwen3.6-27b-prismaquant | summ-v5 | 3 | 2026-06-10 |
| tag | success | vector_similarity | — | — | 19 | 2026-06-11 |
| verify | success | — | — | — | 2 | 2026-06-10 |
Summary generated by qwen3.6-27b-prismaquant on 2026-06-10; verification: verified.
Topics
Ranked by relevance to this paper. Hover a topic for its definition.
Information type
What kind of knowledge this paper contributes, grouped by family — independent of topic (what it is about) and method (how it was studied).
- Methodological Resource: tool software, measurement protocol, dataset resource