Methods and Tools for Monitoring Driver's Behavior

Jan, Muhammad Tanveer; Moshfeghi, Sonia; Conniff, Joshua William; Jang, Jinwoo; Yang, KwangSoo; Zhai, Jiannan; Rosselli, Mónica; Newman, David; Tappen, Ruth M.; Furht, Borko · 2022 · Unknown

DOI: 10.1109/csci58124.2022.00228

archive: archived pipeline: cataloged verified

Get this paper ↗ (DOI — opens at the source; we link to it, we don't host it)

Summary

This paper presents an innovative architecture for unobtrusive in-vehicle sensors designed to monitor driver behavior and detect early cognitive decline, specifically in older adults with mild cognitive impairment or early dementia. The research is motivated by the high prevalence of Alzheimer’s disease and cognitive impairment among older adults, which eventually renders them unable to drive safely. While existing driver alert systems focus on immediate accident prevention, this project aims to identify long-term cognitive changes through continuous monitoring. The work is part of a five-year National Institutes of Health (NIH) funded study targeting drivers aged 65 to 85. The proposed system integrates two primary sensing units: in-vehicle vision sensors and telematics sensors. The vision unit, mounted on the windshield, utilizes forward-facing and driver-facing cameras to track eye and head movements, facial micro-expressions, and environmental factors. Specific computer vision algorithms detect face regions of interest, eye openness, yawning, head pose for distraction, and object use such as smoking or phone handling. The forward camera monitors traffic signs, lane markings, and potential hazards like pedestrians or cyclists. The telematics unit comprises an on-chip Real-Time Kinematic Global Navigation Satellite System (RTK GNSS) module for high-precision positioning, an On-Board Diagnostics (OBD) scanner for vehicle state data, and an Inertial Measurement Unit (IMU) to capture dynamic motions like harsh acceleration and braking. These components are fused to create detailed Driver Behavior Indices (DBIs). The study categorizes DBIs into travel patterns, abnormal driving behaviors, reaction times, and braking patterns. These indices are evaluated daily, weekly, and monthly to reflect cognitive function. For instance, reaction time is measured against traffic light changes and potholes, while abnormal driving includes metrics like wayfinding errors, ignoring signals, and near-collision events. The paper illustrates the system’s capability by showing driving pattern data from two senior drivers over a two-week period, highlighting metrics such as eye closure frequency, distractions, and lane crossings. The architecture supports real-time data processing and local storage, with data uploaded to a central database during quarterly cognitive testing visits. The significance of this work lies in its application to a fully powered, culturally diverse study of older drivers, addressing limitations in previous research regarding sample size and duration. The sensor system has already been installed in approximately 70 vehicles in Florida. The ultimate goal is to identify drivers whose behavioral changes indicate early dementia, thereby contributing to safer driving practices and earlier medical intervention. The authors note that detailed results from the longitudinal study will be published in future works.

Key finding

An integrated in-vehicle sensor architecture combining vision and telematics data has been deployed in approximately 70 vehicles to monitor driving behaviors and detect early cognitive decline in older drivers.

Methodology

field_study

Sample size: 70

Provenance

The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed. Discovered via author_sweep_intake on 2026-05-28.

StageOutcomeToolModelPromptAttemptsCompleted
discover success author_sweep 2 2026-05-28
archive success canonical_url 11 2026-06-06
extract success cached 3 2026-06-10
clean success clean 1 2026-06-04
chunk success chunk 1 2026-06-04
embed success embed Qwen/Qwen3-Embedding-8B 1 2026-06-04
enrich success 1 2026-05-28
promote success 1 2026-06-04
summarize success llm qwen3.6-27b-prismaquant summ-v5 2 2026-06-10
tag success vector_similarity 15 2026-06-11
verify success 2 2026-06-10

Summary generated by qwen3.6-27b-prismaquant on 2026-06-10; verification: verified.

Topics

Ranked by relevance to this paper. Hover a topic for its definition.

Information type

What kind of knowledge this paper contributes, grouped by family — independent of topic (what it is about) and method (how it was studied).