multimodal feedback
Feedback that deliberately combines two or more sensory channels in one alert, such as visual-auditory, haptic-visual, or audio-tactile warnings, and how the channels are integrated. Distinct from the single-channel tags it merges (haptic_feedback, auditory_warnings, voice_interaction) and from feedback_modes, which discusses channels and timing in general rather than specific combined-modality alerts.
Relevant standards
- Commission Delegated Regulation (EU) 2021/1958 — Commission Delegated Regulation (EU) 2021/1958 supplementing Regulation (EU) 2019/2144 by laying down detailed rules concerning the specific test procedures and technical requirements for the type-approval of motor vehicles with regard to their intelligent speed assistance systems
- Commission Implementing Regulation (EU) 2021/646 — Commission Implementing Regulation (EU) 2021/646 laying down rules for the application of Regulation (EU) 2019/2144 as regards uniform procedures and technical specifications for the type-approval of motor vehicles with regard to their emergency lane-keeping systems (ELKS)
- Euro NCAP Test Protocol – Lane Support Systems v4.2 — Euro NCAP Test Protocol – Lane Support Systems
- ISO 11429:1996 — Ergonomics — System of auditory and visual danger and information signals
- ISO 15005:2017 — Road vehicles — Ergonomic aspects of transport information and control systems — Dialogue management principles and compliance procedures
- ISO 15006:2011 — Road vehicles — Ergonomic aspects of transport information and control systems — Specifications for in-vehicle auditory presentation
- ISO 17386:2023 — Intelligent transport systems — Manoeuvring aids for low-speed operation (MALSO) — Performance requirements and test procedures
- ISO 9921:2003 — Ergonomics — Assessment of speech communication
- ISO/TR 12204:2012 — Road vehicles — Ergonomic aspects of transport information and control systems — Introduction to integrating safety critical and time critical warning signals
- ISO/TR 16352:2005 — Road vehicles — Ergonomic aspects of in-vehicle presentation for transport information and control systems — Warning systems
- SAE J2395 — ITS In-Vehicle Message Priority
- SAE J2400 — Human Factors in Forward Collision Warning Systems: Operating Characteristics and User Interface Requirements
- SAE J2802 — Blind Spot Monitoring System (BSMS): Operating Characteristics and User Interface
- SAE J2808 — Lane Departure Warning Systems: Information for the Human Interface
- UN ECE R131 — Uniform provisions concerning the approval of motor vehicles with regard to Advanced Emergency Braking Systems (AEBS)
- UN ECE R152 — Uniform provisions concerning the approval of motor vehicles with regard to the Advanced Emergency Braking System (AEBS) for M1 and N1 vehicles
- UN ECE R28 — Uniform provisions concerning the approval of audible warning devices and of motor vehicles with regard to their audible signals
91 paper(s) · ranked by relevance to this topic
-
-
Auditory, tactile, and multimodal warnings during automated driving · 2019 · Geitner, R. et al. · archived
-
How to drive drivers nuts: effect of auditory, vibrotactile, and multimodal warnings on perceived urgency, annoyance, and acceptability ↗ · 2017 · Biondi, FN et al. · indexed
-
In-Vehicle Auditory Alerts Literature Review · 2022 · Jeon, Myounghoon et al. · archived
-
Advanced driver assistance systems: Using multimodal redundant warnings to enhance road safety · 2016 · Strayer, David L. et al. · archived
-
-
Advanced driver assistance systems: Using multimodal redundant warnings to enhance road safety ↗ · 2017 · Biondi, FN et al. · indexed
-
Haptic and Auditory Interfaces as a Collision Avoidance Technique During Roadway Departures and Driver Perception of these Modalities · 2006 · Stanley, Laura Michelle · archived
-
Auditory-Visual Redundancy in Vehicle Control Interruptions ↗ · 2011 · Wickens, Christopher D. et al. · indexed
-
Multimodal Information Presentation in Support of NextGen Operations ↗ · 2017 · Riggs, Sara L. et al. · indexed
-
Enhancing Safety in Autonomous Vehicles: The Impact of Auditory and Visual Warning Signals on Driver Behavior and Situational Awareness ↗ · 2024 · Huang, Ann et al. · indexed
-
Exploring False Warnings and Modalities for Emergency Vehicle Alerts and Their Impact on Driver Behavior · 2026 · Weibull, Kajsa et al. · archived
-
A Comparison of Tactile, Visual, and Auditory Warnings for Rear-End Collision Prevention in Simulated Driving ↗ · 2008 · Scott, Jeffrey J et al. · indexed
-
Supporting Interruption Management and Multimodal Interface Design ↗ · 2013 · Lu, Sara A. et al. · indexed
-
Audition and vision share spatial attentional resources, yet attentional load does not disrupt audiovisual integration · 2015 · Wahn, Basil et al. · archived
-
Validations of Integrated Driver Vehicle Interface (DVI) Configurations ↗ · 2017 · Brown, James et al. · indexed
-
Age differences in visual-auditory self-motion perception during a simulated driving task · 2016 · eRamkhalawansingh, Robert et al. · archived
-
Multiple Resources and Display Formatting: The Implications of Task Integration ↗ · 1984 · Wickens, Christopher D. et al. · indexed
-
Crossmodal attentional control sets between vision and audition · 2017 · Mast, Frank et al. · archived
-
Optimizing multimodal alarms to mitigate inattentional blindness in air traffic control · 2025 · Wickens, C. D. · archived
-
Multiple Attribute Evaluation of Auditory Warning Signals for In-Vehicle Crash Avoidance Warning Systems · 1995 · Tan, A.K. et al. · archived
-
Benefits of Stimulus Congruency for Multisensory Facilitation of Visual Learning · 2008 · Kim, Robyn S. et al. · archived
-
Integrated Vehicle-Based Safety Systems (IVBSS): Human Factors and Driver-Vehicle Interface (DVI) Summary Report · 2008 · Green, P. et al. · archived
-
Multimodal Coordination and Attention Capture: The Challenge of Inattentional Blindness for AR-HUD on Complex Roads ↗ · 2025 · Zhu, Qi et al. · indexed
-
-
Two senses are better than one: Enhanced orienting to bimodal cues at short cue-target onset asynchronies ↗ · 2026 · Scott, Luke et al. · indexed
-
Vibrotactile Displays: A Survey With a View on Highly Automated Driving ↗ · 2015 · Petermeijer, Sebastiaan M. et al. · indexed
-
外源性注意与多感觉整合的交互关系 · 2018 · Peng, Xing et al. · archived
-
Vision and Haptics Share Spatial Attentional Resources and Visuotactile Integration Is Not Affected by High Attentional Load ↗ · 2015 · Wahn, Basil et al. · indexed
-
Encouraging Eco-Driving With Visual, Auditory, and Vibrotactile Stimuli ↗ · 2016 · McIlroy, Rich C. et al. · indexed
-
Basic collision warning and driver information systems : human factors research needs : summary report · 1998 · NHTSA · archived
-
Guiding spatial attention by multimodal reward cues · 2022 · Hoofs, Vincent et al. · archived
-
Human factors evaluation of the effectiveness of multi-modality displays in advanced traveler information systems · 1999 · Liu, Yung-Ching et al. · archived
-
Divided attention between simultaneous auditory and visual signals · 1998 · Bonnel, Anne-Marie et al. · archived
-
Earcons to reduce mode confusions in partially automated vehicles: Development and application of an evaluation method · 2023 · Monsaingeon, Noé et al. · archived
-
Audiovisual looming signals are not always prioritised: evidence from exogenous, endogenous and sustained attention ↗ · 2021 · Huygelier, Hanne et al. · indexed
-
Vibrotactile Alert Systems for Aircraft Handoffs Acceptance in Air Traffic Control ↗ · 2026 · de Paz, Carlos et al. · indexed
-
Redundancy, Modality, and Priority in Dual Task Interference ↗ · 2003 · Wickens, Christopher D. et al. · indexed
-
-
Expanded Situational Awareness Without Vision · 2023 · Fink, Paul D. S. et al. · archived
-
Exploring the Effects of Meaningful Tactile Display on Perception and Preference in Automated Vehicles · 2022 · Martinez, Kimberly D et al. · archived
-
Cross-modal psychological refractory period in vision, audition, and haptics · 2020 · Rau, Pei‐Luen Patrick et al. · archived
-
Effect of Visual and Auditory Alerts on Older Drivers’ Glances toward Latent Hazards while Turning Left at Intersections ↗ · 2019 · Bakhtiari, Sarah et al. · indexed
-
Attention Distributed across Sensory Modalities Enhances Perceptual Performance ↗ · 2012 · Mishra, Jyoti et al. · indexed
-
Effects of directional auditory and visual warnings at intersections on reaction times and speed reduction times · 2017 · Bella, Francesco et al. · archived
-
Exploring cross-modal perception in a virtual classroom: the effect of visual stimuli on auditory selective attention · 2025 · Breuer, Carolin et al. · archived
-
Crossmodal links between audition and touch in covert endogenous spatial attention · 2003 · Lloyd, Donna M. et al. · archived
-
Tactile Stimuli Increase Effects of Modality Compatibility in Task Switching ↗ · 2015 · Stephan, Denise Nadine et al. · indexed
-
On measuring selective attention to an expected sensory modality · 1997 · Spence, Charles et al. · archived
-
Preliminary Human Factors Guidelines For Crash Avoidance Warning Devices · 1996 · NHTSA · archived
-
The Effects of Sensory Modality and Information Priority on In-Vehicle Signing and Information Systems ↗ · 1994 · Mollenhauer, Michael et al. · indexed
-
Haptic Warning Characteristics for V2V Safety Applications · 2020 · Marshall, Dawn et al. · archived
-
Complementing Haptic Shared Control With Visual Feedback for Obstacle Avoidance ↗ · 2019 · Abbink, David A. · indexed
-
An Auditory Display for Remote Road Vehicle Operation That Increases Awareness and Presence · 2023 · Larsson, Pontus et al. · archived
-
Auditory Alert Characteristics Impact on Crash Avoidance Warning Response · 2018 · Marshall, Dawn et al. · archived
-
The Effects of Bilateral and Ipsilateral Auditory Stimuli on the Subcomponents of Visual Attention ↗ · 2021 · Fu, Jing et al. · indexed
-
Planning Lane Changes using Advance Visual and Haptic Information · 2022 · Frissen, Ilja et al. · archived
-
-
In-vehicle crash avoidance warning systems : human factors considerations · 1997 · Huey, R. W. et al. · archived
-
Effects Of Spatial and Non-Spatial Multi-Modal Cues on Orienting of Visual-Spatial Attention in an Augmented Environment ↗ · 2007 · Jerome, Christian J. · indexed
-
Signal Design Handbook: A New Framework for Designing Alarms, Alerts, and Warnings in Air Traffic Control · 2025 · Ruskin, Keith J. et al. · archived
-
Live Demonstration: In-Vehicle Auditory Signal Evaluation Platform in A Driving Simulator ↗ · 2023 · Sawa, Fuma et al. · indexed
-
A Handbook for Signal Design: Alarms, Alerts, and Warnings in Air Traffic Control · 2022 · Ruskin, Keith J et al. · archived
-
-
Interruption Management: The Use of Attention-Directing Tactile Cues · 2005 · Hopp, Pamela J. et al. · archived
-
An In-Vehicle Auditory Signal Evaluation Platform based on a Driving Simulator · 2023 · SAWA, Fuma et al. · archived
-
Factors Influencing the Performance Advantage of Speech Technology ↗ · 1981 · Wickens, Christopher D. et al. · indexed
-
Multisensory integration attenuates visually induced oculomotor inhibition of return ↗ · 2022 · Tang, Xiaoyu et al. · indexed
-
Auditory Messages for Intersection Movement Assist (IMA) Systems: Effects of Speech- and Nonspeech-Based Cues ↗ · 2021 · Wu, Xingwei et al. · indexed
-
Increasing the User Experience in Autonomous Driving through different Feedback Modalities ↗ · 2021 · Schneider, Tobias et al. · indexed
-
Novel Auditory Displays in Highly Automated Vehicles: Sonification Improves Driver Situation Awareness, Perceived Workload, and Overall Experience · 2021 · Nadri, Chihab et al. · archived
-
-
Multisensory Congruency Enhances Explicit Awareness in a Sequence Learning Task ↗ · 2017 · Silva, Andrew E. et al. · indexed
-
Cue the effects: Stimulus-action effect modality compatibility and dual-task costs. ↗ · 2020 · Schacherer, Jonathan et al. · indexed
-
Cross-modal interactions at the audiovisual cocktail-party revealed by behavior, ERPs, and neural oscillations ↗ · 2023 · Klatt, Laura‐Isabelle et al. · indexed
-
Analyses of the Drivers’ Responses in Final Surveys to the In-Vehicle Receiver (IVR) · 2004 · Benekohal, Rahim F. et al. · archived
-
Auditory Preemption versus Multiple Resources: Who Wins in Interruption Management? ↗ · 2005 · Wickens, Christopher D. et al. · indexed
-
Vibrotactile pedals: provision of haptic feedback to support economical driving ↗ · 2013 · Birrell, Stewart et al. · indexed
-
Eco-Driving Performance Assessment With in-Car Visual and Haptic Feedback Assistance · 2011 · Azzi, Sabrina et al. · archived
-
Acquisition, Response, and Error Rates With Three Suites of Collision Warning Sounds · 2009 · Sullivan, John M. et al. · archived
-
Display Formatting in Information Integration and Nonintegration Tasks ↗ · 1987 · Boles, David B. et al. · indexed
-
-
-
Integrated displays and the perception of graphical data ↗ · 1991 · Goettl, Barry P. et al. · indexed
-
Crowdsourced Measurement of Reaction Times to Audiovisual Stimuli With Various Degrees of Asynchrony ↗ · 2018 · Bazilinskyy, Pavlo et al. · indexed
-
A Simulated Environment Experiment on Annoyance Due to Combined Road Traffic and Industrial Noises ↗ · 2015 · Marquis-Favre, Catherine et al. · indexed
-
Development of the ability to combine visual and acoustic information in working memory ↗ · 2018 · Cowan, Nelson et al. · indexed
-
Multimodal Sensor Fusion in Autonomous Vehicles: Technologies, Architectures, and Open Challenges. ↗ · 2026 · Viktor P et al. · indexed
-
Developing Video or Multimedia Instructions for Older Adults ↗ · 2018 · Pryor, Makenzie et al. · indexed
-
Uncertainty-Aware Evidential Fusion for Multi-Modal Object Detection in Autonomous Driving ↗ · 2026 · Yang, Qihang et al. · indexed
-
Relationship between exposure to multiple noise sources and noise annoyance ↗ · 2004 · Miedema, Henk · indexed