multisensory crossmodal

Multisensory and crossmodal processing: integration of vision, audition, and touch, crossmodal spatial attention and cueing, multisensory facilitation and conflict, auditory and tactile capture of visual attention, and crossmodal correspondences (Spence). The foundational multisensory construct that underpins multimodal warning and display design, distinct from multimodal_feedback and auditory_warnings under HMI (the applied in-vehicle interfaces themselves).

143 paper(s) · ranked by relevance to this topic

1. Crossmodal links between audition and touch in covert endogenous spatial attention · 2003 · Lloyd, Donna M. et al. · archived
2. Crossmodal attentional control sets between vision and audition · 2017 · Mast, Frank et al. · archived
3. Multisensory In-Car Warning Signals for Collision Avoidance ↗ · 2007 · Ho, Cristy et al. · indexed
4. Vision and Haptics Share Spatial Attentional Resources and Visuotactile Integration Is Not Affected by High Attentional Load ↗ · 2015 · Wahn, Basil et al. · indexed
5. Audition and vision share spatial attentional resources, yet attentional load does not disrupt audiovisual integration · 2015 · Wahn, Basil et al. · archived
6. Guiding spatial attention by multimodal reward cues · 2022 · Hoofs, Vincent et al. · archived
7. 外源性注意与多感觉整合的交互关系 · 2018 · Peng, Xing et al. · archived
8. How do Naturalistic Visuo-Auditory Cues Guide Human Attention? Insights from Systematic Explorations in Visual Perception of Embodied Multimodal Interaction ↗ · 2025 · Suchan, Jakob · indexed
9. Two senses are better than one: Enhanced orienting to bimodal cues at short cue-target onset asynchronies ↗ · 2026 · Scott, Luke et al. · indexed
10. Orienting Attention to Points in Time Improves Stimulus Processing Both within and across Modalities ↗ · 2006 · Lange, Kathrin et al. · indexed
11. Attention Distributed across Sensory Modalities Enhances Perceptual Performance ↗ · 2012 · Mishra, Jyoti et al. · indexed
12. On measuring selective attention to an expected sensory modality · 1997 · Spence, Charles et al. · archived
13. Audiovisual links in endogenous covert spatial attention. ↗ · 1996 · Spence, Charles et al. · indexed
14. Cross-modal interactions at the audiovisual cocktail-party revealed by behavior, ERPs, and neural oscillations ↗ · 2023 · Klatt, Laura‐Isabelle et al. · indexed
15. Auditory, tactile, and multimodal warnings during automated driving · 2019 · Geitner, R. et al. · archived
16. Audiovisual looming signals are not always prioritised: evidence from exogenous, endogenous and sustained attention ↗ · 2021 · Huygelier, Hanne et al. · indexed
17. Informing the Design of Multimodal Displays ↗ · 2011 · Lu, Sara A. et al. · indexed
18. Irrelevant sights and sounds require spatial suppression: <scp>ERP</scp> evidence ↗ · 2022 · Lunn, Jessica et al. · indexed
19. Cross-modal psychological refractory period in vision, audition, and haptics · 2020 · Rau, Pei‐Luen Patrick et al. · archived
20. Supramodal Executive Control of Attention · 2015 · eSPAGNA, ALFREDO et al. · archived
21. Cross-modal interactions at the audiovisual cocktail-party revealed by behavior, ERPs, and neural oscillations ↗ · 2022 · Klatt, Laura-Isabelle et al. · indexed
22. Modality-specificity of Selective Attention Networks · 2015 · Stewart, Hannah J. et al. · archived
23. Exploring cross-modal perception in a virtual classroom: the effect of visual stimuli on auditory selective attention · 2025 · Breuer, Carolin et al. · archived
24. The Contributions of Sensory Dominance and Attentional Bias to Cross-modal Enhancement of Visual Cortex Excitability ↗ · 2013 · Romei, Vincenzo et al. · indexed
25. Multisensory integration attenuates visually induced oculomotor inhibition of return ↗ · 2022 · Tang, Xiaoyu et al. · indexed
26. Supporting Interruption Management and Multimodal Interface Design ↗ · 2013 · Lu, Sara A. et al. · indexed
27. Independent effects of bottom-up temporal expectancy and top-down spatial attention. An audiovisual study using rhythmic cueing. · 2015 · eJones, Alexander · archived
28. Preserved Discrimination Performance and Neural Processing during Crossmodal Attention in Aging · 2013 · Mishra, Jyoti et al. · archived
29. Audio-Visual Integration in 3D Space Near the Body ↗ · 2025 · Zeljko, Mick et al. · indexed
30. Semantically congruent bimodal presentation modulates cognitive control over attentional guidance by working memory · 2024 · Cai, Biye et al. · archived
31. Multimodal Information Presentation in Support of NextGen Operations ↗ · 2017 · Riggs, Sara L. et al. · indexed
32. Benefits of Stimulus Congruency for Multisensory Facilitation of Visual Learning · 2008 · Kim, Robyn S. et al. · archived
33. Interruption Management: The Use of Attention-Directing Tactile Cues · 2005 · Hopp, Pamela J. et al. · archived
34. How to drive drivers nuts: effect of auditory, vibrotactile, and multimodal warnings on perceived urgency, annoyance, and acceptability ↗ · 2017 · Biondi, FN et al. · indexed
35. Attention: From Theory to Practice ↗ · 2006 · Kramer, Arthur F. et al. · indexed
36. Hierarchy of Intra- and Cross-modal Redundancy Gains in Visuo-tactile Search: Evidence from the Posterior Contralateral Negativity ↗ · 2023 · Nasemann, Jan et al. · indexed
37. Auditory-Visual Redundancy in Vehicle Control Interruptions ↗ · 2011 · Wickens, Christopher D. et al. · indexed
38. Auditory Preemption versus Multiple Resources: Who Wins in Interruption Management? ↗ · 2005 · Wickens, Christopher D. et al. · indexed
39. Age differences in visual-auditory self-motion perception during a simulated driving task · 2016 · eRamkhalawansingh, Robert et al. · archived
40. The Effects of Bilateral and Ipsilateral Auditory Stimuli on the Subcomponents of Visual Attention ↗ · 2021 · Fu, Jing et al. · indexed
41. Vibrotactile Displays: A Survey With a View on Highly Automated Driving ↗ · 2015 · Petermeijer, Sebastiaan M. et al. · indexed
42. Impact of aging on crossmodal attention switching · 2024 · Schils, Ludivine A. P. et al. · archived
43. Visuospatial attention: Beyond a spotlight model · 1999 · Cave, Kyle R. et al. · archived
44. Redundancy, Modality, and Priority in Dual Task Interference ↗ · 2003 · Wickens, Christopher D. et al. · indexed
45. Advanced driver assistance systems: Using multimodal redundant warnings to enhance road safety · 2016 · Strayer, David L. et al. · archived
46. Effects Of Spatial and Non-Spatial Multi-Modal Cues on Orienting of Visual-Spatial Attention in an Augmented Environment ↗ · 2007 · Jerome, Christian J. · indexed
47. Divided attention between simultaneous auditory and visual signals · 1998 · Bonnel, Anne-Marie et al. · archived
48. Multimodal Coordination and Attention Capture: The Challenge of Inattentional Blindness for AR-HUD on Complex Roads ↗ · 2025 · Zhu, Qi et al. · indexed
49. Attentional capture by auto- and allo-cues · 2003 · Rauschenberger, Robert · archived
50. Tactile Stimuli Increase Effects of Modality Compatibility in Task Switching ↗ · 2015 · Stephan, Denise Nadine et al. · indexed
51. Covert attention in touch: Behavioral and ERP evidence for costs and benefits · 2005 · Forster, Bettina et al. · archived
52. Exploring the Effects of Meaningful Tactile Display on Perception and Preference in Automated Vehicles · 2022 · Martinez, Kimberly D et al. · archived
53. Allocation of Driver Attention for Varying In-Vehicle System Modalities ↗ · 2020 · Li, Ning et al. · indexed
54. Advanced driver assistance systems: Using multimodal redundant warnings to enhance road safety ↗ · 2017 · Biondi, FN et al. · indexed
55. Cross-modal binding and working memory ↗ · 2008 · Allen, Richard J. et al. · indexed
56. The Effect of Stimulus Modality on Signal Detection: Implications for Assessing the Safety of In-Vehicle Technology ↗ · 2008 · Merat, Natasha et al. · indexed
57. The impact of in-car human-machine interface prompt locations on driver attention resource redistribution: An event-related potential study ↗ · 2025 · Wang, Shirui et al. · indexed
58. The Interaction of Spatial and Color Proximity in Aircraft Stability Information Displays ↗ · 1988 · Wickens, C. D. · indexed
59. Haptic and Auditory Interfaces as a Collision Avoidance Technique During Roadway Departures and Driver Perception of these Modalities · 2006 · Stanley, Laura Michelle · archived
60. Basic collision warning and driver information systems : human factors research needs : summary report · 1998 · NHTSA · archived
61. Factors Influencing the Performance Advantage of Speech Technology ↗ · 1981 · Wickens, Christopher D. et al. · indexed
62. Visual Gender Cues Guide Crossmodal Selective Attending to a Gender-Congruent Voice During Dichotic Listening ↗ · 2020 · Factor, Zekiel Z. et al. · indexed
63. Displaywide visual features associated with a search display’s appearance can mediate attentional capture · 2007 · Burnham, Bryan R. · archived
64. Induction Mechanism of Auditory-Assisted Vision for Target Search Localization in Mixed Reality (MR) Environments ↗ · 2022 · Wang, Wei et al. · indexed
65. Conflicting Sensory Information Sharpens the Neural Representations of Early Selective Visuospatial Attention ↗ · 2024 · Sookprao, Panchalee et al. · indexed
66. In-Vehicle Auditory Alerts Literature Review · 2022 · Jeon, Myounghoon et al. · archived
67. A Comparison of Tactile, Visual, and Auditory Warnings for Rear-End Collision Prevention in Simulated Driving ↗ · 2008 · Scott, Jeffrey J et al. · indexed
68. Do ERP components triggered during attentional orienting represent supramodal attentional control? · 2007 · Seiss, Ellen et al. · archived
69. Planning Lane Changes using Advance Visual and Haptic Information · 2022 · Frissen, Ilja et al. · archived
70. Target Cuing in Visual Search: The Effects of Conformality and Display Location on the Allocation of Visual Attention ↗ · 1999 · Yeh, Michelle et al. · indexed
71. Overriding auditory attentional capture · 2007 · Dalton, Polly et al. · archived
72. Recalibration of multisensory simultaneity: Cross-modal transfer coincides with a change in perceptual latency ↗ · 2009 · Di Luca, Massimiliano et al. · indexed
73. Multiple Resources and Display Formatting: The Implications of Task Integration ↗ · 1984 · Wickens, Christopher D. et al. · indexed
74. Concurrent talking in immersive virtual reality: on the dominance of visual speech cues · 2017 · González-Franco, Mar et al. · archived
75. Optimizing multimodal alarms to mitigate inattentional blindness in air traffic control · 2025 · Wickens, C. D. · archived
76. Theory-based Models of Attention in Visual Workspaces ↗ · 2016 · Steelman, Kelly S. et al. · indexed
77. Shifting and focusing auditory spatial attention. ↗ · 1995 · Mondor, Todd A. et al. · indexed
78. Modality compatibility in task switching depends on processing codes and task demands · 2021 · Friedgen, Erik et al. · archived
79. Disentangling the effects of spatial cues on selection and formation of auditory objects ↗ · 2008 · Ihlefeld, Antje et al. · indexed
80. Global Facilitation of Attended Features Is Obligatory and Restricts Divided Attention · 2013 · ‪Søren K. Andersen et al. · archived
81. Rhythmic Fluctuations in Tactile Attention ↗ · 2025 · Bayram, Burcu et al. · indexed
82. Terms of debate: Consensus definitions to guide the scientific discourse on visual distraction · 2024 · Liesefeld, Heinrich R. et al. · archived
83. Cue the effects: Stimulus-action effect modality compatibility and dual-task costs. ↗ · 2020 · Schacherer, Jonathan et al. · indexed
84. The importance of sensory integration processes for action cascading · 2015 · Gohil, Krutika et al. · archived
85. Early sensory gain control is dominated by obligatory and global feature-based attention in top-down shifts of combined spatial and feature-based attention ↗ · 2023 · Gundlach, Christopher et al. · indexed
86. Cognitive Load in Cross‐Modal Dual‐Task Processing ↗ · 2015 · Morrison, Natalie M. V. et al. · indexed
87. From young to old: The effects of information presentation type, multimodal display, and age on situation awareness and processing time in automated vehicles · 2024 · Du, Na et al. · archived
88. ERP investigations into the effects of gaze and spatial attention on the processing of tactile events ↗ · 2012 · Gherri, Elena et al. · indexed
89. The interplay of crossmodal attentional preparation and modality compatibility in cued task switching ↗ · 2019 · Fintor, Edina et al. · indexed
90. Proximity Compatibility and Information Display: Effects of Color, Space, and Objectness on Information Integration ↗ · 1990 · Wickens, Christopher D. et al. · indexed
91. Dynamics of alpha suppression index both modality specific and general attention processes · 2023 · Clements, Grace M. et al. · archived
92. Dissociating stimulus-response compatibility and modality compatibility in task switching · 2022 · Friedgen, Erik et al. · archived
93. Neural correlates of top-down attention in auditory and visual contexts reflect individual differences in the population ↗ · 2021 · Kwasa, Jasmine et al. · indexed
94. Variations in the magnitude of attentional capture: Testing a two-process model · 2010 · Anderson, Brian A. et al. · archived
95. Human factors evaluation of the effectiveness of multi-modality displays in advanced traveler information systems · 1999 · Liu, Yung-Ching et al. · archived
96. Human-Machine interfaces and vehicle Automation: A review of the literature and recommendations for system Design, Feedback, and alerts · 2024 · Wang, Meng et al. · archived
97. Auditory Attentional Capture: Effects of Singleton Distractor Sounds. ↗ · 2004 · Dalton, Polly et al. · indexed
98. Selective attention and performance with a multidimensional visual display. ↗ · 1986 · Lambert, Anthony J. et al. · indexed
99. Expanded Situational Awareness Without Vision · 2023 · Fink, Paul D. S. et al. · archived
100. Automatic, stimulus-driven attentional capture by objecthood · 2007 · Kimchi, Ruth et al. · archived
101. Neural correlates of endogenous attention, exogenous attention and inhibition of return in touch ↗ · 2014 · Jones, Alexander et al. · indexed
102. Emotional content overrides spatial attention ↗ · 2021 · Bekhtereva, Valeria et al. · indexed
103. Multisensory Enhancement of Cognitive Control over Working Memory Capture of Attention in Children with ADHD ↗ · 2022 · Cai, Biye et al. · indexed
104. What Makes the Detection of Movement Different Within the Autistic Traits Spectrum? Evidence From the Audiovisual Depth Paradigm · 2023 · Poulain, Rachel et al. · archived
105. Recalibration of the Multisensory Temporal Window of Integration Results from Changing Task Demands · 2013 · Mégevand, Pierre et al. · archived
106. Evidence for spatial tuning in informational masking using the probe-signal method ↗ · 2000 · Arbogast, Tanya L. et al. · indexed
107. Timecourse of coactivation in bimodal divided attention · 1986 · Miller, Jeff · archived
108. Synergistic Effect of Combined Temporal and Spatial Expectations on Visual Attention ↗ · 2005 · Doherty, Joanna R. et al. · indexed
109. Visuospatial experience modulates attentional capture: Evidence from action video game players ↗ · 2008 · West, Greg L. et al. · indexed
110. Perspective Chapter: The Visual Cognition and Attention Allocation Principles in Nuclear Power Monitoring Operations · 2026 · Wu, Xiaoli · archived
111. Congenitally blind humans use different stimulus selection strategies in hearing: An ERP study of spatial and temporal attention ↗ · 2007 · Röder, Brigitte et al. · indexed
112. It's the Other Way Around! Early Modulation of Sensory Distractor Processing Induced by Late Response Conflict ↗ · 2018 · Pastötter, Bernhard et al. · indexed
113. How voluntary spatial attention influences feature biases in object correspondence · 2020 · Stepper, Madeleine Y. et al. · archived
114. Bisensory stimulation: Inferring decision-related processes from the P300 component. ↗ · 1977 · Squires, Nancy K. et al. · indexed
115. Age influences audiovisual speech processing in multi-talker scenarios – Evidence from cortical oscillations ↗ · 2022 · Begau, Alexandra et al. · indexed
116. A Naturalistic Embodied Human Multimodal Interaction Dataset: Systematically Annotated Behavioural Visuo-Auditory Cue and Attention Data ↗ · 2025 · Suchan, Jakob · indexed
117. Motor coactivation revealed by response force in divided and focused attention. ↗ · 1993 · Giray, Markus et al. · indexed
118. Are individualized head-related transfer functions required for auditory information displays? ↗ · 1999 · Wenzel, Elizabeth M. et al. · indexed
119. Crossmodal Attentional Blink Induced by Executive Working Memory ↗ · 2016 · Jun, Haechan et al. · indexed
120. Numerosity adaptation partly depends on the allocation of implicit numerosity-contingent visuo-spatial attention · 2021 · Grasso, Paolo A. et al. · archived
121. Topographic specificity of alpha power during auditory spatial attention ↗ · 2019 · Deng, Yuqi et al. · indexed
122. Spatial Release from Informational Masking: Evidence from Functional Near Infrared Spectroscopy ↗ · 2018 · Zhang, Min et al. · indexed
123. Sensitivity and Bias in the Resolution of Stream-Bounce Stimuli ↗ · 2017 · Zeljko, Mick et al. · indexed
124. Multimodal spatial discrimination in the face of uncertainty ↗ · 2014 · Boles, David B. et al. · indexed
125. Pictorial communication in virtual and real environments ↗ · 1900 · Kaiser, Mary K et al. · indexed
126. Neural Evidence of Hierarchical Cognitive Control during Haptic Processing: An fMRI Study · 2018 · Gurtubay-Antolin, Ane et al. · archived
127. Do congruent lip movements facilitate speech processing in a dynamic audiovisual multi-talker scenario? An ERP study with older and younger adults ↗ · 2020 · Begau, Alexandra et al. · indexed
128. Information integration in multiple-cue judgments. ↗ · 1980 · Brehmer, Berndt et al. · indexed
129. Inter-hemispheric integration of tactile-motor responses across body parts · 2015 · Luigi Tamà ̈ et al. · archived
130. Embedding auditory cognitive tasks in realistic spatial contexts ↗ · 2025 · Stecker, G. Christopher et al. · indexed
131. Cognitive Style and Visual Attention in Multimodal Museum Exhibitions: An Eye-Tracking Study on Visitor Experience ↗ · 2025 · Shi, Wen et al. · indexed
132. Fast Reaction to Different Sensory Modalities Activates Common Fields in the Motor Areas, but the Anterior Cingulate Cortex is Involved in the Speed of Reaction ↗ · 2000 · Naito, Eiichi et al. · indexed
133. Goal-Selection and Movement-Related Conflict during Bimanual Reaching Movements · 2005 · Diedrichsen, Jörn et al. · archived
134. Overestimation of Phonological Judgments on the Right Side of Space · 2023 · Turriziani, Patrizia et al. · archived
135. Independent effects of eye gaze and spatial attention on the processing of tactile events: Evidence from event-related potentials · 2015 · Gherri, Elena et al. · archived
136. Interhemispheric vs. stimulus-response spatial compatibility effects in bimanual reaction times to lateralized visual stimuli ↗ · 2013 · Pellicano, Antonello et al. · indexed
137. Avatar embodiment in VR: Are there individual susceptibilities to visuo-tactile or cardio-visual stimulations? · 2022 · Pratviel, Yvan et al. · archived
138. Social and Representational Cues Jointly Influence Spatial Perspective‐Taking ↗ · 2014 · Galati, Alexia et al. · indexed
139. Predictive coding and dimension-selective attention enhance the lateralization of spoken language processing ↗ · 2024 · Preisig, Basil Christoph et al. · indexed
140. Suppression of Extinction with TMS in Humans: From Healthy Controls to Patients · 2006 · Oliveri, Massimiliano et al. · archived
141. Predictive coding and dimension-selective attention enhance the lateralization of spoken language processing ↗ · 2025 · Preisig, Basil Christoph et al. · indexed
142. SIMPLE REACTION TIMES TO LATERALIZED LIGHT FLASHES ↗ · 1989 · Clarke, Jeffrey M. et al. · indexed
143. The effects of bilingualism on efficiency and lateralization of attentional networks ↗ · 2012 · MARZECOVÁ, ANNA et al. · indexed