Cross-modal psychological refractory period in vision, audition, and haptics

Rau, Pei‐Luen Patrick; Zheng, Jian · 2020 · OpenAlex-citations

DOI: 10.3758/s13414-020-01978-4

archive: archived pipeline: cataloged verified

Get this paper ↗ (DOI — opens at the source; we link to it, we don't host it)

Summary

This study investigates the psychological refractory period (PRP) effect across all possible combinations of visual, auditory, and haptic input modalities. While previous research established that parallel processing is limited by a central bottleneck, most PRP studies focused on visual and auditory stimuli, leaving tactile inputs largely unexplored. The authors aimed to determine if input modality influences dual-task performance and to evaluate which theoretical models—Response Selection Bottleneck (RSB), Central Capacity-Sharing (CCS), or Executive Control of the Theory of Visual Attention (ECTVA)—best explain cross-modal interactions. Thirty participants performed a dual-task paradigm where they judged the magnitude (small or large) of two stimuli presented in different modalities with stimulus onset asynchronies (SOA) ranging from 75 to 1,200 ms. The experiment utilized a within-subject design covering six modality combinations: visual-auditory, auditory-visual, visual-tactile, tactile-visual, auditory-tactile, and tactile-auditory. Stimuli were presented via a head-mounted display for vision, noise-canceling earphones for audition, and vibrating controllers for haptics. Participants responded using manual clicks, prioritizing the first task. The results confirmed a PRP effect in all six modality combinations, with reaction time to the second stimulus (RT2) increasing as SOA decreased. However, modality-specific differences emerged. In the auditory-tactile condition, RT2 decreased with a slope steeper than −1, Task 2 accuracy dropped significantly at short SOAs, and RT1 increased as SOA increased. This pattern also included a backward crosstalk effect, where Task 1 performance improved when responses were congruent. In the tactile-visual condition, RT1 increased with decreasing SOA, but no backward crosstalk or accuracy drop was observed. Other conditions showed standard PRP effects without these anomalies. Task difficulty varied by modality, with auditory tasks being the most difficult and visual tasks the easiest. The findings suggest that existing theoretical models are insufficient to explain all cross-modal data. The auditory-tactile results align exclusively with the ECTVA model, which accounts for the loss of early Task 2 processing and backward crosstalk. The tactile-visual results fit the CCS model, while other conditions are consistent with both RSB and CCS. The authors attribute these differences to modality-specific characteristics, such as the lack of tactile afterimages compared to visual persistence and hemispheric asymmetries in somatosensory processing. The study concludes that input modality significantly shapes dual-task interference, necessitating models that incorporate sensory-specific features rather than treating all inputs as modality-independent.

Provenance

The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed.

Summary generated by qwen3.6-27b-prismaquant on 2026-06-25; verification: verified.

Topics

Ranked by relevance to this paper. Hover a topic for its definition.

• dual task multitasking
• multisensory crossmodal
• multimodal feedback