2008/03/27 by David R. Wozny, Ulrik Beierholm, Ladan Shams · 177 citations
Agricultural and Biological Sciences · Neuroscience · Psychology · #Artificial intelligence #Bayes' theorem #Bayesian probability #Cognitive psychology #Computer science #Illusion #Inference #Modalities #Modality (human–computer interaction) #Multisensory perception and integration #Neuroscience #Numerosity adaptation effect #Perception #Psychology #Sensory Analysis and Statistical Methods #Sensory system #Stimulus modality #Visual perception and processing mechanisms
paper · doi:10.1167/8.3.24
published in Journal of Vision 8(3), 24 (Association for Research in Vision and Ophthalmology)
openalex publication_date 2008/03/27 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/01
Our nervous system typically processes signals from multiple sensory modalities at any given moment and is therefore posed with two important problems: which of the signals are caused by a common event, and how to combine those signals. We investigated human perception in the presence of auditory, visual, and tactile stimulation in a numerosity judgment task. Observers were presented with stimuli in one, two, or three modalities simultaneously and were asked to report their percepts in each modality. The degree of congruency between the modalities varied across trials. For example, a single flash was paired in some trials with two beeps and two taps. Cross-modal illusions were observed in most conditions in which there was incongruence among the two or three stimuli, revealing robust interactions among the three modalities in all directions. The observers' bimodal and trimodal percepts were remarkably consistent with a Bayes-optimal strategy of combining the evidence in each modality with the prior probability of the events. These findings provide evidence that the combination of sensory information among three modalities follows optimal statistical inference for the entire spectrum of conditions.