Crossmodaal

Crossmodaal is a term used in psychology and neuroscience to describe cross-modal processing, the ways in which information from different sensory modalities interacts, influences perception, and is integrated by the brain. It encompasses automatic and attention-modulated interactions between senses, as well as the formation of multisensory representations that guide perception and action.

Research in crossmodaal examines phenomena such as temporal synchrony, spatial alignment, and cross-modal correspondences, where features in one modality are systematically linked to features in another—for example, high-pitched sounds with small or bright objects, or the integration of sight and sound in speech perception. Classic demonstrations include the McGurk effect, where visual speech information alters auditory perception, and the ventriloquist effect, where visual spatial cues bias perceived sound location. Other well-known phenomena include the sound-induced flash illusion, in which auditory signals change the number of perceived visual flashes.

Methodologically, crossmodaal studies use behavioral experiments, as well as neuroimaging (fMRI, EEG/MEG) and brain stimulation techniques to identify the neural substrates of multisensory integration. Brain regions frequently implicated include multisensory areas in the superior temporal sulcus, posterior parietal cortex, and superior colliculus, along with interactions with primary sensory cortices.

Applications span human–computer interaction, virtual reality, design of educational tools, and accessibility technologies, where cross-modal cues can aid perception and learning. Crossmodaal is related to concepts such as crossmodal correspondences and multisensory integration, and is often discussed in Dutch-language literature as a field-wide term for cross-sensory processing.