Binding and differentiation in multisensory object perception

Abstract

Cognitive scientists have long known that the modalities interact during perceptual processing. Cross-modal illusions like the ventriloquism effect show that the course of processing in one modality can alterthe course of processing in another. But how do the modalities interact in the specific domain of object perception?This paper distinguishes and analyzes two kinds of multisensoryinteraction in object perception. First, the modalities may bind features to a single object or event. Second, the modalities may cooperatewhendifferentiating an object or event from its surroundings.I critically evaluate evidence for various forms of multisensory binding. I then consider the case for multisensory differentiation. I argue that existing evidence for multisensory differentiation is inconclusive. I highlight ways that the issue might be empirically resolved.