Electrophysiology Reveals That Intuitive Physics Guides Visual Tracking and Working Memory
Name
opmi_a_00174.pdf
Description
Published version
Size
1.07 MB
Format
Adobe PDF
Checksum (MD5)
d19ba7289def8fbdac5bc312c14d7c23
Author(s)
Balaban, Halely
Smith, Kevin A
Tenenbaum, Joshua B
Ullman, Tomer D
Date Issued
November 22, 2024
Journal
Open Mind
Publisher
MIT Press
Citation
Halely Balaban, Kevin A. Smith, Joshua B. Tenenbaum, Tomer D. Ullman; Electrophysiology Reveals That Intuitive Physics Guides Visual Tracking and Working Memory. Open Mind 2024; 8 1425–1446.
Version
Final published version
Abstract
Starting in early infancy, our perception and predictions are rooted in strong expectations about the behavior of everyday objects. These intuitive physics expectations have been demonstrated in numerous behavioral experiments, showing that even pre-verbal infants are surprised when something impossible happens (e.g., when objects magically appear or disappear). However, it remains unclear whether and how physical expectations shape different aspects of moment-by-moment online visual scene processing, unrelated to explicit physical reasoning. In two EEG experiments, people watched short videos like those used in behavioral studies with adults and infants, and more recently in AI benchmarks. Objects moved on a stage, and were briefly hidden behind an occluder, with the scene either unfolding as expected, or violating object permanence (adding or removing an object). We measured the contralateral delay activity, an electrophysiological marker of online processing, to examine participants’ working memory (WM) representations, as well as their ability to continuously track the objects in the scene. We found that both types of object permanence violations disrupted tracking, even though violations involved perceptually non-salient events (magical vanishing) or new objects that weren’t previously tracked (magical creation). Physical violations caused WM to reset, i.e., to discard the original scene representation before it could recover and represent the updated number of items. Providing a physical explanation for the violations (a hole behind the occluder) restored object tracking, and we found evidence that WM continued to represent items that disappeared ‘down the hole’. Our results show how intuitive physical expectations shape online representations, and form the basis of dynamic object tracking.
Terms of Use
Creative Commons Attribution
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1162/opmi_a_00174
