Modeling short visual events through the BOLD moments video fMRI dataset and metadata
Name
s41467-024-50310-3.pdf
Size
11.89 MB
Format
Adobe PDF
Checksum (MD5)
c9bfb0d2fc41b0b018dc66954572bb61
Author(s)
Lahner, Benjamin
Dwivedi, Kshitij
Iamshchinina, Polina
Graumann, Monika
Lascelles, Alex
Roig, Gemma
Gifford, Alessandro Thomas
Pan, Bowen
Jin, SouYoung
Murty, N. Apurva Ratan
Date Issued
July 24, 2024
Journal
Nature Communications
Publisher
Springer Nature
Citation
Lahner, B., Dwivedi, K., Iamshchinina, P. et al. Modeling short visual events through the BOLD moments video fMRI dataset and metadata. Nat Commun 15, 6241 (2024).
Version
Final published version
Abstract
Studying the neural basis of human dynamic visual perception requires extensive experimental data to evaluate the large swathes of functionally diverse brain neural networks driven by perceiving visual events. Here, we introduce the BOLD Moments Dataset (BMD), a repository of whole-brain fMRI responses to over 1000 short (3 s) naturalistic video clips of visual events across ten human subjects. We use the videos’ extensive metadata to show how the brain represents word- and sentence-level descriptions of visual events and identify correlates of video memorability scores extending into the parietal cortex. Furthermore, we reveal a match in hierarchical processing between cortical regions of interest and video-computable deep neural networks, and we showcase that BMD successfully captures temporal dynamics of visual events at second resolution. With its rich metadata, BMD offers new perspectives and accelerates research on the human brain basis of visual event perception.
MIT Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
Terms of Use
Creative Commons Attribution
An error occurred on the license name.
Persistent DSpace Link
