Neural Regression, Representational Similarity, Model Zoology Neural Taskonomy at Scale in Rodent Visual Cortex
Name
CBMM-Memo-131.pdf
Size
9.37 MB
Format
Adobe PDF
Checksum (MD5)
f65b12bbd0d8f3842dc9bea1fe16e178
Author(s)
Conwell, Colin
Mayo, David
Buice, Michael A.
Katz, Boris
Alvarez, George A.
Barbu, Andrei
Date Issued
December 6, 2021
Publisher
Center for Brains, Minds and Machines (CBMM), The Thirty-fifth Annual Conference on Neural Information Processing Systems (NeurIPS)
Series/Report no.
CBMM Memo;131
Abstract
How well do deep neural networks fare as models of mouse visual cortex? A majority of research to date suggests results far more mixed than those produced in the modeling of primate visual cortex. Here, we perform a large-scale bench- marking of dozens of deep neural network models in mouse visual cortex with both representational similarity analysis and neural regression. Using the Allen Brain Observatory’s 2-photon calcium-imaging dataset of activity in over 6,000 reliable rodent visual cortical neurons recorded in response to natural scenes, we replicate previous findings and resolve previous discrepancies, ultimately demonstrating that modern neural networks can in fact be used to explain activity in the mouse visual cortex to a more reasonable degree than previously suggested. Using our benchmark as an atlas, we offer preliminary answers to overarching questions about levels of analysis, questions about the properties of models that best predict the visual system overall and questions about the mapping between biological and artificial representations. Our results provide a reference point for future ventures in the deep neural network modeling of mouse visual cortex, hinting at novel combinations of mapping method, architecture, and task to more fully characterize the computational motifs of visual representation in a species so central to neuroscience, but with a perceptual physiology and ecology markedly different from the ones we study in primates.
Persistent DSpace Link
