Neurally plausible mechanisms for learning selective and invariant representations
Name
13408_2020_Article_88.pdf
Size
1.71 MB
Format
Adobe PDF
Checksum (MD5)
7716c02a16f8a06114d3fd4f7fadbb43
Author(s)
Anselmi, Fabio
Patel, Ankit
Rosasco, Lorenzo
Date Issued
August 18, 2020
Publisher
Springer Berlin Heidelberg
Citation
The Journal of Mathematical Neuroscience. 2020 Aug 18;10(1):12
Version
Final published version
Abstract
Abstract
Coding for visual stimuli in the ventral stream is known to be invariant to object identity preserving nuisance transformations. Indeed, much recent theoretical and experimental work suggests that the main challenge for the visual cortex is to build up such nuisance invariant representations. Recently, artificial convolutional networks have succeeded in both learning such invariant properties and, surprisingly, predicting cortical responses in macaque and mouse visual cortex with unprecedented accuracy. However, some of the key ingredients that enable such success—supervised learning and the backpropagation algorithm—are neurally implausible. This makes it difficult to relate advances in understanding convolutional networks to the brain. In contrast, many of the existing neurally plausible theories of invariant representations in the brain involve unsupervised learning, and have been strongly tied to specific plasticity rules. To close this gap, we study an instantiation of simple-complex cell model and show, for a broad class of unsupervised learning rules (including Hebbian learning), that we can learn object representations that are invariant to nuisance transformations belonging to a finite orthogonal group. These findings may have implications for developing neurally plausible theories and models of how the visual cortex or artificial neural networks build selectivity for discriminating objects and invariance to real-world nuisance transformations.
MIT Department
Center for Brains, Minds, and Machines
Terms of Use
Creative Commons Attribution
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1186/s13408-020-00088-7
