2026-09-20T04:26:20Zhttps://dspace.mit.edu/server/oai/requestoai:dspace.mit.edu:1721.1/1270222026-06-17T14:43:44Zcom_1721.1_7582com_1721.1_7581col_1721.1_131022
James J. DiCarlo.
Lee, Hyo-Dong.
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
2020-09-03T17:42:27Z
2020-09-03T17:42:27Z
2020
2020
https://hdl.handle.net/1721.1/127022
1191625184
Thesis: Ph. D., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, May, 2020
Cataloged from the official PDF of thesis.
Includes bibliographical references (pages 103-109).
Face processing in visual cortex has been widely studied and emphasized for its importance in primate survival and social communication. Monkey inferior temporal (IT) cortex contains neurons that respond preferentially to faces and cluster into several regions ("face patches") that together are referred to as the IT face process-ing network. While recent work has demonstrated that deep artificial neural net-works (ANNs) optimized for object categorization are strong predictors of neuronal responses at corresponding levels of the primate ventral visual stream (V1, V2, V4, and IT), those models do not explain the spatial organization of those neurons in general or the organization of the IT face processing network in particular. In this work, we test whether a new class of ANNs can naturally reproduce the core phenomena of the IT face network, including the rich spatial topography of face-selective neurons. Specifically, we designed and successfully trained topographic deep artificial neural networks (TDANNs) to solve a real-world object recognition task and to also minimize a proxy for neuronal wiring costs within each of the two highest IT levels (cIT and aIT). We report that layers of the trained TDANNs corresponding to cIT and aIT cortex contain clusters of face-selective units and reproduce core phenomenology of the face-patch system, such as connectivity between clusters and the emergence of viewpoint invariance. We also found that the model IT face network emerged over a range of naturalistic experience during training, but not for highly unnatural experience. Taken together, these results argue that the functional organization of the ventral stream might be explained by the need for the visual system to perform general, real world object categorization while also minimizing wiring costs over evolutionary and/or post-natal developmental time scales.
by Hyodong Lee.
Ph.D.
Ph.D. Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science
109 pages
eng
Massachusetts Institute of Technology
MIT theses may be protected by copyright. Please reuse MIT thesis content according to the MIT Libraries Permissions Policy, which is available through the URL provided.
http://dspace.mit.edu/handle/1721.1/7582
Electrical Engineering and Computer Science.
Topographic deep artificial neural network as a model of primate ventral visual stream
Thesis
application/pdf
2020-09-03T17:42:26Z
Publication
Doctoral
EECS
unknown
unknown
<Publication xmlns="https://www.openaire.eu/cerif-profile/1.1/" id="80d9d1f2-9131-472b-a496-1cef9c62b18f">
<Type xmlns="https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types">http://purl.org/coar/resource_type/c_1843</Type>
<Language>eng</Language>
<Title>Topographic deep artificial neural network as a model of primate ventral visual stream</Title>
<PublishedIn>
<Publication>
</Publication>
</PublishedIn>
<PublicationDate>2020</PublicationDate>
<Authors>
<Author>
<DisplayName>Lee, Hyo-Dong.</DisplayName>
<Affiliation>
<OrgUnit>
</OrgUnit>
</Affiliation>
</Author>
</Authors>
<Editors>
</Editors>
<Publishers>
<Publisher>
<DisplayName>Massachusetts Institute of Technology</DisplayName>
<OrgUnit />
</Publisher>
</Publishers>
<License>http://dspace.mit.edu/handle/1721.1/7582</License>
<Keyword>Electrical Engineering and Computer Science.</Keyword>
<Abstract>Face processing in visual cortex has been widely studied and emphasized for its importance in primate survival and social communication. Monkey inferior temporal (IT) cortex contains neurons that respond preferentially to faces and cluster into several regions ("face patches") that together are referred to as the IT face process-ing network. While recent work has demonstrated that deep artificial neural net-works (ANNs) optimized for object categorization are strong predictors of neuronal responses at corresponding levels of the primate ventral visual stream (V1, V2, V4, and IT), those models do not explain the spatial organization of those neurons in general or the organization of the IT face processing network in particular. In this work, we test whether a new class of ANNs can naturally reproduce the core phenomena of the IT face network, including the rich spatial topography of face-selective neurons. Specifically, we designed and successfully trained topographic deep artificial neural networks (TDANNs) to solve a real-world object recognition task and to also minimize a proxy for neuronal wiring costs within each of the two highest IT levels (cIT and aIT). We report that layers of the trained TDANNs corresponding to cIT and aIT cortex contain clusters of face-selective units and reproduce core phenomenology of the face-patch system, such as connectivity between clusters and the emergence of viewpoint invariance. We also found that the model IT face network emerged over a range of naturalistic experience during training, but not for highly unnatural experience. Taken together, these results argue that the functional organization of the ventral stream might be explained by the need for the visual system to perform general, real world object categorization while also minimizing wiring costs over evolutionary and/or post-natal developmental time scales.</Abstract>
<Access xmlns="http://purl.org/coar/access_right"
>
</Access>
</Publication>