Mathematical analysis of static and plastic biological neural circuits
Name
1192966398-MIT.pdf
Size
2.22 MB
Format
Adobe PDF
Checksum (MD5)
058214bc0865c2d4f8335666cd4b5988
Author(s)
Wang, Mien Brabeeba.
Advisor(s)
Nancy A. Lynch.
Date Issued
2020
Publisher
Massachusetts Institute of Technology
Abstract
In this thesis, I explain possible mathematical principles behind brain computations during the processing of temporal information and fast sensory adaptation using static and plastic neural circuits respectively. For the static part of the thesis, I investigate the possible computational principles behind how the brain can process temporal information over a long time range using neurons with transient activities. Specifically, I design static memoryless neural circuits that are capable of processing temporal sequences in either rate coding or temporal coding and prove that the networks are optimal in both the number of the neurons and the convergence time. For the plastic part of the thesis, I show how a sensory system can potentially adapt quickly under Barlow's efficient coding principle despite having high dimensional sensory inputs. Specifically, I use Oja's rule as an example of sensory adaptation under the efficient coding principle and give the first convergence rate analysis of Oja's rule in solving streaming principal component analysis (PCA). In particular, the convergence rate I obtain matches the information-theoretic lower bound up to logarithmic factors and outperforms the state-of-the-art analysis for other streaming PCA algorithms in the literature. I further demonstrate the capacity of Oja's rule for continual learning in a living system. Specifically, I prove that Oja's rule can continuously adapt to changing environments without sacrificing too much efficiency and remain functional throughout the process.
Description
Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, May, 2020
Cataloged from the official PDF of thesis.
Includes bibliographical references (pages 123-129).
Subjects
Electrical Engineering and Computer Science.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
MIT theses may be protected by copyright. Please reuse MIT thesis content according to the MIT Libraries Permissions Policy, which is available through the URL provided.
Persistent DSpace Link