Scalable Representation Learning: On Data-scarcity, Uncertainty and Symmetry
Name
loh-cloh-phd-eecs-2024-thesis.pdf
Description
Thesis PDF
Size
33.08 MB
Format
Adobe PDF
Checksum (MD5)
97f253a11d6649c0fadc20b499605498
Author(s)
Loh, Charlotte Chang Le
Advisor(s)
Soljačić, Marin
Date Issued
May 2024
Publisher
Massachusetts Institute of Technology
Abstract
Deep learning has experienced remarkable success in recent years, leading to significant advancements in various fields such as vision, natural language generation, complex game play, as well as solving difficult scientific problems such as predicting protein folding. Despite these successes, traditional deep learning faces fundamental challenges limiting their scalability and effectiveness. These challenges include the necessity for extensive labeled datasets, the lack of trustworthiness due to model overconfidence, and difficulties in generalizing to new, unseen data. In this thesis, our primary goal is to tackle these issues by introducing novel tools and methods that augment traditional deep learning. We explore various strategies for solving the main bottlenecks of traditional deep learning, which includes incorporating prior known symmetries and inductive biases of the problem, utilizing Bayesian and ensemble methods, and leveraging abundance of unlabeled data in a representation learning framework. We discuss and demonstrate practical applications of these novel tools in diverse domains including vision, photonics, material science and neuroscience.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)
Copyright retained by author(s)
Persistent DSpace Link
