Provable Algorithms for Learning and Variational Inference in Undirected Graphical Models
Name
koehler-fkoehler-phd-mathematics-2021-thesis.pdf
Description
Thesis PDF
Size
1.58 MB
Format
Adobe PDF
Checksum (MD5)
5b31619cf8f91ef778f4e9695de3d9e3
Author(s)
Koehler, Frederic
Advisor(s)
Mossel, Elchanan
Date Issued
June 2021
Publisher
Massachusetts Institute of Technology
Abstract
Graphical models are a general-purpose tool for modeling complex distributions in a way which facilitates probabilistic reasoning, with numerous applications across machine learning and the sciences. This thesis deals with algorithmic and statistical problems of learning a high-dimensional graphical model from samples, and related problems of performing inference on a known model, both areas of research which have been the subject of continued interest over the years. Our main contributions are the first computationally efficient algorithms for provably (1) learning a (possibly ill-conditioned) walk-summable Gaussian Graphical Model from samples, (2) learning a Restricted Boltzmann Machine (or other latent variable Ising model) from data, and (3) performing naive mean-field variational inference on an Ising model in the optimal density regime. These different problems illustrate a set of key principles, such as the diverse algorithmic applications of “pinning” variables in graphical models. We also show in some cases that these results are nearly optimal due to matching computational/cryptographic hardness results.
MIT Department
Massachusetts Institute of Technology. Department of Mathematics
Terms of Use
In Copyright - Educational Use Permitted
Copyright MIT
Persistent DSpace Link
