Applications and limits of convex optimization
Name
hamilton-luh-phd-math-2022-thesis.pdf
Description
Thesis PDF
Size
2.46 MB
Format
Adobe PDF
Checksum (MD5)
87b9757ae77ae9164e849e6d63e260ea
Author(s)
Hamilton, Linus
Advisor(s)
Moitra, Ankur
Date Issued
May 2022
Publisher
Massachusetts Institute of Technology
Abstract
Every algorithmic learning problem becomes vastly more tractable when reduced to a convex program, yet few can be simplified this way. At the heart of this thesis are two hard problems with unexpected convex reformulations. The Paulsen problem, a longstanding open problem in operator theory, was recently resolved by Kwok et al [40]. We use a convex program due to Barthe to present a dramatically simpler proof with an accompanying efficient algorithm that also achieves a better bound. Next, we examine the related operator scaling problem, whose fastest known algorithm uses convex optimization in non-Euclidean space. We expose a fundamental obstruction to such techniques by proving that, under realistic noise conditions, hyperbolic space admits no analogue of Nesterov’s accelerated gradient descent. Finally, we generalize Bresler’s structure learning algorithm from Ising models to arbitrary graphical models. We compare our results to a recent convex programming reformulation of the same problem. Notably, in variants of the problem where one only receives partial samples, our combinatorial algorithm is almost unaffected, whereas the convex approach fails to get off the ground.
MIT Department
Massachusetts Institute of Technology. Department of Mathematics
Terms of Use
In Copyright - Educational Use Permitted
Copyright MIT
Persistent DSpace Link
