Incremental proximal methods for large scale convex optimization
Author(s)Bertsekas, Dimitri P.
MetadataShow full item record
We consider the minimization of a sum∑m [over]i=1 fi (x) consisting of a large number of convex component functions fi . For this problem, incremental methods consisting of gradient or subgradient iterations applied to single components have proved very effective. We propose new incremental methods, consisting of proximal iterations applied to single components, as well as combinations of gradient, subgradient, and proximal iterations. We provide a convergence and rate of convergence analysis of a variety of such methods, including some that involve randomization in the selection of components.We also discuss applications in a few contexts, including signal processing and inference/machine learning.
Laboratory for Information and Decision Systems Report LIDS-P-2847
DepartmentMassachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Bertsekas, Dimitri P. “Incremental proximal methods for large scale convex optimization.” Mathematical Programming 129.2 (2011): 163-195.
Author's final manuscript