This is an archived course. A more recent version may be available at ocw.mit.edu.

 

Calendar

LEC # TOPICS KEY DATES
1 The role of convexity in optimization, duality theory, algorithms and duality  
2 Convex sets and functions, epigraphs, closed convex functions, recognizing convex functions  
3 Differentiable convex functions, convex and affine hulls, Caratheodory's theorem, relative interior  
4 Algebra of relative interiors and closures, continuity of convex functions, closures of functions, recession cones and lineality space Homework 1 due
5 Directions of recession of convex functions, local and global minima, existence of optimal solutions  
6 Nonemptiness of closed set intersections, existence of optimal solutions, linear and quadratic programming, preservation of closure under linear transformation Homework 2 due
7 Partial minimization, hyperplane separation, proper separation, nonvertical hyperplanes  
8 Convex conjugate functions, conjugacy theorem, support functions  
9 Min common/max crossing duality, weak duality, constrained optimization and minimax, strong duality Homework 3 due
10 Min common/max crossing duality theorems, strong duality conditions, existence of dual optimal solutions, nonlinear Farkas' lemma  
11 Min common/max crossing theorem III, nonlinear Farkas' lemma/linear constraints, linear programming duality, convex programming duality Homework 4 due
12 Convex programming duality, optimality conditions, mixtures of linear and convex constraints, existence of optimal primal solutions, Fenchel duality, conic duality  
13 Subgradients, Fenchel inequality, sensitivity in constrained optimization, subdifferential calculus, optimality conditions  
14 Min-max duality, existence of saddle points  
15 Problem structures, conic programming Homework 5 due
16 Conic programming, semidefinite programming, exact penalty functions, descent methods for convex/nondifferentiable optimization, steepest descent method  
17 Subgradient methods, calculations of subgradients, convergence  
18 Approximate subgradient methods, ε-subdifferential, ε-subgradient methods, incremental subgradient methods  
19 Return to descent methods, fixing the convergence problem of steepest descent, ε-descent method, extended monotropic programming  
20 Approximation methods, cutting plane methods, proximal minimization algorithm, proximal cutting plane algorithm, bundle methods  
21 Generalized polyhedral approximations in convex optimization  
22 Review of Fenchel duality, review of proximal minimization, dual proximal minimization algorithm, augmented Lagrangian methods  
23 Interior point methods, barrier method, conic programming cases, path following  
24 Review and epilogue