CPSC 524F / MATH 604:Convex Analysis and OptimizationConvex optimization is a key tool for analyzing and solving a range of computational problems that arise in machine learning, signal and image processing, theoretical computer science, and other fields. It is also forms the backbone for other areas of optimization, including nonconvex problems. The aim of this course is to provide a self-contained treatment of the key ideas in convex analysis and their use in convex optimization.This course is cross-listed as both CS542F (Topics in Numerical Computation) and MATH 604 (Topics in Optimization).SyllabusThis list represents a tentative outline of the topics that will be covered.Part 1: Convex setsconvexity-preserving operations, derived sets (closure, relative interior, extreme points, faces)projection onto convex sets, separationconic approximations: tangent and normal conesPart 2: Convex functionsepigraphical viewconvexity-preserving operations, infimal convolution, perspective transform, smoothingdifferentiable and nondifferentiable functionssupport functions: correspondence with convex sets; norms and duals; gauges and polarsconjugate functionsPart 3: Convex optimizationproblem types: linear and quadratic optimization, conic programming (second-order and semi-definite optimization)applications of sparse optimization, including compressed sending, matrix completionLagrange and conjugate dualityfirst-order methods for unconstrained and nonsmooth problems, including proximal gradient, ADMM, Frank-Wolfeinterior methods for conic problemsTarget AudienceThis course is intended for students who wish to learn the underpinnings of convex optimization and are considering research in the area. Students looking to gain more practical experience with optimization (e.g., how to use various solvers) may wish to instead consider CPSC 406, which will be taught in Term 2.PrerequisitiesBackground in vector calculus, linear algebra, and basic real analysis.GradingHomework assignments. Three homework assignments involving both theoretical and computational exercises.Lecture scribe. Every student will transcribe notes for one or more lectures (depending on the class size). These notes will be made available to others in the class.Grade distribution. 25% each homework; 25% lecture scribe.Auditors and UndergraduatesAuditors are welcome. Graduate students who wish to audit, please bring a graduate registration form to the first lecture. Undergraduate students who wish to take the course for credit should fill out an undergraduate registration form.ReferencesThe course isn’t based on any one particular text. These references should be helpful for further reading.Bertsekas, D. P., Convex optimization theory. Athena Scientific, 2009Boyd, S., and Vandenberghe, L. Convex optimization. Cambridge University Press, 2004Hiriart-Urruty, J.-B., and Lemaréchal, C., Fundamentals of convex analysis. Springer, 2012.Rockafellar, R. T., Convex analysis. Princeton University Press, 2015Rockafellar, R. T., and Wets, R. J-B., Variational analysis. Springer, 2009PiazzaSign up for the Piazza course page.