Lecture Notes: Optimization for Machine Learning

2019/09/08 by Elad Hazan, Hazan, Elad · 2 voices
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Machine Learning and Algorithms #Stochastic Gradient Optimization Techniques #cs.LG #stat.ML

paper · pdf · doi:10.48550/arxiv.1909.03550

openalex publication_date 2019/09/08 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Lecture notes on optimization for machine learning, derived from a course at Princeton University and tutorials given in MLSS, Buenos Aires, as well as Simons Foundation, Berkeley.

Citations

• Adafactor: Adaptive Learning Rates with Sublinear Memory Cost

Discussions

• Lecture Notes: Optimization for Machine Learning [hn, 27 points, 0 comments]
• I came across these well-documented lecture notes about Optimization for Machine Learning by Prof. Elad Hazan from Princeton University. This is a new level of lecture notes 🚀 👇🏼 arxiv.org/abs/190 [bsky, 1 points, 0 comments]

Related

• Machine Learning: a Lecture Note
• Optimization problems for machine learning: A survey
• Mini-Workshop: Mathematical Foundations of Robust and Generalizable Learning
• Lecture Notes: Neural Network Architectures
• Introduction to Machine Learning: Class Notes 67577