Orabona, Francesco
- Online Learning: A Modern Introduction Using Convex Optimization
2019/12/31 by Francesco Orabona, Orabona, Francesco · 3 voices · 54 citations
Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #Machine Learning and Algorithms #Sparse and Compressive Sensing Techniques #cs.LG #math.OC #stat.ML
- Momentum-Based Variance Reduction in Non-Convex SGD
2019/05/24 by Ashok Cutkosky, Cutkosky, Ashok, Francesco Orabona +1 · 37 citations
Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- On the Convergence of Stochastic Gradient Descent with Adaptive Stepsizes
2018/05/21 by Xiaoyu Li, Li, Xiaoyu, Francesco Orabona +1 · 35 citations
Computer Science · Engineering · Decision Sciences · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Advanced Bandit Algorithms Research
- Coin Betting and Parameter-Free Online Learning
2016/02/12 by Francesco Orabona, Orabona, Francesco, Dávid Pál +1 · 11 citations
Decision Sciences · Computer Science · #Advanced Bandit Algorithms Research #Machine Learning and Algorithms #Optimization and Search Problems
- Unconstrained Online Linear Learning in Hilbert Spaces: Minimax Algorithms and Normal Approximations
2014/03/03 by H. Brendan McMahan, McMahan, H. Brendan, Francesco Orabona +1 · 13 citations
Decision Sciences · Computer Science · #Advanced Bandit Algorithms Research #Machine Learning and Algorithms #Optimization and Search Problems
- Black-Box Reductions for Parameter-free Online Learning in Banach Spaces
2018/02/17 by Ashok Cutkosky, Francesco Orabona, Cutkosky, Ashok +1 · 9 citations
Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- Position: Machine Learning Conferences Should Establish a "Refutations and Critiques" Track
2025/06/24 by Rylan Schaeffer, Schaeffer, Rylan, Joshua Kazdan +25 · 2 voices · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.CL #cs.CY #cs.LG
- Optimal Stochastic Non-smooth Non-convex Optimization through Online-to-Non-convex Conversion
2023/02/07 by Ashok Cutkosky, Harsh Mehta, Cutkosky, Ashok +3 · 9 citations
Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- Scale-Free Online Learning
2016/01/08 by Orabona, Francesco, Pál, Dávid · 5 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Robustness to Unbounded Smoothness of Generalized SignSGD
2022/08/23 by Michael Crawshaw, Crawshaw, Michael, Mingrui Liu +7 · 8 citations
Engineering · Computer Science · #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Advanced Neural Network Applications
- Understanding AdamW through Proximal Methods and Scale-Freeness
2022/01/31 by Zhuang, Zhenxun, Liu, Mingrui, Cutkosky, Ashok +1 · 5 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Optimal Non-Asymptotic Lower Bound on the Minimax Regret of Learning with Expert Advice
2015/11/06 by Francesco Orabona, Orabona, Francesco, Dávid Pál +1 · 3 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Optimization and Search Problems
- Normalized Gradients for All
2023/08/10 by Orabona, Francesco · 6 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- A High Probability Analysis of Adaptive SGD with Momentum
2020/07/28 by Li, Xiaoyu, Orabona, Francesco · 3 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Parameter-free Stochastic Optimization of Variationally Coherent Functions
2021/01/30 by Orabona, Francesco, Pál, Dávid · 3 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Simultaneous Model Selection and Optimization through Parameter-free Stochastic Learning
2014/06/15 by Orabona, Francesco · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Tight Concentrations and Confidence Sequences from the Regret of Universal Portfolio
2021/10/27 by Francesco Orabona, Kwang-Sung Jun, Orabona, Francesco +1 · 3 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Methodology (stat.ME) #Optimization and Search Problems #Statistics Theory (math.ST)
- Tighter PAC-Bayes Bounds Through Coin-Betting
2023/02/12 by Kyoungseok Jang, Kwang-Sung Jun, Jang, Kyoungseok +5 · 3 citations
Computer Science · #Machine Learning and Algorithms #Adversarial Robustness in Machine Learning #Machine Learning and Data Classification
- PRISMA: PRoximal Iterative SMoothing Algorithm
2012/06/11 by Orabona, Francesco, Argyriou, Andreas, Srebro, Nathan · 1 citation
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Scale-Free Algorithms for Online Linear Optimization
2015/02/19 by Orabona, Francesco, Pal, David · 1 citation
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Improved Strongly Adaptive Online Learning using Coin Betting
2016/10/14 by Kwang-Sung Jun, Jun, Kwang-Sung, Francesco Orabona +5 · 1 citation
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Data Stream Mining Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms
- New Perspectives on the Polyak Stepsize: Surrogate Functions and Negative Results
2025/05/26 by Orabona, Francesco, D'Orazio, Ryan · 5 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Adam+: A Stochastic Method with Adaptive Variance Reduction
2020/11/24 by Mingrui Liu, Liu, Mingrui, Wei Zhang +5 · 1 citation
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Neural Networks and Applications #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
- A closer look at temporal variability in dynamic online learning
2021/02/15 by Campolongo, Nicolò, Orabona, Francesco · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Implicit Parameter-free Online Learning with Truncated Linear Models
2022/03/19 by Chen, Keyi, Cutkosky, Ashok, Orabona, Francesco · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Better-than-KL PAC-Bayes Bounds
2024/02/14 by Ilja Kuzborskij, Kwang-Sung Jun, Kuzborskij, Ilja +7 · 1 citation
Computer Science · Decision Sciences · #Data Mining Algorithms and Applications #Data Quality and Management #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Rough Sets and Fuzzy Logic
- Beyond the Ideal: Analyzing the Inexact Muon Update
2025/10/22 by Egor Shulgin, Shulgin, Egor, Sultan AlRashed +5 · 4 citations
Computer Science · Engineering · Physics and Astronomy · #Computational Physics and Python Applications #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Muon and positron interactions and applications #Optimization and Control (math.OC) #Particle physics theoretical and experimental studies
- New Lower Bounds for Stochastic Non-Convex Optimization through Divergence Decomposition
2025/02/19 by Saad, El Mehdi, Lee, Wei-Cheng, Orabona, Francesco · 1 citation
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- STaR-Bets: Sequential Target-Recalculating Bets for Tighter Confidence Intervals
2025/05/28 by Václav Voràček, Francesco Orabona, Voráček, Václav +1 · 1 citation
Decision Sciences · Computer Science · Mathematics · #Advanced Bandit Algorithms Research #Machine Learning and Algorithms #Statistical Methods and Inference