Fatkhullin, Ilyas

1. EF21: A New, Simpler, Theoretically Better, and Practically Faster Error Feedback
   2021/06/09 by Peter Richtárik, Richtárik, Peter, Igor Sokolov +3 · 18 citations
   Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Privacy-Preserving Technologies in Data #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
2. Optimizing Static Linear Feedback: Gradient Method
   2020/04/21 by Fatkhullin, Ilyas, Polyak, Boris · 9 citations
   #49N10 (Primary) 49M37 #90C26 #90C52 (Secondary) #FOS: Mathematics #Optimization and Control (math.OC)
3. From Gradient Clipping to Normalization for Heavy Tailed SGD
   2024/10/17 by Florian Hübler, Hübler, Florian, Ilyas Fatkhullin +3 · 20 citations
   Mathematics · Physics and Astronomy · Engineering · #Gas Dynamics and Kinetic Theory #Atomic and Molecular Physics #Advanced Numerical Methods in Computational Mathematics
4. Momentum Provably Improves Error Feedback!
   2023/05/24 by Ilyas Fatkhullin, Fatkhullin, Ilyas, Alexander Tyurin +3 · 10 citations
   Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Privacy-Preserving Technologies in Data
5. Sharp Analysis of Stochastic Optimization under Global Kurdyka-Łojasiewicz Inequality
   2022/10/04 by Ilyas Fatkhullin, Jalal Etesami, Fatkhullin, Ilyas +5 · 5 citations
   Computer Science · Decision Sciences · Engineering · #90C15 #90C26 #Advanced Bandit Algorithms Research #FOS: Mathematics #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
6. Two Sides of One Coin: the Limits of Untuned SGD and the Power of Adaptive Methods
   2023/05/21 by Junchi Yang, Yang, Junchi, Xiang Li +5 · 5 citations
   Computer Science · Engineering · #Advanced Image Processing Techniques #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
7. Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergence
   2024/02/27 by Fatkhullin, Ilyas, He, Niao · 5 citations
   #90C15 #90C26 #FOS: Computer and information sciences #FOS: Mathematics #G.1.6 #Machine Learning (cs.LG) #Optimization and Control (math.OC)
8. EF21 with Bells & Whistles: Six Algorithmic Extensions of Modern Error Feedback
   2021/10/07 by Ilyas Fatkhullin, Fatkhullin, Ilyas, Igor Sokolov +7 · 2 citations
   Computer Science · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Numerical Methods and Algorithms #Optimization and Control (math.OC)
9. Can SGD Handle Heavy-Tailed Noise?
   2025/08/06 by Fatkhullin, Ilyas, Hübler, Florian, Lan, Guanghui · 7 citations
   #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
10. 3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation
    2022/02/02 by Peter Richtárik, Richtárik, Peter, Igor Sokolov +9 · 1 citation
    Computer Science · Engineering · #Data Structures and Algorithms (cs.DS) #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning and ELM #Optimization and Control (math.OC) #Parallel #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
11. Stochastic Optimization under Hidden Convexity
    2023/12/30 by Ilyas Fatkhullin, Niao He, Fatkhullin, Ilyas +3 · 2 citations
    Computer Science · Engineering · #90C06 #90C15 #90C26 #Age of Information Optimization #Computational Complexity (cs.CC) #FOS: Computer and information sciences #FOS: Mathematics #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
12. Learning Zero-Sum Linear Quadratic Games with Improved Sample Complexity and Last-Iterate Convergence
    2023/09/08 by Jiduan Wu, Wu, Jiduan, Anas Barakat +5 · 1 citation
    Computer Science · Decision Sciences · #Adaptive Dynamic Programming Control #Advanced Bandit Algorithms Research #Computer Science and Game Theory (cs.GT) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Systems and Control (eess.SY) #electronic engineering #information engineering