vix.ing · top · new · best · stats · spec

Eduard Gorbunov

  1. Distributed Learning with Compressed Gradient Differences
    2019/01/26 by Konstantin Mishchenko, Mishchenko, Konstantin, Eduard Gorbunov +5 · 23 citations
    Computer Science · Engineering · #Distributed Sensor Networks and Detection Algorithms #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  2. Stochastic Optimization with Heavy-Tailed Noise via Accelerated Gradient Clipping
    2020/05/21 by Eduard Gorbunov, Gorbunov, Eduard, М. А. Данилова +4 · 11 citations
    Engineering · Computer Science · Mathematics · #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Markov Chains and Monte Carlo Methods
  3. A Unified Theory of SGD: Variance Reduction, Sampling, Quantization and\n Coordinate Descent
    2019/05/27 by Eduard Gorbunov, Gorbunov, Eduard, Filip Hanzely +3 · 9 citations
    Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Markov Chains and Monte Carlo Methods #Numerical Analysis (math.NA) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Statistical Methods and Inference #Stochastic Gradient Optimization Techniques
  4. High-Probability Bounds for Stochastic Optimization and Variational Inequalities: the Case of Unbounded Variance
    2023/02/02 by Abdurakhmon Sadiev, М. А. Данилова, Sadiev, Abdurakhmon +13 · 8 citations
    Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Optimization and Variational Analysis #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  5. Recent Theoretical Advances in Non-Convex Optimization
    2020/12/11 by М. А. Данилова, Pavel Dvurechensky, Danilova, Marina +11 · 5 citations
    Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  6. High-Probability Convergence for Composite and Distributed Stochastic Minimization and Variational Inequalities with Heavy-Tailed Noise
    2023/10/03 by Eduard Gorbunov, Gorbunov, Eduard, Abdurakhmon Sadiev +13 · 8 citations
    Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  7. Extragradient Method: O(1/K) Last-Iterate Convergence for Monotone\n Variational Inequalities and Connections With Cocoercivity
    2021/10/08 by Eduard Gorbunov, Gorbunov, Eduard, Nicolas Loizou +3 · 5 citations
    Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Optimization and Variational Analysis #Sparse and Compressive Sensing Techniques
  8. Linearly Converging Error Compensated SGD
    2020/10/23 by Eduard Gorbunov, Gorbunov, Eduard, Dmitry Kovalev +5 · 3 citations
    Computer Science · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
  9. Variance Reduction is an Antidote to Byzantines: Better Rates, Weaker Assumptions and Communication Compression as a Cherry on the Top
    2022/06/01 by Eduard Gorbunov, Samuel Horváth, Gorbunov, Eduard +5 · 3 citations
    Computer Science · Mathematics · #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #Random Matrices and Applications #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  10. Communication Compression for Byzantine Robust Learning: New Efficient Algorithms and Improved Rates
    2023/10/15 by Ahmad Rammal, Kaja Gruntkowska, Rammal, Ahmad +7 · 4 citations
    Computer Science · #90C26 #Cooperative Communication and Network Coding #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
  11. Clipping Improves Adam-Norm and AdaGrad-Norm when the Noise Is Heavy-Tailed
    2024/06/06 by Savelii Chezhegov, Chezhegov, Savelii, Yaroslav Klyukin +13 · 3 citations
    Computer Science · Neuroscience · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Neural Networks and Applications #Neural dynamics and brain function #Optimization and Control (math.OC)
  12. EF21 with Bells & Whistles: Six Algorithmic Extensions of Modern Error Feedback
    2021/10/07 by Ilyas Fatkhullin, Fatkhullin, Ilyas, Igor Sokolov +7 · 2 citations
    Computer Science · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Numerical Methods and Algorithms #Optimization and Control (math.OC)
  13. Linear Convergence Rate in Convex Setup is Possible! Gradient Descent Method Variants under (L0,L1)-Smoothness
    2024/12/22 by Aleksandr Lobanov, Lobanov, Aleksandr, Alexander Gasnikov +5 · 4 citations
    Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Mathematics #Iterative Methods for Nonlinear Equations #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques
  14. A Stochastic Derivative Free Optimization Method with Momentum
    2019/05/30 by Eduard Gorbunov, Gorbunov, Eduard, Adel Bibi +7 · 1 citation
    Computer Science · Engineering · Mathematics · #FOS: Mathematics #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  15. Secure Distributed Training at Scale
    2021/06/21 by Eduard Gorbunov, Alexander Borzunov, Gorbunov, Eduard +5 · 1 citation
    Computer Science · #Cryptography and Data Security #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  16. Exploring Jacobian Inexactness in Second-Order Methods for Variational Inequalities: Lower Bounds, Optimal Algorithms and Quasi-Newton Approximations
    2024/05/25 by Artem Agafonov, Petr Ostroukhov, Agafonov, Artem +13 · 2 citations
    Mathematics · Computer Science · Engineering · #Advanced Optimization Algorithms Research #Optimization and Variational Analysis #Advanced Control Systems Optimization
  17. Clipped Stochastic Methods for Variational Inequalities with Heavy-Tailed Noise
    2022/06/02 by Eduard Gorbunov, Gorbunov, Eduard, Marina Danilova +9 · 1 citation
    Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Statistical Methods and Inference #Stochastic Gradient Optimization Techniques
  18. 3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation
    2022/02/02 by Peter Richtárik, Richtárik, Peter, Igor Sokolov +9 · 1 citation
    Computer Science · Engineering · #Data Structures and Algorithms (cs.DS) #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning and ELM #Optimization and Control (math.OC) #Parallel #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  19. Single-Call Stochastic Extragradient Methods for Structured Non-monotone Variational Inequalities: Improved Analysis under Weaker Conditions
    2023/02/27 by Sayantan Choudhury, Eduard Gorbunov, Choudhury, Sayantan +3 · 2 citations
    Computer Science · Engineering · #Computer Science and Game Theory (cs.GT) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  20. Byzantine Robustness and Partial Participation Can Be Achieved at Once: Just Clip Gradient Differences
    2023/11/23 by Grigory Malinovsky, Malinovsky, Grigory, Peter Richtárik +5 · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #Blockchain Technology Applications and Security #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  21. Stochastic Extragradient: General Analysis and Improved Rates
    2021/11/16 by Eduard Gorbunov, Gorbunov, Eduard, Hugo Berard +5 · 1 citation
    Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Complexity and Algorithms in Graphs
  22. Federated Optimization Algorithms with Random Reshuffling and Gradient Compression
    2022/06/14 by Abdurakhmon Sadiev, Sadiev, Abdurakhmon, Grigory Malinovsky +11 · 1 citation
    Computer Science · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Privacy-Preserving Technologies in Data #Random Matrices and Applications #Stochastic Gradient Optimization Techniques
  23. Clip21: Error Feedback for Gradient Clipping
    2023/05/30 by Sarit Khirirat, Khirirat, Sarit, Eduard Gorbunov +9 · 1 citation
    Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Privacy-Preserving Technologies in Data #Sparse and Compressive Sensing Techniques
  24. Double Momentum and Error Feedback for Clipping with Fast Rates and Differential Privacy
    2025/02/17 by Rustem Islamov, Islamov, Rustem, Samuel Horváth +7 · 1 citation
    Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  25. What's in a Smoothness Constant? Tighter Rates for Local SGD with Bounded Second-order Heterogeneity
    2026/07/16 by Kumar Kshitij Patel, Rustem Islamov, Sebastian U Stich +3
    #cs.LG #math.OC #stat.ML