vix.ing · top · new · best · stats · spec

Gorbunov, Eduard

  1. Distributed Learning with Compressed Gradient Differences
    2019/01/26 by Konstantin Mishchenko, Eduard Gorbunov, Mishchenko, Konstantin +5 · 35 citations
    Computer Science · Engineering · #Distributed Sensor Networks and Detection Algorithms #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  2. Stochastic Optimization with Heavy-Tailed Noise via Accelerated Gradient Clipping
    2020/05/21 by Eduard Gorbunov, М. А. Данилова, Gorbunov, Eduard +4 · 13 citations
    Engineering · Computer Science · Mathematics · #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Markov Chains and Monte Carlo Methods
  3. A Unified Theory of SGD: Variance Reduction, Sampling, Quantization and\n Coordinate Descent
    2019/05/27 by Eduard Gorbunov, Gorbunov, Eduard, Filip Hanzely +3 · 11 citations
    Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Markov Chains and Monte Carlo Methods #Numerical Analysis (math.NA) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Statistical Methods and Inference #Stochastic Gradient Optimization Techniques
  4. High-Probability Bounds for Stochastic Optimization and Variational Inequalities: the Case of Unbounded Variance
    2023/02/02 by Abdurakhmon Sadiev, М. А. Данилова, Sadiev, Abdurakhmon +13 · 10 citations
    Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Optimization and Variational Analysis #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  5. Recent Theoretical Advances in Non-Convex Optimization
    2020/12/11 by М. А. Данилова, Pavel Dvurechensky, Danilova, Marina +11 · 6 citations
    Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  6. MARINA: Faster Non-Convex Distributed Learning with Compression
    2021/02/15 by Gorbunov, Eduard, Burlachenko, Konstantin, Li, Zhize +1 · 6 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  7. High-Probability Convergence for Composite and Distributed Stochastic Minimization and Variational Inequalities with Heavy-Tailed Noise
    2023/10/03 by Eduard Gorbunov, Gorbunov, Eduard, Abdurakhmon Sadiev +13 · 9 citations
    Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  8. Extragradient Method: O(1/K) Last-Iterate Convergence for Monotone\n Variational Inequalities and Connections With Cocoercivity
    2021/10/08 by Eduard Gorbunov, Nicolas Loizou, Gorbunov, Eduard +3 · 5 citations
    Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Optimization and Variational Analysis #Sparse and Compressive Sensing Techniques
  9. Linearly Converging Error Compensated SGD
    2020/10/23 by Eduard Gorbunov, Dmitry Kovalev, Gorbunov, Eduard +5 · 5 citations
    Computer Science · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
  10. Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices
    2021/03/04 by Ryabinin, Max, Gorbunov, Eduard, Plokhotnyuk, Vsevolod +1 · 4 citations
    #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Parallel #and Cluster Computing (cs.DC)
  11. Methods for Convex (L0,L1)-Smooth Optimization: Clipping, Acceleration, and Adaptivity
    2024/09/23 by Gorbunov, Eduard, Tupitsa, Nazarii, Choudhury, Sayantan +4 · 9 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  12. Local SGD: Unified Theory and New Efficient Methods
    2020/11/03 by Gorbunov, Eduard, Hanzely, Filip, Richtárik, Peter · 4 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  13. Breaking the Heavy-Tailed Noise Barrier in Stochastic Optimization Problems
    2023/11/07 by Nikita Puchkin, Puchkin, Nikita, Eduard Gorbunov +5 · 6 citations
    Computer Science · Mathematics · #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Statistical Methods and Inference #Statistics Theory (math.ST) #Stochastic Gradient Optimization Techniques
  14. Variance Reduction is an Antidote to Byzantines: Better Rates, Weaker Assumptions and Communication Compression as a Cherry on the Top
    2022/06/01 by Eduard Gorbunov, Gorbunov, Eduard, Samuel Horváth +5 · 4 citations
    Computer Science · Mathematics · #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #Random Matrices and Applications #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  15. Communication Compression for Byzantine Robust Learning: New Efficient Algorithms and Improved Rates
    2023/10/15 by Ahmad Rammal, Rammal, Ahmad, Kaja Gruntkowska +7 · 4 citations
    Computer Science · #90C26 #Cooperative Communication and Network Coding #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
  16. Accelerated Zeroth-order Method for Non-Smooth Stochastic Convex Optimization Problem with Infinite Variance
    2023/10/28 by Kornilov, Nikita, Shamir, Ohad, Lobanov, Aleksandr +5 · 4 citations
    #FOS: Mathematics #Optimization and Control (math.OC)
  17. Clipping Improves Adam-Norm and AdaGrad-Norm when the Noise Is Heavy-Tailed
    2024/06/06 by Savelii Chezhegov, Yaroslav Klyukin, Chezhegov, Savelii +13 · 4 citations
    Computer Science · Neuroscience · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Neural Networks and Applications #Neural dynamics and brain function #Optimization and Control (math.OC)
  18. High Probability Complexity Bounds for Non-Smooth Stochastic Optimization with Heavy-Tailed Noise
    2021/06/10 by Gorbunov, Eduard, Danilova, Marina, Shibaev, Innokentiy +2 · 2 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  19. Secure Distributed Training at Scale
    2021/06/21 by Eduard Gorbunov, Alexander Borzunov, Gorbunov, Eduard +5 · 2 citations
    Computer Science · #Cryptography and Data Security #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  20. Last-Iterate Convergence of Optimistic Gradient Method for Monotone Variational Inequalities
    2022/05/17 by Gorbunov, Eduard, Taylor, Adrien, Gidel, Gauthier · 2 citations
    #FOS: Mathematics #Optimization and Control (math.OC)
  21. EF21 with Bells & Whistles: Six Algorithmic Extensions of Modern Error Feedback
    2021/10/07 by Ilyas Fatkhullin, Igor Sokolov, Fatkhullin, Ilyas +7 · 2 citations
    Computer Science · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Numerical Methods and Algorithms #Optimization and Control (math.OC)
  22. Stochastic Gradient Descent-Ascent: Unified Theory and New Efficient Methods
    2022/02/15 by Beznosikov, Aleksandr, Gorbunov, Eduard, Berard, Hugo +1 · 2 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  23. Linear Convergence Rate in Convex Setup is Possible! Gradient Descent Method Variants under (L0,L1)-Smoothness
    2024/12/22 by Aleksandr Lobanov, Lobanov, Aleksandr, Alexander Gasnikov +5 · 4 citations
    Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Mathematics #Iterative Methods for Nonlinear Equations #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques
  24. Stochastic Three Points Method for Unconstrained Smooth Minimization
    2019/02/10 by Bergou, El Houcine, Gorbunov, Eduard, Richtárik, Peter · 1 citation
    #FOS: Mathematics #Optimization and Control (math.OC)
  25. A Stochastic Derivative Free Optimization Method with Momentum
    2019/05/30 by Eduard Gorbunov, Adel Bibi, Gorbunov, Eduard +7 · 1 citation
    Computer Science · Engineering · Mathematics · #FOS: Mathematics #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  26. Exploring Jacobian Inexactness in Second-Order Methods for Variational Inequalities: Lower Bounds, Optimal Algorithms and Quasi-Newton Approximations
    2024/05/25 by Artem Agafonov, Petr Ostroukhov, Agafonov, Artem +13 · 2 citations
    Mathematics · Computer Science · Engineering · #Advanced Optimization Algorithms Research #Optimization and Variational Analysis #Advanced Control Systems Optimization
  27. Clipped Stochastic Methods for Variational Inequalities with Heavy-Tailed Noise
    2022/06/02 by Eduard Gorbunov, Gorbunov, Eduard, Marina Danilova +9 · 1 citation
    Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Statistical Methods and Inference #Stochastic Gradient Optimization Techniques
  28. Error Feedback under (L0,L1)-Smoothness: Normalization and Momentum
    2024/10/22 by Khirirat, Sarit, Sadiev, Abdurakhmon, Riabinin, Artem +2 · 3 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  29. 3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation
    2022/02/02 by Peter Richtárik, Richtárik, Peter, Igor Sokolov +9 · 1 citation
    Computer Science · Engineering · #Data Structures and Algorithms (cs.DS) #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning and ELM #Optimization and Control (math.OC) #Parallel #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  30. Convergence of Proximal Point and Extragradient-Based Methods Beyond Monotonicity: the Case of Negative Comonotonicity
    2022/10/25 by Gorbunov, Eduard, Taylor, Adrien, Horváth, Samuel +1 · 1 citation
    #FOS: Mathematics #Optimization and Control (math.OC)
  31. Single-Call Stochastic Extragradient Methods for Structured Non-monotone Variational Inequalities: Improved Analysis under Weaker Conditions
    2023/02/27 by Sayantan Choudhury, Eduard Gorbunov, Choudhury, Sayantan +3 · 2 citations
    Computer Science · Engineering · #Computer Science and Game Theory (cs.GT) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  32. Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning
    2024/11/29 by Kaustubh Ponkshe, Ponkshe, Kaustubh, Raghav Singhal +9 · 2 citations
    Engineering · #Advancements in PLL and VCO Technologies #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Microwave Engineering and Waveguides #Radio Frequency Integrated Circuit Design
  33. Byzantine Robustness and Partial Participation Can Be Achieved at Once: Just Clip Gradient Differences
    2023/11/23 by Grigory Malinovsky, Peter Richtárik, Malinovsky, Grigory +5 · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #Blockchain Technology Applications and Security #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  34. Stochastic Extragradient: General Analysis and Improved Rates
    2021/11/16 by Eduard Gorbunov, Gorbunov, Eduard, Hugo Berard +5 · 1 citation
    Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Complexity and Algorithms in Graphs
  35. Federated Optimization Algorithms with Random Reshuffling and Gradient Compression
    2022/06/14 by Abdurakhmon Sadiev, Grigory Malinovsky, Sadiev, Abdurakhmon +11 · 1 citation
    Computer Science · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Privacy-Preserving Technologies in Data #Random Matrices and Applications #Stochastic Gradient Optimization Techniques
  36. Clip21: Error Feedback for Gradient Clipping
    2023/05/30 by Sarit Khirirat, Khirirat, Sarit, Eduard Gorbunov +9 · 1 citation
    Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Privacy-Preserving Technologies in Data #Sparse and Compressive Sensing Techniques
  37. Convergence of Clipped-SGD for Convex (L0,L1)-Smooth Optimization with Heavy-Tailed Noise
    2025/05/27 by Chezhegov, Savelii, Beznosikov, Aleksandr, Horváth, Samuel +1 · 3 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  38. Double Momentum and Error Feedback for Clipping with Fast Rates and Differential Privacy
    2025/02/17 by Rustem Islamov, Samuel Horváth, Islamov, Rustem +7 · 1 citation
    Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  39. Methods with Local Steps and Random Reshuffling for Generally Smooth Non-Convex Federated Optimization
    2024/12/03 by Demidovich, Yury, Ostroukhov, Petr, Malinovsky, Grigory +4 · 1 citation
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)