Konstantin Mishchenko

1. The Road Less Scheduled
   2024/05/24 by Aaron Defazio, Xingyu, Xingyu Alice Yang +10 · 4 voices · 35 citations
   Computer Science · Decision Sciences · Mathematics · #Advanced Bandit Algorithms Research #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques #cs.AI #cs.LG #math.OC #stat.ML
2. Regularized Newton Method with Global O(1/k²) Convergence
   2021/12/03 by Konstantin Mishchenko, Mishchenko, Konstantin · 1 voice · 7 citations
   #math.OC #cs.LG
3. Distributed Learning with Compressed Gradient Differences
   2019/01/26 by Konstantin Mishchenko, Mishchenko, Konstantin, Eduard Gorbunov +5 · 22 citations
   Computer Science · Engineering · #Distributed Sensor Networks and Detection Algorithms #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
4. ProxSkip: Yes! Local Gradient Steps Provably Lead to Communication Acceleration! Finally!
   2022/02/18 by Konstantin Mishchenko, Mishchenko, Konstantin, Grigory Malinovsky +5 · 9 citations
   Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Privacy-Preserving Technologies in Data #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
5. Random Reshuffling: Simple Analysis with Vast Improvements
   2020/06/10 by Konstantin Mishchenko, Ahmed Khaled, Mishchenko, Konstantin +3 · 6 citations
   Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Complexity and Algorithms in Graphs
6. Super-Universal Regularized Newton Method
   2022/08/11 by Nikita Doikov, Doikov, Nikita, Konstantin Mishchenko +3 · 7 citations
   Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Optimization and Variational Analysis #Sparse and Compressive Sensing Techniques
7. Stochastic Distributed Learning with Gradient Quantization and Variance Reduction
   2019/04/10 by Samuel Horváth, Dmitry Kovalev, Horváth, Samuel +7 · 13 citations
   Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Privacy-Preserving Technologies in Data #Sparse and Compressive Sensing Techniques
8. DoWG Unleashed: An Efficient Universal Parameter-Free Gradient Descent Method
   2023/05/25 by Ahmed Khaled, Khaled, Ahmed, Konstantin Mishchenko +3 · 8 citations
   Computer Science · Engineering · Medicine · #FOS: Computer and information sciences #FOS: Mathematics #Glioma Diagnosis and Treatment #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
9. Server-Side Stepsizes and Sampling Without Replacement Provably Help in Federated Optimization
   2022/01/26 by Grigory Malinovsky, Malinovsky, Grigory, Konstantin Mishchenko +3 · 3 citations
   Computer Science · #Cooperative Communication and Network Coding #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
10. A Stochastic Decoupling Method for Minimizing the Sum of Smooth and\n Non-Smooth Functions
    2019/05/27 by Konstantin Mishchenko, Mishchenko, Konstantin, Peter Richtárik +1 · 1 citation
    Computer Science · Engineering · Mathematics · #FOS: Mathematics #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Statistical Methods and Inference #Stochastic Gradient Optimization Techniques