Rustem Islamov
- AsGrad: A Sharp Unified Analysis of Asynchronous-SGD Algorithms
2023/10/31 by Rustem Islamov, Mher Safaryan, Islamov, Rustem +3 · 5 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Privacy-Preserving Technologies in Data #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- Distributed Second Order Methods with Fast Rates and Compressed Communication
2021/02/14 by Rustem Islamov, Islamov, Rustem, Xun Qian +3 · 2 citations
Computer Science · Engineering · #Distributed #F.2.1 #FOS: Computer and information sciences #FOS: Mathematics #G.1.6 #I.2.11 #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Loss Landscape Characterization of Neural Networks without Over-Parametrization
2024/10/16 by Rustem Islamov, Islamov, Rustem, Niccolò Ajroldi +6 · 1 voice · 3 citations
Computer Science · #Neural Networks and Applications #cs.LG #math.OC #stat.ML
- Adaptive Methods through the Lens of SDEs: Theoretical Insights on the Role of Noise
2024/11/24 by Enea Monzio Compagnoni, Compagnoni, Enea Monzio, T. Liu +9 · 4 citations
Decision Sciences · #Complex Systems and Decision Making #FOS: Computer and information sciences #Machine Learning (cs.LG)
- FedNL: Making Newton-Type Methods Applicable to Federated Learning
2021/06/05 by Mher Safaryan, Safaryan, Mher, Rustem Islamov +5 · 3 citations
Computer Science · #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Adaptive Compression for Communication-Efficient Distributed Training
2022/10/31 by Maksim Makarenko, Elnur Gasanov, Makarenko, Maksim +7 · 1 citation
Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #Distributed #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Parallel #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Clip21: Error Feedback for Gradient Clipping
2023/05/30 by Sarit Khirirat, Khirirat, Sarit, Eduard Gorbunov +9 · 1 citation
Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Privacy-Preserving Technologies in Data #Sparse and Compressive Sensing Techniques
- Double Momentum and Error Feedback for Clipping with Fast Rates and Differential Privacy
2025/02/17 by Rustem Islamov, Islamov, Rustem, Samuel Horváth +7 · 1 citation
Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- What's in a Smoothness Constant? Tighter Rates for Local SGD with Bounded Second-order Heterogeneity
2026/07/16 by Kumar Kshitij Patel, Rustem Islamov, Sebastian U Stich +3
#cs.LG #math.OC #stat.ML