Islamov, Rustem
- AsGrad: A Sharp Unified Analysis of Asynchronous-SGD Algorithms
2023/10/31 by Islamov, Rustem, Safaryan, Mher, Alistarh, Dan · 5 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- EControl: Fast Distributed Optimization with Compression and Error Control
2023/11/06 by Gao, Yuan, Islamov, Rustem, Stich, Sebastian · 4 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Distributed Second Order Methods with Fast Rates and Compressed Communication
2021/02/14 by Islamov, Rustem, Qian, Xun, Richtárik, Peter · 2 citations
#Distributed #F.2.1 #FOS: Computer and information sciences #FOS: Mathematics #G.1.6 #I.2.11 #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Parallel #and Cluster Computing (cs.DC)
- Loss Landscape Characterization of Neural Networks without Over-Parametrization
2024/10/16 by Rustem Islamov, Islamov, Rustem, Niccolò Ajroldi +6 · 1 voice · 3 citations
Computer Science · #Neural Networks and Applications #cs.LG #math.OC #stat.ML
- Adaptive Methods through the Lens of SDEs: Theoretical Insights on the Role of Noise
2024/11/24 by Enea Monzio Compagnoni, T. Liu, Compagnoni, Enea Monzio +9 · 4 citations
Decision Sciences · #Complex Systems and Decision Making #FOS: Computer and information sciences #Machine Learning (cs.LG)
- FedNL: Making Newton-Type Methods Applicable to Federated Learning
2021/06/05 by Mher Safaryan, Safaryan, Mher, Rustem Islamov +5 · 3 citations
Computer Science · #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Adaptive Compression for Communication-Efficient Distributed Training
2022/10/31 by Maksim Makarenko, Elnur Gasanov, Makarenko, Maksim +7 · 1 citation
Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #Distributed #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Parallel #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Towards Faster Decentralized Stochastic Optimization with Communication Compression
2024/05/30 by Islamov, Rustem, Gao, Yuan, Stich, Sebastian U. · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Distributed Newton-Type Methods with Communication Compression and Bernoulli Aggregation
2022/06/07 by Islamov, Rustem, Qian, Xun, Hanzely, Slavomír +2 · 1 citation
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Clip21: Error Feedback for Gradient Clipping
2023/05/30 by Sarit Khirirat, Eduard Gorbunov, Khirirat, Sarit +9 · 1 citation
Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Privacy-Preserving Technologies in Data #Sparse and Compressive Sensing Techniques
- Double Momentum and Error Feedback for Clipping with Fast Rates and Differential Privacy
2025/02/17 by Rustem Islamov, Islamov, Rustem, Samuel Horváth +7 · 1 citation
Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)