Egor Shulgin

1. Gluon: Making Muon & Scion Great Again! (Bridging Theory and Practice of LMO-based Optimizers for LLMs)
   2025/05/19 by Artem Riabinin, Egor Shulgin, Riabinin, Artem +5 · 23 citations
   Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
2. Towards a Better Theoretical Understanding of Independent Subnetwork Training
   2023/06/28 by Egor Shulgin, Shulgin, Egor, Peter Richtárik +1 · 1 citation
   Computer Science · #Neural Networks and Applications #Advanced Neural Network Applications #Machine Learning and ELM
3. MAST: Model-Agnostic Sparsified Training
   2023/11/27 by Yury Demidovich, Demidovich, Yury, Grigory Malinovsky +5 · 1 citation
   Computer Science · #Artificial Intelligence (cs.AI) #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning and ELM #Optimization and Control (math.OC) #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
4. On the Convergence of DP-SGD with Adaptive Clipping
   2024/12/27 by Egor Shulgin, Peter Richtárik, Shulgin, Egor +1 · 3 citations
   Computer Science · #Cryptography and Security (cs.CR) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
5. ADOM: Accelerated Decentralized Optimization Method for Time-Varying Networks
   2021/02/18 by Dmitry Kovalev, Egor Shulgin, Kovalev, Dmitry +7 · 1 citation
   Engineering · Computer Science · #Sparse and Compressive Sensing Techniques #Distributed Control Multi-Agent Systems #Stochastic Gradient Optimization Techniques
6. Beyond the Ideal: Analyzing the Inexact Muon Update
   2025/10/22 by Egor Shulgin, Sultan AlRashed, Shulgin, Egor +5 · 4 citations
   Computer Science · Engineering · Physics and Astronomy · #Computational Physics and Python Applications #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Muon and positron interactions and applications #Optimization and Control (math.OC) #Particle physics theoretical and experimental studies