Lian, Xiangru

1. Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent
   2017/05/25 by Xiangru Lian, Lian, Xiangru, Ce Zhang +9 · 48 citations
   Computer Science · #Stochastic Gradient Optimization Techniques #Distributed Control Multi-Agent Systems #Age of Information Optimization
2. D²: Decentralized Training over Decentralized Data
   2018/03/19 by Hanlin Tang, Tang, Hanlin, Xiangru Lian +7 · 28 citations
   Computer Science · #Stochastic Gradient Optimization Techniques #Privacy-Preserving Technologies in Data #Complexity and Algorithms in Graphs
3. Asynchronous Decentralized Parallel Stochastic Gradient Descent
   2017/10/18 by Xiangru Lian, Lian, Xiangru, Wei Zhang +5 · 19 citations
   Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Privacy-Preserving Technologies in Data #Sparse and Compressive Sensing Techniques
4. Asynchronous Parallel Stochastic Gradient for Nonconvex Optimization
   2015/06/27 by Lian, Xiangru, Huang, Yijun, Li, Yuncheng +1 · 9 citations
   #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (stat.ML) #Numerical Analysis (math.NA) #Optimization and Control (math.OC)
5. DouZero: Mastering DouDizhu with Self-Play Deep Reinforcement Learning
   2021/06/11 by Daochen Zha, Zha, Daochen, Jingru Xie +11 · 7 citations
   Computer Science · Psychology · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Games #Digital Games and Media #FOS: Computer and information sciences #Gambling Behavior and Treatments #Machine Learning (cs.LG)
6. Staleness-aware Async-SGD for Distributed Deep Learning
   2015/11/18 by Wei Zhang, Suyog Gupta, Zhang, Wei +5 · 6 citations
   Computer Science · #Advanced Neural Network Applications #Stochastic Gradient Optimization Techniques #Adversarial Robustness in Machine Learning
7. DoubleSqueeze: Parallel Stochastic Gradient Descent with Double-Pass Error-Compensated Compression
   2019/05/15 by Tang, Hanlin, Lian, Xiangru, Yu, Chen +2 · 5 citations
   #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
8. A Comprehensive Linear Speedup Analysis for Asynchronous Stochastic Parallel Optimization from Zeroth-Order to First-Order
   2016/06/01 by Lian, Xiangru, Zhang, Huan, Hsieh, Cho-Jui +2 · 4 citations
   #FOS: Mathematics #Optimization and Control (math.OC)
9. Persia: An Open, Hybrid System Scaling Deep Learning-based Recommenders up to 100 Trillion Parameters
   2021/11/10 by Xiangru Lian, Binhang Yuan, Lian, Xiangru +51 · 3 citations
   Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Parallel #Recommender Systems and Techniques #and Cluster Computing (cs.DC)
10. DeepSqueeze: Decentralization Meets Error-Compensated Compression
    2019/07/17 by Tang, Hanlin, Lian, Xiangru, Qiu, Shuang +4 · 2 citations
    #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #and Cluster Computing (cs.DC)
11. 1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed
    2021/02/04 by Tang, Hanlin, Gan, Shaoduo, Awan, Ammar Ahmad +6 · 1 citation
    #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
12. BAGUA: Scaling up Distributed Learning with System Relaxations
    2021/07/03 by Gan, Shaoduo, Lian, Xiangru, Wang, Rui +11 · 1 citation
    #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)