Cong Xie

1. MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs
   2024/02/23 by Ziheng Jiang, Haibin Lin, Jiang, Ziheng +61 · 36 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques
2. Fall of Empires: Breaking Byzantine-tolerant SGD by Inner Product Manipulation
   2019/03/10 by Cong Xie, Oluwasanmi Koyejo, Xie, Cong +4 · 14 citations
   Computer Science · #Adversarial Robustness in Machine Learning #Age of Information Optimization #Cryptography and Security (cs.CR) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
3. Zeno: Distributed Stochastic Gradient Descent with Suspicion-based\n Fault-tolerance
   2018/05/25 by Cong Xie, Oluwasanmi Koyejo, Xie, Cong +3 · 10 citations
   Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Cryptography and Security (cs.CR) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
4. Local AdaAlter: Communication-Efficient Stochastic Gradient Descent with Adaptive Learning Rates
   2019/11/20 by Cong Xie, Xie, Cong, Oluwasanmi Koyejo +5 · 6 citations
   Computer Science · #Stochastic Gradient Optimization Techniques #Privacy-Preserving Technologies in Data #Machine Learning and ELM
5. Phocas: dimensional Byzantine-resilient stochastic gradient descent
   2018/05/23 by Cong Xie, Xie, Cong, Oluwasanmi Koyejo +3 · 5 citations
   Computer Science · #Cryptography and Data Security #Distributed #FOS: Computer and information sciences #Machine Learning (stat.ML) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
6. The protozoan commensal Tritrichomonas musculis is a natural adjuvant for mucosal IgA
   2024/10/22 by Eric Yixiao Cao, Kyle Burrows, Pailin Chiaranunt +14 · 1 voice · 1 citation
   Medicine · Biochemistry, Genetics and Molecular Biology · #Clostridium difficile and Clostridium perfringens research #Gut microbiota and health #Transgenic Plants and Applications
7. SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training
   2024/10/20 by Jinda Jia, Jia, Jinda, Cong Xie +19 · 2 citations
   Computer Science · #Advanced Data Storage Technologies #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
8. Object-Driven One-Shot Fine-tuning of Text-to-Image Diffusion with Prototypical Embedding
   2024/01/28 by Jianxiang Lu, Cong Xie, Lu, Jianxiang +3 · 1 voice
   Computer Science · Biochemistry, Genetics and Molecular Biology · Engineering · #Digital Media Forensic Detection #Cell Image Analysis Techniques #Image Processing Techniques and Applications
9. Cautious Weight Decay
   2025/10/14 by Lizhang Chen, Chen, Lizhang, Jonathan Li +16 · 1 voice · 1 citation
   Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Stochastic Gradient Optimization Techniques #cs.LG #math.OC #stat.ML
10. CSER: Communication-efficient SGD with Error Reset
    2020/07/26 by Cong Xie, Shuai Zheng, Xie, Cong +9 · 1 citation
    Computer Science · #Stochastic Gradient Optimization Techniques #Advanced Neural Network Applications #Privacy-Preserving Technologies in Data