Olatunji Ruwase

1. Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
   2024/04/22 by Marah Abdin, Jyoti Aneja, Abdin, Marah +262 · 8 voices · 344 citations
   Computer Science · #Computational Physics and Python Applications
2. ZeRO: Memory Optimizations Toward Training Trillion Parameter Models
   2019/10/04 by Samyam Rajbhandari, Rajbhandari, Samyam, Jeff Rasley +5 · 253 citations
   Computer Science · Engineering · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
3. DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale
   2022/06/30 by Reza Yazdani Aminabadi, Aminabadi, Reza Yazdani, Samyam Rajbhandari +19 · 67 citations
   Computer Science · Engineering · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Graph Theory and Algorithms #Machine Learning (cs.LG) #Parallel #Performance (cs.PF) #and Cluster Computing (cs.DC)
4. ZeRO-Offload: Democratizing Billion-Scale Model Training
   2021/01/18 by Jie Ren, Ren, Jie, Samyam Rajbhandari +13 · 55 citations
   Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Topic Modeling #and Cluster Computing (cs.DC)
5. ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning
   2021/04/16 by Samyam Rajbhandari, Olatunji Ruwase, Rajbhandari, Samyam +7 · 47 citations
   Computer Science · #Advanced Neural Network Applications #Stochastic Gradient Optimization Techniques #Parallel Computing and Optimization Techniques
6. DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales
   2023/08/02 by Zhewei Yao, Reza Yazdani Aminabadi, Yao, Zhewei +35 · 15 citations
   Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
7. Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding
   2024/03/05 by Zhenyu Zhang, Runjin Chen, Zhang, Zhenyu +13 · 18 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Speech and dialogue systems
8. FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design
   2024/01/25 by Haojun Xia, Zheng Zhen, Xia, Haojun +25 · 1 voice · 1 citation
   Computer Science · #cs.LG #cs.AI #cs.AR
9. ZeRO++: Extremely Efficient Collective Communication for Giant Model Training
   2023/06/16 by Guanhua Wang, Wang, Guanhua, Heyang Qin +15 · 4 citations
   Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and ELM #Parallel #Performance (cs.PF) #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
10. ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks
    2023/12/14 by Xiaoxia Wu, Wu, Xiaoxia, Haojun Xia +19 · 4 citations
    Computer Science · Engineering · #Topic Modeling #Ferroelectric and Negative Capacitance Devices #Advanced Neural Network Applications
11. Domino: Eliminating Communication in LLM Training via Generic Tensor Slicing and Overlapping
    2024/09/23 by Guanhua Wang, Wang, Guanhua, Chengming Zhang +6 · 3 citations
    Computer Science · #Topic Modeling #Speech Recognition and Synthesis #Natural Language Processing Techniques
12. Mojito: Motion Trajectory and Intensity Control for Video Generation
    2024/12/12 by Xuehai He, He, Xuehai, Shuohang Wang +17 · 2 citations
    Computer Science · Engineering · Social Sciences · #Advanced Vision and Imaging #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation #Multimedia Communication and Technology