Ammar Ahmad Awan

1. Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
   2024/04/22 by Marah Abdin, Jyoti Aneja, Abdin, Marah +262 · 8 voices · 399 citations
   Computer Science · #Computational Physics and Python Applications
2. DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale
   2022/06/30 by Reza Yazdani Aminabadi, Samyam Rajbhandari, Aminabadi, Reza Yazdani +19 · 76 citations
   Computer Science · Engineering · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Graph Theory and Algorithms #Machine Learning (cs.LG) #Parallel #Performance (cs.PF) #and Cluster Computing (cs.DC)
3. DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference
   2024/01/09 by Connor Holmes, Holmes, Connor, Masahiro Tanaka +19 · 20 citations
   Computer Science · Engineering · #Topic Modeling #Natural Language Processing Techniques #Ferroelectric and Negative Capacitance Devices
4. DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales
   2023/08/02 by Zhewei Yao, Yao, Zhewei, Reza Yazdani Aminabadi +35 · 16 citations
   Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
5. DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
   2023/10/06 by Shuaiwen Leon Song, Bonnie Kruft, Song, Shuaiwen Leon +181 · 5 citations
   Biochemistry, Genetics and Molecular Biology · Decision Sciences · Materials Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Genetics, Bioinformatics, and Biomedical Research #Machine Learning (cs.LG) #Machine Learning in Materials Science #Scientific Computing and Data Management
6. 1-bit Adam: Communication Efficient Large-Scale Training with Adam's\n Convergence Speed
   2021/02/04 by Hanlin Tang, Shaoduo Gan, Tang, Hanlin +15 · 2 citations
   Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
7. Optimized Broadcast for Deep Learning Workloads on Dense-GPU InfiniBand Clusters: MPI or NCCL?
   2017/07/28 by Ammar Ahmad Awan, Awan, Ammar Ahmad, Ching-Hsiang Chu +5 · 1 citation
   Computer Science · #Advanced Data Storage Technologies #Caching and Content Delivery #Distributed #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)