Bekman, Stas

1. BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
   2022/11/09 by BigScience Workshop, Workshop, BigScience, Teven Le Scao +784 · 1 voice · 180 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
2. Datasets: A Community Library for Natural Language Processing
   2021/09/07 by Quentin Lhoest, Lhoest, Quentin, Albert Villanova del Moral +61 · 1 voice · 71 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
3. OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents
   2023/06/21 by Hugo Laurençon, Laurençon, Hugo, Lucile Saulnier +22 · 1 voice · 57 citations
   Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.CV #cs.IR
4. What Language Model to Train if You Have One Million GPU Hours?
   2022/10/27 by Teven Le Scao, Thomas J. Wang, Scao, Teven Le +34 · 9 citations
   Computer Science · Materials Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Materials Science #Parallel Computing and Optimization Techniques #Topic Modeling
5. Universal Checkpointing: A Flexible and Efficient Distributed Checkpointing System for Large-Scale DNN Training with Reconfigurable Parallelis
   2024/06/27 by Xinyu Lian, Sam Adé Jacobs, Lian, Xinyu +11 · 7 citations
   Computer Science · #Distributed #Distributed and Parallel Computing Systems #Distributed systems and fault tolerance #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
6. The Case for Co-Designing Model Architectures with Hardware
   2024/01/25 by Anthony, Quentin, Hatef, Jacob, Narayanan, Deepak +6 · 3 citations
   #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
7. Arctic Long Sequence Training: Scalable And Efficient Training For Multi-Million Token Sequences
   2025/06/16 by Stas Bekman, Samyam Rajbhandari, Bekman, Stas +13 · 1 citation
   Computer Science · #Algorithms and Data Compression #FOS: Computer and information sciences #Machine Learning (cs.LG)