Leo Gao
- The Pile: An 800GB Dataset of Diverse Text for Language Modeling
2020/12/31 by Leo Gao, Stella Biderman, Gao, Leo +22 · 6 voices · 277 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
2022/06/09 by Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448 · 3 voices · 138 citations
#cs.CL #cs.AI #cs.CY #cs.LG #stat.ML
- Lessons from the Trenches on Reproducible Evaluation of Language Models
2024/05/23 by Stella Biderman, Hailey Schoelkopf, Biderman, Stella +58 · 2 voices · 35 citations
Computer Science · #Natural Language Processing Techniques
- GPT-NeoX-20B: An Open-Source Autoregressive Language Model
2022/04/14 by Sid Black, Black, Sid, Stella Biderman +31 · 1 voice · 43 citations
Computer Science · #cs.CL
- Scaling Laws for Reward Model Overoptimization
2022/10/19 by Leo Gao, Gao, Leo, John Schulman +3 · 139 citations
Computer Science · #Data Stream Mining Techniques #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics
- Multitask Prompted Training Enables Zero-Shot Task Generalization
2021/10/15 by Victor Sanh, Albert Webson, Sanh, Victor +79 · 67 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision
2023/12/14 by Collin Burns, Pavel Izmailov, Burns, Collin +21 · 50 citations
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Weight-sparse transformers have interpretable circuits
2025/11/17 by Leo Gao, A. Rajaram, Gao, Leo +8 · 6 citations
Computer Science · Materials Science · #Artificial Intelligence (cs.AI) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Materials Science #Multimodal Machine Learning Applications