Sam Shleifer
- OPT: Open Pre-trained Transformer Language Models
2022/05/02 by Susan Zhang, Stephen Roller, Zhang, Susan +35 · 2 voices · 511 citations
Computer Science · #cs.CL #cs.LG
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Eric Bieber, Comanici, Gheorghe +6844 · 8 voices · 1533 citations
Computer Science · #cs.CL #cs.AI
- Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
2022/06/09 by Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448 · 3 voices · 314 citations
Computer Science · Mathematics · #cs.CL #cs.AI #cs.CY #cs.LG #stat.ML
- HuggingFace's Transformers: State-of-the-art Natural Language Processing
2019/10/09 by Thomas Wolf, Wolf, Thomas, Lysandre Debut +42 · 451 citations
Computer Science · Engineering · Materials Science · #Architecture #Computation and Language (cs.CL) #Computer science #Electrical engineering #Engineering #FOS: Computer and information sciences #Machine Learning in Materials Science #Natural Language Processing Techniques #Software engineering #Topic Modeling #Transformer #cs.CL
- PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel
2023/04/21 by Yanli Zhao, Andrew Gu, Zhao, Yanli +31 · 212 citations
Computer Science · #Advanced Neural Network Applications #Parallel Computing and Optimization Techniques #Advanced Data Storage Technologies
- 8-bit Optimizers via Block-wise Quantization
2021/10/06 by Tim Dettmers, Mike Lewis, Dettmers, Tim +5 · 97 citations
Computer Science · Mathematics · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Stochastic Gradient Optimization Techniques #Tensor decomposition and applications #cs.LG