Shleifer, Sam
- OPT: Open Pre-trained Transformer Language Models
2022/05/02 by Susan Zhang, Stephen Roller, Zhang, Susan +35 · 2 voices · 462 citations
Computer Science · #cs.CL #cs.LG
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Eric Bieber, Comanici, Gheorghe +6844 · 8 voices · 1459 citations
Computer Science · #cs.CL #cs.AI
- HuggingFace's Transformers: State-of-the-art Natural Language Processing
2019/10/09 by Thomas Wolf, Lysandre Debut, Wolf, Thomas +29 · 410 citations
Computer Science · Materials Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning in Materials Science #Natural Language Processing Techniques #Topic Modeling
- Efficient Large Scale Language Modeling with Mixtures of Experts
2021/12/20 by Mikel Artetxe, Shruti Bhosale, Artetxe, Mikel +47 · 1 voice · 26 citations
Computer Science · #Topic Modeling #Expert finding and Q&A systems #Machine Learning in Healthcare
- PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel
2023/04/21 by Yanli Zhao, Andrew Gu, Zhao, Yanli +31 · 185 citations
Computer Science · #Advanced Neural Network Applications #Parallel Computing and Optimization Techniques #Advanced Data Storage Technologies
- 8-bit Optimizers via Block-wise Quantization
2021/10/06 by Tim Dettmers, Dettmers, Tim, Mike Lewis +5 · 90 citations
Computer Science · Mathematics · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Stochastic Gradient Optimization Techniques #Tensor decomposition and applications
- Few-shot Learning with Multilingual Language Models
2021/12/20 by Xi Victoria Lin, Todor Mihaylov, Lin, Xi Victoria +39 · 30 citations
Computer Science · #Topic Modeling #Hate Speech and Cyberbullying Detection #Natural Language Processing Techniques
- Pre-trained Summarization Distillation
2020/10/24 by Sam Shleifer, Shleifer, Sam, Alexander M. Rush +1 · 8 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- NormFormer: Improved Transformer Pretraining with Extra Normalization
2021/10/18 by Sam Shleifer, Jason Weston, Shleifer, Sam +3 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Speech Recognition and Synthesis #Topic Modeling
- Using Small Proxy Datasets to Accelerate Hyperparameter Search
2019/06/12 by Sam Shleifer, Eric Prokop, Shleifer, Sam +1 · 5 citations
Computer Science · #Advanced Neural Network Applications #Machine Learning and Data Classification #Domain Adaptation and Few-Shot Learning
- Incrementally Improving Graph WaveNet Performance on Traffic Prediction
2019/12/11 by Sam Shleifer, Shleifer, Sam, Clara H. McCreery +3 · 2 citations
Computer Science · Engineering · #Advanced Graph Neural Networks #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Neural Networks and Applications #Signal Processing (eess.SP) #Traffic Prediction and Management Techniques #electronic engineering #information engineering
- Low Resource Text Classification with ULMFit and Backtranslation
2019/03/21 by Shleifer, Sam · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Efficient Language Modeling with Sparse all-MLP
2022/03/14 by Mikel Artetxe, Yu, Ping, Artetxe, Mikel +8 · 1 citation
Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning