Shayne Longpre

1. The Leaderboard Illusion
   2025/04/29 by Shivalika Singh, Yiyang Nan, Singh, Shivalika +26 · 32 voices · 20 citations
   Medicine · Computer Science · Social Sciences · #Artificial Intelligence in Healthcare and Education #AI in Service Interactions #Ethics and Social Impacts of AI
2. The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text
   2025/06/05 by Nikhil Kandpal, Brian Lester, Kandpal, Nikhil +51 · 20 voices · 8 citations
   Computer Science · Medicine · #Topic Modeling #Hate Speech and Cyberbullying Detection #Artificial Intelligence in Healthcare and Education
3. Scaling Instruction-Finetuned Language Models
   2022/10/20 by Hyung Won Chung, Le Hou, Chung, Hyung Won +62 · 245 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
4. Prometheus: Inducing Fine-grained Evaluation Capability in Language Models
   2023/10/12 by Seungone Kim, Kim, Seungone, Jamin Shin +19 · 91 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
5. The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
   2023/01/31 by Shayne Longpre, Le Hou, Longpre, Shayne +18 · 68 citations
   Computer Science · Engineering · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Machine Learning and Data Classification
6. MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering
   2020/07/30 by Shayne Longpre, Yi Lu, Longpre, Shayne +3 · 23 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
7. A Survey on Data Selection for Language Models
   2024/02/26 by Alon Albalak, Albalak, Alon, Yanai Elazar +25 · 41 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
8. A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity
   2023/05/22 by Shayne Longpre, Gregory Yauney, Longpre, Shayne +18 · 26 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Software Engineering Research
9. Consent in Crisis: The Rapid Decline of the AI Data Commons
   2024/07/20 by Shayne Longpre, Robert Mahari, Longpre, Shayne +104 · 5 voices · 13 citations
   Computer Science · Social Sciences · #Ethics and Social Impacts of AI #Privacy, Security, and Data Protection #Privacy-Preserving Technologies in Data #cs.AI #cs.CL #cs.LG
10. OctoPack: Instruction Tuning Code Large Language Models
    2023/08/14 by Niklas Muennighoff, Qian Liu, Muennighoff, Niklas +17 · 21 citations
    Computer Science · #Software Engineering Research #Parallel Computing and Optimization Techniques #Topic Modeling
11. The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models
    2024/06/09 by Seungone Kim, Juyoung Suk, Kim, Seungone +61 · 21 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
12. The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset
    2023/03/07 by Hugo Laurençon, Lucile Saulnier, Laurençon, Hugo +104 · 14 citations
    Computer Science · Biochemistry, Genetics and Molecular Biology · #Topic Modeling #Natural Language Processing Techniques #Biomedical Text Mining and Ontologies
13. A Safe Harbor for AI Evaluation and Red Teaming
    2024/03/07 by Shayne Longpre, Sayash Kapoor, Longpre, Shayne +43 · 1 voice · 15 citations
    Computer Science · #Explainable Artificial Intelligence (XAI)
14. On the Societal Impact of Open Foundation Models
    2024/02/27 by Sayash Kapoor, Kapoor, Sayash, Rishi Bommasani +47 · 15 citations
    Engineering · #3D Modeling in Geospatial Applications #Artificial Intelligence (cs.AI) #BIM and Construction Integration #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG)
15. International AI Safety Report
    2025/01/29 by Yoshua Bengio, Bengio, Yoshua, Sören Mindermann +180 · 17 citations
    Social Sciences · #Artificial Intelligence (cs.AI) #Computers and Society (cs.CY) #Ethics and Social Impacts of AI #FOS: Computer and information sciences #Machine Learning (cs.LG)
16. The Foundation Model Transparency Index
    2023/10/19 by Rishi Bommasani, Kevin Klyman, Bommasani, Rishi +13 · 1 voice · 8 citations
    Computer Science · #Blockchain Technology Applications and Security #Mobile Crowdsensing and Crowdsourcing #Privacy-Preserving Technologies in Data #cs.AI #cs.LG
17. Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLP
    2021/06/12 by Anthony Chen, Chen, Anthony, Pallavi Gudipati +7 · 2 citations
    Computer Science · #Advanced Graph Neural Networks #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
18. Active Learning Over Multiple Domains in Natural Language Tasks
    2022/02/01 by Shayne Longpre, Longpre, Shayne, Julia Reisler +11 · 1 citation
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Natural Language Processing Techniques #Speech Recognition and Synthesis
19. AI-Powered Autonomous Weapons Risk Geopolitical Instability and Threaten AI Research
    2024/05/03 by Riley Simmons-Edler, Simmons-Edler, Riley, Ryan P. Badman +6 · 1 voice · 1 citation
    Computer Science · Social Sciences · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computers and Society (cs.CY) #Ethics and Social Impacts of AI #European and Russian Geopolitical Military Strategies #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO) #cs.AI #cs.CY #cs.LG #cs.RO
20. To Err is AI : A Case Study Informing LLM Flaw Reporting Practices
    2024/10/15 by Sean McGregor, Allyson Ettinger, McGregor, Sean +24 · 2 voices · 1 citation
    Computer Science · #cs.CY #cs.LG #cs.SE
21. The 2025 Foundation Model Transparency Index
    2025/12/11 by Alexander Wan, Wan, Alexander, Kevin Klyman +13 · 1 voice · 3 citations
    Business, Management and Accounting · Computer Science · Social Sciences · #Big Data and Business Intelligence #Data Analysis with R #Ethics and Social Impacts of AI #cs.AI #cs.CY #cs.LG