Luca Soldaini
- The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text
2025/06/05 by Nikhil Kandpal, Kandpal, Nikhil, Brian Lester +51 · 20 voices · 8 citations
Computer Science · Medicine · #Topic Modeling #Hate Speech and Cyberbullying Detection #Artificial Intelligence in Healthcare and Education
- 2 OLMo 2 Furious
2024/12/31 by Team OLMo, P N Walsh, Pete Walsh +85 · 9 voices · 86 citations
Computer Science · Medicine · #Topic Modeling #Artificial Intelligence in Healthcare and Education #Natural Language Processing Techniques
- Tulu 3: Pushing Frontiers in Open Language Model Post-Training
2024/11/22 by Nathan Lambert, Lambert, Nathan, Jacob Morrison +44 · 9 voices · 234 citations
Computer Science · #Natural Language Processing Techniques
- DataComp-LM: In search of the next generation of training sets for language models
2024/06/17 by Jeffrey Li, Alex Fang, Li, Jeffrey +121 · 2 voices · 80 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Models
2024/09/25 by Matt Deitke, Deitke, Matt, Christopher Clark +100 · 4 voices · 150 citations
Computer Science · #Semantic Web and Ontologies #Speech and dialogue systems
- Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
2024/01/31 by Luca Soldaini, Rodney Kinney, Soldaini, Luca +69 · 80 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- OLMo: Accelerating the Science of Language Models
2024/02/01 by Dirk Groeneveld, Groeneveld, Dirk, Iz Beltagy +83 · 76 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- OLMoE: Open Mixture-of-Experts Language Models
2024/09/03 by Niklas Muennighoff, Muennighoff, Niklas, Luca Soldaini +45 · 1 voice · 60 citations
Computer Science · #Expert finding and Q&A systems #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- What's In My Big Data?
2023/10/31 by Yanai Elazar, Akshita Bhagia, Elazar, Yanai +23 · 3 voices · 12 citations
#cs.CL #cs.LG
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
2024/03/22 by Orion Weller, Benjamin Chang, Weller, Orion +13 · 15 citations
Computer Science · #Intelligent Tutoring Systems and Adaptive Learning #Online Learning and Analytics
- Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
2025/02/14 by Alexander Wettig, Kyle Lo, Wettig, Alexander +9 · 22 citations
Computer Science · Decision Sciences · #Computation and Language (cs.CL) #Data Quality and Management #FOS: Computer and information sciences #Research Data Management Practices #Scientific Computing and Data Management
- The Surveillance AI Pipeline
2023/09/26 by Pratyusha Ria Kalluri, Kalluri, Pratyusha Ria, William Agnew +9 · 8 voices · 1 citation
#cs.CV #cs.CY
- OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMs
2024/11/21 by Akari Asai, Asai, Akari, Jacqueline He +50 · 2 voices · 13 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Natural Language Processing Techniques #Semantic Web and Ontologies #cs.AI #cs.CL #cs.DL #cs.IR #cs.LG
- OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens
2025/04/09 by Jiacheng Liu, Taylor Blanton, Liu, Jiacheng +61 · 3 voices · 8 citations
Computer Science · Medicine · #Topic Modeling #Natural Language Processing Techniques #Artificial Intelligence in Healthcare and Education
- AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data Filters
2024/01/12 by Li Lucy, Suchin Gururangan, Lucy, Li +12 · 3 voices · 2 citations
Computer Science · Social Sciences · #Natural Language Processing Techniques #Topic Modeling #Wikis in Education and Collaboration
- DataDecide: How to Predict Best Pretraining Data with Small Experiments
2025/04/15 by Ian Magnusson, Magnusson, Ian, Tai, Nguyen +22 · 12 citations
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature
2024/06/10 by David Wadden, Wadden, David, Kejian Shi +24 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- DrawEduMath: Evaluating Vision Language Models with Expert-Annotated Students' Hand-Drawn Math Images
2025/01/24 by Sami Baral, Li Lucy, Baral, Sami +11 · 4 citations
Engineering · Psychology · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Second Language Acquisition and Learning #Spatial Cognition and Navigation #Visual and Cognitive Learning Processes
- KIWI: A Dataset of Knowledge-Intensive Writing Instructions for Answering Research Questions
2024/03/06 by Fangyuan Xu, Xu, Fangyuan, Kyle Lo +9 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- The Semantic Reader Project: Augmenting Scholarly Documents through AI-Powered Interactive Reading Interfaces
2023/03/25 by Kyle Lo, Joseph Chee Chang, Lo, Kyle +111 · 1 voice
Computer Science · #AI in Service Interactions #Artificial Intelligence (cs.AI) #Cloud Computing and Resource Management #Computation and Language (cs.CL) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Recommender Systems and Techniques #cs.AI #cs.CL #cs.HC
- Self-Directed Synthetic Dialogues and Revisions Technical Report
2024/07/25 by Nathan Lambert, Hailey Schoelkopf, Lambert, Nathan +9 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multi-Agent Systems and Negotiation #Speech and dialogue systems
- Overview of the TREC 2022 NeuCLIR Track
2023/04/24 by Dawn Lawrie, Sean MacAvaney, Lawrie, Dawn +11 · 1 citation
Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Semantic Web and Ontologies #Topic Modeling
- olmOCR 2: Unit Test Rewards for Document OCR
2025/10/22 by Jake Poznanski, Luca Soldaini, Poznanski, Jake +3 · 3 citations
Computer Science · #Handwritten Text Recognition Techniques #Mathematics, Computing, and Information Processing #Natural Language Processing Techniques
- mFollowIR: a Multilingual Benchmark for Instruction Following in Retrieval
2025/01/31 by Orion Weller, Weller, Orion, Benjamin Chang +17 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Natural Language Processing Techniques