Ian Magnusson
- Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
2024/01/31 by Luca Soldaini, Rodney Kinney, Soldaini, Luca +69 · 80 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- OLMo: Accelerating the Science of Language Models
2024/02/01 by Dirk Groeneveld, Iz Beltagy, Groeneveld, Dirk +83 · 76 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- What's In My Big Data?
2023/10/31 by Yanai Elazar, Elazar, Yanai, Akshita Bhagia +23 · 3 voices · 12 citations
#cs.CL #cs.LG
- DataDecide: How to Predict Best Pretraining Data with Small Experiments
2025/04/15 by Ian Magnusson, Magnusson, Ian, Tai, Nguyen +22 · 12 citations
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Exploring The Landscape of Distributional Robustness for Question Answering Models
2022/10/22 by Anas Awadalla, Mitchell Wortsman, Awadalla, Anas +11 · 2 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #Expert finding and Q&A systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
- Fluid Language Model Benchmarking
2025/09/14 by Valentin Hofmann, Hofmann, Valentin, David Heineman +17 · 3 voices · 7 citations
#cs.CL #cs.AI #cs.LG
- Scalable Data Ablation Approximations for Language Models through Modular Training and Merging
2024/01/01 by Clara Na, Ian Magnusson, Ananya Harsh Jha +4 · 1 voice · 1 citation
Computer Science · #Natural Language Processing Techniques #Topic Modeling
- Signal and Noise: A Framework for Reducing Uncertainty in Language Model Evaluation
2025/08/18 by David Heineman, Heineman, David, Valentin Hofmann +13 · 6 citations
Computer Science · #Natural Language Processing Techniques