Magnusson, Ian

1. Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
   2024/01/31 by Luca Soldaini, Rodney Kinney, Soldaini, Luca +69 · 80 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
2. OLMo: Accelerating the Science of Language Models
   2024/02/01 by Dirk Groeneveld, Iz Beltagy, Groeneveld, Dirk +83 · 76 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques
3. What's In My Big Data?
   2023/10/31 by Yanai Elazar, Akshita Bhagia, Elazar, Yanai +23 · 3 voices · 12 citations
   #cs.CL #cs.LG
4. Paloma: A Benchmark for Evaluating Language Model Fit
   2023/12/16 by Magnusson, Ian, Bhagia, Akshita, Hofmann, Valentin +13 · 11 citations
   #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
5. DataDecide: How to Predict Best Pretraining Data with Small Experiments
   2025/04/15 by Ian Magnusson, Magnusson, Ian, Ben Bogin +22 · 12 citations
   Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
6. Exploring The Landscape of Distributional Robustness for Question Answering Models
   2022/10/22 by Anas Awadalla, Mitchell Wortsman, Awadalla, Anas +11 · 2 citations
   Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #Expert finding and Q&A systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
7. Fluid Language Model Benchmarking
   2025/09/14 by Valentin Hofmann, David Heineman, Hofmann, Valentin +17 · 3 voices · 7 citations
   #cs.CL #cs.AI #cs.LG
8. From Unstructured Text to Causal Knowledge Graphs: A Transformer-Based Approach
   2022/02/23 by Friedman, Scott, Magnusson, Ian, Sarathy, Vasanth +1 · 1 citation
   #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
9. Signal and Noise: A Framework for Reducing Uncertainty in Language Model Evaluation
   2025/08/18 by David Heineman, Valentin Hofmann, Heineman, David +13 · 6 citations
   Computer Science · #Natural Language Processing Techniques