Dodge, Jesse
- Green AI
2019/07/22 by Roy Schwartz, Schwartz, Roy, Jesse Dodge +5 · 2 voices · 82 citations
Computer Science · Engineering · #Green IT and Sustainability #Mobile Crowdsensing and Crowdsourcing #cs.CL #cs.CV #cs.CY #cs.LG #stat.ME
- BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
2022/11/09 by BigScience Workshop, Workshop, BigScience, Teven Le Scao +784 · 1 voice · 133 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
- Documenting Large Webtext Corpora: A Case Study on the Colossal Clean\n Crawled Corpus
2021/04/18 by Jesse Dodge, Maarten Sap, Dodge, Jesse +13 · 76 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- OLMo: Accelerating the Science of Language Models
2024/02/01 by Dirk Groeneveld, Groeneveld, Dirk, Iz Beltagy +83 · 118 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
2024/01/31 by Luca Soldaini, Soldaini, Luca, Rodney Kinney +69 · 100 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- Evaluating the Social Impact of Generative AI Systems in Systems and Society
2023/06/09 by Irene Solaiman, Zeerak Talat, Solaiman, Irene +59 · 4 voices · 14 citations
#cs.CY #cs.AI
- Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping
2020/02/14 by Jesse Dodge, Dodge, Jesse, Gabriel Ilharco +9 · 32 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- What's In My Big Data?
2023/10/31 by Yanai Elazar, Elazar, Yanai, Akshita Bhagia +23 · 3 voices · 14 citations
Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.CL #cs.LG
- Efficient Methods for Natural Language Processing: A Survey
2022/08/31 by Marcos Treviso, Ji-Ung Lee, Treviso, Marcos +41 · 2 voices · 10 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
- Key-Value Memory Networks for Directly Reading Documents
2016/06/09 by Miller, Alexander, Fisch, Adam, Dodge, Jesse +3 · 16 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Text
2023/04/14 by Wanrong Zhu, Zhu, Wanrong, Jack Hessel +17 · 30 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Show Your Work: Improved Reporting of Experimental Results
2019/09/06 by Jesse Dodge, Dodge, Jesse, Suchin Gururangan +7 · 20 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Machine Learning and Data Classification
- Can Machines Learn Morality? The Delphi Experiment
2021/10/14 by Jiang, Liwei, Hwang, Jena D., Bhagavatula, Chandra +12 · 19 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Measuring the Carbon Intensity of AI in Cloud Instances
2022/06/10 by Jesse Dodge, Taylor Prewitt, Dodge, Jesse +17 · 16 citations
Computer Science · Engineering · Environmental Science · #Environmental Impact and Sustainability #FOS: Computer and information sciences #Green IT and Sustainability #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing
- OLMES: A Standard for Language Model Evaluations
2024/06/12 by Yuling Gu, Gu, Yuling, Oyvind Tafjord +9 · 28 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- Staged Training for Transformer Language Models
2022/03/11 by Sheng Shen, Shen, Sheng, Pete Walsh +9 · 10 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- Paloma: A Benchmark for Evaluating Language Model Fit
2023/12/16 by Ian Magnusson, Akshita Bhagia, Magnusson, Ian +29 · 16 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Position: Machine Learning Conferences Should Establish a "Refutations and Critiques" Track
2025/06/24 by Rylan Schaeffer, Schaeffer, Rylan, Joshua Kazdan +25 · 2 voices · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.CL #cs.CY #cs.LG
- AdapterSoup: Weight Averaging to Improve Generalization of Pretrained Language Models
2023/02/14 by Alexandra Chronopoulou, Chronopoulou, Alexandra, Matthew E. Peters +5 · 10 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Evaluating Prerequisite Qualities for Learning End-to-End Dialog Systems
2015/11/21 by Jesse Dodge, Andreea Gane, Dodge, Jesse +13 · 8 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens
2025/04/09 by Jiacheng Liu, Taylor Blanton, Liu, Jiacheng +61 · 3 voices · 13 citations
Computer Science · Medicine · #Topic Modeling #Natural Language Processing Techniques #Artificial Intelligence in Healthcare and Education
- Holistically Evaluating the Environmental Impact of Creating Language Models
2025/03/03 by Jacob Morrison, Morrison, Jacob, Clara Na +9 · 3 voices · 14 citations
#cs.CY #cs.AI #cs.LG
- Language Models Hallucinate, but May Excel at Fact Verification
2023/10/23 by Jian Guan, Guan, Jian, Jesse Dodge +7 · 8 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Explainable Artificial Intelligence (XAI)
- The Right Tool for the Job: Matching Model and Instance Complexities
2020/04/16 by Schwartz, Roy, Stanovsky, Gabriel, Swayamdipta, Swabha +2 · 4 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Competency Problems: On Finding and Removing Artifacts in Language Data
2021/04/17 by Matt Gardner, William Merrill, Gardner, Matt +11 · 4 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Explainable Artificial Intelligence (XAI)
- Establishing Task Scaling Laws via Compute-Efficient Model Ladders
2024/12/05 by Akshita Bhagia, Jiacheng Liu, Bhagia, Akshita +21 · 11 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences
- AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data Filters
2024/01/12 by Li Lucy, Lucy, Li, Suchin Gururangan +12 · 3 voices · 2 citations
Computer Science · Social Sciences · #Natural Language Processing Techniques #Topic Modeling #Wikis in Education and Collaboration
- DataDecide: How to Predict Best Pretraining Data with Small Experiments
2025/04/15 by Ian Magnusson, Magnusson, Ian, Tai, Nguyen +22 · 14 citations
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Words as Gatekeepers: Measuring Discipline-specific Terms and Meanings in Scholarly Publications
2022/12/19 by Li Lucy, Lucy, Li, Jesse Dodge +5 · 3 citations
Decision Sciences · Physics and Astronomy · Social Sciences · #Complex Network Analysis Techniques #Computation and Language (cs.CL) #Computational and Text Analysis Methods #Digital Libraries (cs.DL) #FOS: Computer and information sciences #scientometrics and bibliometrics research
- The Rise of Open Science: Tracking the Evolution and Perceived Value of Data and Methods Link-Sharing Practices
2023/10/04 by Hancheng Cao, Jesse Dodge, Cao, Hancheng +7 · 2 citations
Decision Sciences · Computer Science · #Scientific Computing and Data Management #Research Data Management Practices #scientometrics and bibliometrics research
- RNN Architecture Learning with Sparse Regularization
2019/09/06 by Jesse Dodge, Roy Schwartz, Dodge, Jesse +5 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling
- Fluid Language Model Benchmarking
2025/09/14 by Valentin Hofmann, David Heineman, Hofmann, Valentin +17 · 3 voices · 7 citations
#cs.CL #cs.AI #cs.LG
- Signal and Noise: A Framework for Reducing Uncertainty in Language Model Evaluation
2025/08/18 by David Heineman, Valentin Hofmann, Heineman, David +13 · 6 citations
Computer Science · #Natural Language Processing Techniques
- Merge to Learn: Efficiently Adding Skills to Language Models with Model Merging
2024/10/16 by Jacob Morrison, Morrison, Jacob, Noah A. Smith +9 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Semantic Web and Ontologies #Topic Modeling
- Reproducibility in NLP: What Have We Learned from the Checklist?
2023/06/16 by Magnusson, Ian, Smith, Noah A., Dodge, Jesse · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- SciArena: An Open Evaluation Platform for Non-Verifiable Scientific Literature-Grounded Tasks
2025/07/01 by Yilun Zhao, Zhao, Yilun, Kaiyan Zhang +35 · 1 voice · 4 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Expert finding and Q&A systems #Topic Modeling #cs.AI #cs.CL