Bhagia, Akshita
- 2 OLMo 2 Furious
2024/12/31 by Team OLMo, OLMo, Team, Pete Walsh +85 · 9 voices · 95 citations
Computer Science · Medicine · #Topic Modeling #Artificial Intelligence in Healthcare and Education #Natural Language Processing Techniques
- Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
2024/01/31 by Luca Soldaini, Soldaini, Luca, Rodney Kinney +69 · 93 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- OLMo: Accelerating the Science of Language Models
2024/02/01 by Dirk Groeneveld, Iz Beltagy, Groeneveld, Dirk +83 · 94 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- OLMoE: Open Mixture-of-Experts Language Models
2024/09/03 by Niklas Muennighoff, Muennighoff, Niklas, Luca Soldaini +45 · 1 voice · 66 citations
Computer Science · #Expert finding and Q&A systems #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- What's In My Big Data?
2023/10/31 by Yanai Elazar, Elazar, Yanai, Akshita Bhagia +23 · 3 voices · 13 citations
Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.CL #cs.LG
- Paloma: A Benchmark for Evaluating Language Model Fit
2023/12/16 by Ian Magnusson, Akshita Bhagia, Magnusson, Ian +29 · 13 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Establishing Task Scaling Laws via Compute-Efficient Model Ladders
2024/12/05 by Bhagia, Akshita, Liu, Jiacheng, Wettig, Alexander +9 · 11 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- HINT: Hypernetwork Instruction Tuning for Efficient Zero- & Few-Shot Generalisation
2022/12/20 by Hamish Ivison, Ivison, Hamish, Akshita Bhagia +7 · 4 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Software Engineering Research
- DataDecide: How to Predict Best Pretraining Data with Small Experiments
2025/04/15 by Ian Magnusson, Magnusson, Ian, Tai, Nguyen +22 · 13 citations
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- FlexOlmo: Open Language Models for Flexible Data Use
2025/07/09 by Shi, Weijia, Bhagia, Akshita, Farhat, Kevin +20 · 6 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Continued Pretraining for Better Zero- and Few-Shot Promptability
2022/10/19 by Wu, Zhaofeng, Logan, Robert L., Walsh, Pete +4 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences