Messmer, Bettina

1. Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks
   2023/05/26 by Atli Kosson, Bettina Messmer, Kosson, Atli +3 · 2 voices · 10 citations
   Physics and Astronomy · #Advanced Thermodynamics and Statistical Mechanics
2. FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
   2025/06/26 by Guilherme Penedo, Penedo, Guilherme, Hynek Kydlíček +17 · 1 voice · 33 citations
   Computer Science · #Computation and Language (cs.CL) #Educational Technology and Assessment #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Online Learning and Analytics
3. Analyzing & Reducing the Need for Learning Rate Warmup in GPT Training
   2024/10/31 by Kosson, Atli, Messmer, Bettina, Jaggi, Martin · 7 citations
   #FOS: Computer and information sciences #Machine Learning (cs.LG)
4. Enhancing Multilingual LLM Pretraining with Model-Based Data Selection
   2025/02/14 by Bettina Messmer, Messmer, Bettina, Vinko Sabolčec +3 · 6 citations
   Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification
5. Towards an empirical understanding of MoE design choices
   2024/02/20 by Dongyang Fan, Bettina Messmer, Fan, Dongyang +3 · 2 citations
   Business, Management and Accounting · Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Innovative Approaches in Technology and Social Development #Machine Learning (cs.LG) #Technology Use by Older Adults #Usability and User Interface Design
6. On-Device Collaborative Language Modeling via a Mixture of Generalists and Specialists
   2024/09/20 by Dongyang Fan, Bettina Messmer, Fan, Dongyang +3 · 2 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Speech and dialogue systems
7. Apertus: Democratizing Open and Compliant LLMs for Global Language Environments
   2025/09/17 by Apertus, Project, Hernández-Cano, Alejandro, Hägele, Alexander +100 · 9 citations
   #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)