Benjamin Thérien

1. Simple and Scalable Strategies to Continually Pre-train Large Language Models
   2024/03/13 by Adam Ibrahim, Ibrahim, Adam, Benjamin Therien +14 · 3 voices · 23 citations
   Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
2. Overcoming the Communication-Performance Tradeoff in LLM Pretraining
   2025/08/21 by Amir Sarfi, Sarfi, Amir, Benjamin Therien +6 · 4 voices · 4 citations
   Computer Science · #Advanced Neural Network Applications #Speech Recognition and Synthesis #Topic Modeling #cs.LG
3. MuLoCo: Muon is a practical inner optimizer for DiLoCo
   2025/05/29 by Benjamin Therien, Benjamin Thérien, Xiaolong Huang +8 · 1 voice · 9 citations
   Computer Science · Materials Science · #Big Data and Digital Economy #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Materials Science #Topic Modeling #cs.LG
4. Covenant-72B: Pre-Training a 72B LLM with Trustless Peers Over-the-Internet
   2026/03/09 by Joel Lidin, Amir Sarfi, Erfan Miahi +6 · 2 voices · 1 citation
   #cs.DC #cs.LG