Pagliardini, Matteo
- DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging
2024/02/04 by Matteo Pagliardini, Amirkeivan Mohtashami, Pagliardini, Matteo +6 · 1 voice · 13 citations
Computer Science · #Neural Networks and Applications
- MEDITRON-70B: Scaling Medical Pretraining for Large Language Models
2023/11/27 by Zeming Chen, A. Cano, Chen, Zeming +37 · 44 citations
Computer Science · Medicine · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare #Topic Modeling
- DoGE: Domain Reweighting with Generalization Estimation
2023/10/23 by Simin Fan, Fan, Simin, Matteo Pagliardini +3 · 14 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- CoTFormer: A Chain-of-Thought Driven Architecture with Budget-Adaptive Computation Cost at Inference
2023/10/16 by Mohtashami, Amirkeivan, Pagliardini, Matteo, Jaggi, Martin · 11 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Agree to Disagree: Diversity through Disagreement for Better Transferability
2022/02/09 by Pagliardini, Matteo, Jaggi, Martin, Fleuret, François +1 · 5 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- The AdEMAMix Optimizer: Better, Faster, Older
2024/09/05 by Matteo Pagliardini, Pierre Ablin, Pagliardini, Matteo +3 · 10 citations
Engineering · Medicine · #FOS: Computer and information sciences #Fault Detection and Control Systems #Hemodynamic Monitoring and Therapy #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Apertus: Democratizing Open and Compliant LLMs for Global Language Environments
2025/09/17 by Project Apertus, Alejandro Hernández-Cano, Apertus, Project +203 · 4 voices · 9 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.CL #cs.LG
- The Peril of Popular Deep Learning Uncertainty Estimation Methods
2021/12/09 by Liu, Yehao, Pagliardini, Matteo, Chavdarova, Tatjana +1 · 3 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Benchmarking Optimizers for Large Language Model Pretraining
2025/09/01 by A L Semenov, Andrei Semenov, Semenov, Andrei +4 · 2 voices · 15 citations
Computer Science · Social Sciences · #Computational and Text Analysis Methods #Machine Learning and Data Classification #Topic Modeling #cs.LG
- Thinking Slow, Fast: Scaling Inference Compute with Distilled Reasoners
2025/02/27 by Paliotta, Daniele, Wang, Junxiong, Pagliardini, Matteo +6 · 6 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- CWM: An Open-Weights LLM for Research on Code Generation with World Models
2025/09/30 by FAIR CodeGen team, Copet, Jade, Carbonneaux, Quentin +48 · 13 citations
#68T07 #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #I.2.7 #Machine Learning (cs.LG) #Software Engineering (cs.SE)
- Leveraging the true depth of LLMs
2025/02/05 by Ramón Calvo González, González, Ramón Calvo, Daniele Paliotta +7 · 2 voices · 1 citation
#cs.LG #cs.CL