Paliotta, Daniele
- The Mamba in the Llama: Distilling and Accelerating Hybrid Models
2024/08/27 by Junxiong Wang, Wang, Junxiong, Daniele Paliotta +7 · 1 voice · 34 citations
Agricultural and Biological Sciences · Computer Science · #Agriculture and Rural Development Research #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.LG
- M1: Towards Scalable Test-Time Compute with Mamba Reasoning Models
2025/04/14 by Junxiong Wang, Weizhong Li, Wen-Ding Li +11 · 3 voices · 12 citations
Computer Science · #Formal Methods in Verification #Logic, programming, and type systems #Logic, Reasoning, and Knowledge
- Thinking Slow, Fast: Scaling Inference Compute with Distilled Reasoners
2025/02/27 by Paliotta, Daniele, Wang, Junxiong, Pagliardini, Matteo +6 · 8 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Understanding and Minimising Outlier Features in Neural Network Training
2024/05/29 by Bobby He, Lorenzo Noci, He, Bobby +7 · 4 citations
Computer Science · #Neural Networks and Applications
- Faster Causal Attention Over Large Sequences Through Sparse Flash Attention
2023/06/01 by Matteo Pagliardini, Pagliardini, Matteo, Daniele Paliotta +5 · 3 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Domain Adaptation and Few-Shot Learning
- Leveraging the true depth of LLMs
2025/02/05 by Ramón Calvo González, Daniele Paliotta, González, Ramón Calvo +7 · 2 voices · 2 citations
#cs.LG #cs.CL