Federico Danieli
- Theory, Analysis, and Best Practices for Sigmoid Self-Attention
2024/09/06 by Jason Ramapuram, Federico Danieli, Ramapuram, Jason +20 · 1 voice · 13 citations
Psychology · #Identity, Memory, and Therapy
- DeepPCR: Parallelizing Sequential Operations in Neural Networks
2023/09/28 by Federico Danieli, Danieli, Federico, Miguel Sarabia +7 · 4 citations
Computer Science · Physics and Astronomy · Materials Science · #Stochastic Gradient Optimization Techniques #Model Reduction and Neural Networks #Machine Learning in Materials Science
- ParaRNN: Unlocking Parallel Training of Nonlinear RNNs for Large Language Models
2025/10/24 by Federico Danieli, Danieli, Federico, Pau Rodríguez +7 · 2 citations
Computer Science · Materials Science · Physics and Astronomy · #68T07 #68W10 #FOS: Computer and information sciences #I.2.7 #Machine Learning (cs.LG) #Machine Learning in Materials Science #Model Reduction and Neural Networks #Topic Modeling
- Attention to Mamba: A Recipe for Cross-Architecture Distillation
2026/04/01 by Abhinav Moudgil, Ningyuan Huang, Eeshan Gunesh Dhekane +3 · 1 voice · 1 citation
#cs.CL #cs.LG