Lorenzo Noci

1. Don't be lazy: CompleteP enables compute-efficient deep transformers
   2025/05/02 by Bin Zhang, Dey, Nolan, Zhang, Bin Claire +14 · 1 voice · 20 citations
   Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Parallel Computing and Optimization Techniques
2. Signal Propagation in Transformers: Theoretical Perspectives and the Role of Rank Collapse
   2022/06/07 by Lorenzo Noci, Noci, Lorenzo, Sotiris Anagnostidis +9 · 17 citations
   Computer Science · #Neural Networks and Applications #Domain Adaptation and Few-Shot Learning #Neural Networks and Reservoir Computing
3. Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit
   2023/09/28 by Blake Bordelon, Lorenzo Noci, Bordelon, Blake +7 · 9 citations
   Biochemistry, Genetics and Molecular Biology · Computer Science · Physics and Astronomy · #Artificial Intelligence (cs.AI) #Cell Image Analysis Techniques #Disordered Systems and Neural Networks (cond-mat.dis-nn) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks
4. Achieving a Better Stability-Plasticity Trade-off via Auxiliary Networks in Continual Learning
   2023/03/16 by Sanghwan Kim, Lorenzo Noci, Kim, Sanghwan +5 · 4 citations
   Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG)
5. Dynamic Context Pruning for Efficient and Interpretable Autoregressive Transformers
   2023/05/25 by Sotiris Anagnostidis, Anagnostidis, Sotiris, Dario Pavllo +8 · 4 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Natural Language Processing Techniques #Topic Modeling
6. Super Consistency of Neural Network Landscapes and Learning Rate Transfer
   2024/02/27 by Lorenzo Noci, Alexandru Meterez, Noci, Lorenzo +5 · 4 citations
   Computer Science · #Neural Networks and Applications
7. The Curious Case of Benign Memorization
   2022/10/25 by Sotiris Anagnostidis, Anagnostidis, Sotiris, Gregor Bachmann +5 · 2 citations
   Computer Science · #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Music and Audio Processing #Neural Networks and Applications
8. Understanding and Minimising Outlier Features in Neural Network Training
   2024/05/29 by Bobby He, He, Bobby, Lorenzo Noci +7 · 1 citation
   Computer Science · #Neural Networks and Applications