Carlo Luschi
- Revisiting Small Batch Training for Deep Neural Networks
2018/04/20 by Dominic Masters, Carlo Luschi, Masters, Dominic +1 · 4 voices · 14 citations
Computer Science · Mathematics · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Stochastic Gradient Optimization Techniques #cs.CV #cs.LG #stat.ML
- 8-bit Numerical Formats for Deep Neural Networks
2022/06/06 by Badreddine Noune, Noune, Badreddine, Philip H. Jones +8 · 2 voices · 3 citations
Computer Science · Physics and Astronomy · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural Networks and Applications #Numerical Methods and Algorithms #cs.LG
- SparQ Attention: Bandwidth-Efficient LLM Inference
2023/12/08 by Luka Ribar, Ribar, Luka, Ivan Chelombiev +9 · 21 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling
- Training and inference of large language models using 8-bit floating point
2023/09/29 by Sergio P. Perez, Perez, Sergio P., Yan Zhang +17 · 2 voices · 2 citations
Computer Science · #B.2.4 #Computation and Language (cs.CL) #Computational Physics and Python Applications #Emerging Technologies (cs.ET) #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #I.2.7 #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques #Performance (cs.PF) #Topic Modeling #cs.AR #cs.CL #cs.ET #cs.LG #cs.PF
- Improving Neural Network Training in Low Dimensional Random Bases
2020/11/09 by Frithjof Gressmann, Zach Eaton-Rosen, Gressmann, Frithjof +3 · 1 citation
Computer Science · #Advanced Neural Network Applications #Stochastic Gradient Optimization Techniques #Machine Learning and ELM
- Making EfficientNet More Efficient: Exploring Batch-Independent Normalization, Group Convolutions and Reduced Resolution Training
2021/06/07 by Dominic Masters, Masters, Dominic, Antoine Labatie +5 · 3 citations
Computer Science · #Advanced Neural Network Applications #Anomaly Detection Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)