Erich Elsen

1. Training Compute-Optimal Large Language Models
   2022/03/29 by Jordan Hoffmann, Sebastian Borgeaud, Hoffmann, Jordan +41 · 13 voices · 432 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Machine Learning and Algorithms
2. Deep Speech: Scaling up end-to-end speech recognition
   2014/12/17 by Awni Hannun, Hannun, Awni, Carl Case +19 · 4 voices · 17 citations
   #cs.CL #cs.LG #cs.NE
3. Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
   2015/12/08 by Dario Amodei, Rishita Anubhai, Amodei, Dario +66 · 1 voice · 49 citations
   Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.CL
4. Mixed Precision Training
   2017/10/10 by Paulius Micikevicius, Micikevicius, Paulius, Sharan Narang +20 · 1 voice · 174 citations
   Physics and Astronomy · Computer Science · #Model Reduction and Neural Networks #Numerical Methods and Algorithms #Advanced Neural Network Applications
5. Improving language models by retrieving from trillions of tokens
   2021/12/08 by Sebastian Borgeaud, Borgeaud, Sebastian, Arthur Mensch +54 · 6 voices · 148 citations
   Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.CL #cs.LG
6. The State of Sparsity in Deep Neural Networks
   2019/02/25 by Trevor Gale, Gale, Trevor, Erich Elsen +3 · 1 voice · 56 citations
   Computer Science · #Advanced Neural Network Applications #Anomaly Detection Techniques and Applications #Machine Learning and Data Classification #cs.LG #stat.ML
7. Scaling Language Models: Methods, Analysis & Insights from Training Gopher
   2021/12/08 by Jack W. Rae, Rae, Jack W., Sebastian Borgeaud +157 · 73 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
8. Sparse GPU Kernels for Deep Learning
   2020/06/18 by Trevor Gale, Matei Zaharia, Gale, Trevor +5 · 1 voice · 13 citations
   #cs.LG #cs.DC #stat.ML
9. Enabling Factorized Piano Music Modeling and Generation with the MAESTRO\n Dataset
   2018/10/29 by Curtis Hawthorne, Hawthorne, Curtis, Andriy Stasyuk +15 · 35 citations
   Computer Science · Neuroscience · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Music Technology and Sound Studies #Music and Audio Processing #Neuroscience and Music Perception #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
10. Onsets and Frames: Dual-Objective Piano Transcription
    2017/10/30 by Curtis Hawthorne, Hawthorne, Curtis, Erich Elsen +15 · 15 citations
    Computer Science · Neuroscience · #Music and Audio Processing #Music Technology and Sound Studies #Neuroscience and Music Perception
11. Efficient Neural Audio Synthesis
    2018/02/23 by Nal Kalchbrenner, Erich Elsen, Kalchbrenner, Nal +17 · 18 citations
    Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
12. Exploring Sparsity in Recurrent Neural Networks
    2017/04/17 by Sharan Narang, Narang, Sharan, Erich Elsen +5 · 17 citations
    Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Neural Networks and Applications
13. Fast Sparse ConvNets
    2019/11/21 by Erich Elsen, Marat Dukhan, Elsen, Erich +5 · 1 voice · 2 citations
    #cs.CV
14. Parallel WaveNet: Fast High-Fidelity Speech Synthesis
    2017/11/28 by Aäron van den Oord, Oord, Aaron van den, Yazhe Li +40 · 7 citations
    Computer Science · #Speech Recognition and Synthesis #Speech and Audio Processing #Music and Audio Processing
15. The State of Sparse Training in Deep Reinforcement Learning
    2022/06/17 by Laura Graesser, Utku Evci, Graesser, Laura +5 · 11 citations
    Computer Science · #Reinforcement Learning in Robotics #Domain Adaptation and Few-Shot Learning #Machine Learning and ELM
16. High Fidelity Speech Synthesis with Adversarial Networks
    2019/09/25 by Mikołaj Bińkowski, Bińkowski, Mikołaj, Jeff Donahue +13 · 7 citations
    Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
17. AlgebraNets
    2020/06/12 by Jordan Hoffmann, Hoffmann, Jordan, Simon Schmitt +7 · 1 voice · 1 citation
    Computer Science · #cs.LG #stat.ML
18. DSD: Dense-Sparse-Dense Training for Deep Neural Networks
    2016/07/15 by Song Han, Jeff Pool, Han, Song +21 · 5 citations
    Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning and Algorithms