Geoffrey Hinton
- Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Sparsely-Gated MoE layers increase model capacity by over 1000x with minimal compute loss, improving language modeling and translation.
2017/01/23 by Noam Shazeer, Shazeer, Noam, Azalia Mirhoseini +13 · 11 voices · 696 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling #cs.CL #cs.LG #cs.NE #stat.ML
- Distilling the Knowledge in a Neural Network
2015/03/09 by Geoffrey Hinton, Geoffrey E. Hinton, Oriol Vinyals +5 · 5 voices · 1411 citations
Computer Science · #Neural Networks and Applications #Time Series Analysis and Forecasting #Topic Modeling #cs.LG #cs.NE #stat.ML
- How to represent part-whole hierarchies in a neural network
2021/02/25 by Geoffrey Hinton, Geoffrey E. Hinton, Hinton, Geoffrey · 4 voices · 4 citations
Computer Science · #Neural Networks and Applications
- Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups
2012/10/19 by Geoffrey Hinton, Geoffrey E. Hinton, Li Deng +12 · 274 citations
Computer Science · #Speech Recognition and Synthesis #Music and Audio Processing #Speech and Audio Processing
- Distilling a Neural Network Into a Soft Decision Tree
2017/11/27 by Nicholas Frosst, Geoffrey Hinton, Geoffrey E. Hinton +2 · 1 voice · 48 citations
Computer Science · #cs.LG #cs.AI #stat.ML
- Backpropagation and the brain
2020/04/17 by Timothy Lillicrap, Timothy P. Lillicrap, Adam Santoro +4 · 35 citations
Computer Science · Engineering · Neuroscience · #Advanced Memory and Neural Computing #Neural Networks and Applications #Neural dynamics and brain function
- Cerberus: A Multi-headed Derenderer
2019/05/28 by Boyang Deng, Deng, Boyang, Simon Kornblith +4 · 1 voice · 1 citation
Computer Science · Earth and Planetary Sciences · #3D Surveying and Cultural Heritage #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Image Processing and 3D Reconstruction #Machine Learning (cs.LG) #cs.AI #cs.CV #cs.LG