vix.ing · top · new · best · stats · spec

Geoffrey E. Hinton

  1. Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
    Sparsely-Gated MoE layers increase model capacity by over 1000x with minimal compute loss, improving language modeling and translation.
    2017/01/23 by Noam Shazeer, Shazeer, Noam, Azalia Mirhoseini +13 · 11 voices · 655 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling #cs.CL #cs.LG #cs.NE #stat.ML
  2. Distilling the Knowledge in a Neural Network
    2015/03/09 by Geoffrey Hinton, Geoffrey E. Hinton, Oriol Vinyals +5 · 5 voices · 1084 citations
    Computer Science · #Neural Networks and Applications #Time Series Analysis and Forecasting #Topic Modeling #cs.LG #cs.NE #stat.ML
  3. ImageNet classification with deep convolutional neural networks
    2017/05/24 by Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · 2649 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Advanced Image Processing Techniques
  4. A Simple Framework for Contrastive Learning of Visual Representations
    2020/02/13 by Ting Chen, Chen, Ting, Simon Kornblith +5 · 1139 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques #Multimodal Machine Learning Applications
  5. How to represent part-whole hierarchies in a neural network
    2021/02/25 by Geoffrey Hinton, Geoffrey E. Hinton, Hinton, Geoffrey · 4 voices · 4 citations
    Computer Science · #Neural Networks and Applications
  6. Layer Normalization
    2016/07/21 by Jimmy Ba, Jimmy Lei Ba, Ba, Jimmy Lei +5 · 1 voice · 411 citations
    Computer Science · Materials Science · #Machine Learning and ELM #Machine Learning in Materials Science #Neural Networks and Applications #cs.LG #stat.ML
  7. Adaptive Mixtures of Local Experts
    1991/02/01 by Robert A. Jacobs, Michael I. Jordan, Steven J. Nowlan +1 · 237 citations
    Computer Science · #Music and Audio Processing #Neural Networks and Applications #Speech and Audio Processing
  8. Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups
    2012/10/19 by Geoffrey E. Hinton, Geoffrey Hinton, Li Deng +12 · 183 citations
    Computer Science · #Speech Recognition and Synthesis #Music and Audio Processing #Speech and Audio Processing
  9. Training Products of Experts by Minimizing Contrastive Divergence
    2002/08/01 by Geoffrey E. Hinton · 160 citations
    Computer Science · Engineering · #Bayesian Modeling and Causal Inference #Neural Networks and Applications #Remote-Sensing Image Classification
  10. A Fast Learning Algorithm for Deep Belief Nets
    2006/05/29 by Geoffrey E. Hinton, Simon Osindero, Yee-Whye Teh +1 · 133 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Generative Adversarial Networks and Image Synthesis #Neural Networks and Applications
  11. Improving neural networks by preventing co-adaptation of feature detectors
    2012/07/03 by Geoffrey E. Hinton, Hinton, Geoffrey E., Nitish Srivastava +7 · 145 citations
    Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE)
  12. Distilling a Neural Network Into a Soft Decision Tree
    2017/11/27 by Nicholas Frosst, Geoffrey Hinton, Frosst, Nicholas +2 · 1 voice · 31 citations
    Computer Science · #cs.LG #cs.AI #stat.ML
  13. Big Self-Supervised Models are Strong Semi-Supervised Learners
    2020/06/17 by Ting Chen, Chen, Ting, Simon Kornblith +7 · 78 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Advanced Neural Network Applications
  14. Dynamic Routing Between Capsules
    2017/10/26 by Sara Sabour, Sabour, Sara, Nicholas Frosst +3 · 36 citations
    Computer Science · #Advanced Graph Neural Networks #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Topic Modeling
  15. Speech Recognition with Deep Recurrent Neural Networks
    2013/03/22 by Alex Graves, Abdelrahman Mohamed, Graves, Alex +3 · 27 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Music and Audio Processing #Natural Language Processing Techniques #Neural and Evolutionary Computing (cs.NE) #Speech Recognition and Synthesis
  16. Regularizing Neural Networks by Penalizing Confident Output Distributions
    2017/01/23 by Gabriel Pereyra, Pereyra, Gabriel, George Tucker +7 · 29 citations
    Computer Science · #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE)
  17. Neural Additive Models: Interpretable Machine Learning with Neural Nets
    2020/04/29 by Rishabh Agarwal, Agarwal, Rishabh, Nicholas Frosst +9 · 36 citations
    Computer Science · #Explainable Artificial Intelligence (XAI) #Adversarial Robustness in Machine Learning #Machine Learning and Data Classification
  18. Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioning
    2022/08/08 by Ting Chen, Chen, Ting, Ruixiang Zhang +3 · 40 citations
    Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques
  19. The Forward-Forward Algorithm: Some Preliminary Investigations
    2022/12/27 by Geoffrey E. Hinton, Hinton, Geoffrey · 39 citations
    Computer Science · #Neural Networks and Applications #Neural Networks and Reservoir Computing #Advanced Image Processing Techniques
  20. Backpropagation and the brain
    2020/04/17 by Timothy Lillicrap, Timothy P. Lillicrap, Adam Santoro +4 · 31 citations
    Computer Science · Engineering · Neuroscience · #Advanced Memory and Neural Computing #Neural Networks and Applications #Neural dynamics and brain function
  21. Lookahead Optimizer: k steps forward, 1 step back
    2019/07/19 by Michael R. Zhang, Zhang, Michael R., James Lucas +5 · 20 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE) #Stochastic Gradient Optimization Techniques
  22. Using Fast Weights to Attend to the Recent Past
    2016/10/20 by Jimmy Ba, Geoffrey E. Hinton, Ba, Jimmy +7 · 17 citations
    Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE)
  23. Large scale distributed neural network training through online distillation
    2018/04/09 by Rohan Anil, Gabriel Pereyra, Anil, Rohan +9 · 18 citations
    Computer Science · #Advanced Neural Network Applications #Machine Learning and Data Classification #Adversarial Robustness in Machine Learning
  24. Assessing the Scalability of Biologically-Motivated Deep Learning\n Algorithms and Architectures
    2018/07/12 by Sergey Bartunov, Bartunov, Sergey, Adam Santoro +9 · 18 citations
    Engineering · Computer Science · #Advanced Memory and Neural Computing #Neural Networks and Reservoir Computing #Ferroelectric and Negative Capacitance Devices
  25. CvxNet: Learnable Convex Decomposition
    2019/09/12 by Boyang Deng, Kyle Genova, Deng, Boyang +9 · 7 citations
    Computer Science · Engineering · #3D Shape Modeling and Analysis #Advanced Vision and Imaging #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Machine Learning (cs.LG)
  26. Scaling Forward Gradient With Local Losses
    2022/10/07 by Mengye Ren, Simon Kornblith, Ren, Mengye +5 · 9 citations
    Computer Science · Engineering · #Domain Adaptation and Few-Shot Learning #Sparse and Compressive Sensing Techniques #Advanced Neural Network Applications
  27. A Unified Sequence Interface for Vision Tasks
    2022/06/15 by Ting Chen, Saurabh Saxena, Chen, Ting +9 · 7 citations
    Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Advanced Neural Network Applications
  28. International AI Safety Report
    2025/01/29 by Yoshua Bengio, Sören Mindermann, Bengio, Yoshua +180 · 17 citations
    Social Sciences · #Artificial Intelligence (cs.AI) #Computers and Society (cs.CY) #Ethics and Social Impacts of AI #FOS: Computer and information sciences #Machine Learning (cs.LG)
  29. Learning sets of filters using back-propagation
    1987/03/01 by David C. Plaut, Geoffrey E. Hinton · 2 citations
    Computer Science · #Blind Source Separation Techniques #Music and Audio Processing #Neural Networks and Applications
  30. Gaussian-Bernoulli RBMs Without Tears
    2022/10/19 by Renjie Liao, Liao, Renjie, Simon Kornblith +7 · 5 citations
    Computer Science · #Generative Adversarial Networks and Image Synthesis #Domain Adaptation and Few-Shot Learning #Music and Audio Processing
  31. NASA: Neural Articulated Shape Approximation
    2019/12/06 by Boyang Deng, Deng, Boyang, JP Lewis +11 · 4 citations
    Computer Science · Earth and Planetary Sciences · Engineering · #3D Shape Modeling and Analysis #3D Surveying and Cultural Heritage #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Human Pose and Action Recognition #Machine Learning (cs.LG)
  32. Conditional Restricted Boltzmann Machines for Structured Output\n Prediction
    2012/02/14 by Volodymyr Mnih, Hugo Larochelle, Mnih, Volodymyr +3 · 2 citations
    Computer Science · Physics and Astronomy · #Generative Adversarial Networks and Image Synthesis #Music and Audio Processing #Model Reduction and Neural Networks
  33. A learning algorithm for boltzmann machines
    1985/03/01 by David H. Ackley, Geoffrey E. Hinton, Terrence J. Sejnowski · 1 voice · 1 citation
    Computer Science · Materials Science · #Machine Learning and Algorithms #Machine Learning in Materials Science #Neural Networks and Applications
  34. Modeling Documents with Deep Boltzmann Machines
    2013/09/26 by Nitish Srivastava, Srivastava, Nitish, Ruslan Salakhutdinov +3 · 1 citation
    Computer Science · #Generative Adversarial Networks and Image Synthesis #Topic Modeling #Music and Audio Processing
  35. Cerberus: A Multi-headed Derenderer
    2019/05/28 by Boyang Deng, Simon Kornblith, Deng, Boyang +4 · 1 voice · 1 citation
    Computer Science · Earth and Planetary Sciences · #3D Surveying and Cultural Heritage #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Image Processing and 3D Reconstruction #Machine Learning (cs.LG) #cs.AI #cs.CV #cs.LG
  36. Grammar as a Foreign Language
    2014/12/23 by Oriol Vinyals, Łukasz Kaiser, Vinyals, Oriol +9 · 2 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  37. Stacked Capsule Autoencoders
    2019/06/17 by Adam R. Kosiorek, Sara Sabour, Kosiorek, Adam R. +5 · 1 voice
    Computer Science · Mathematics · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Human Pose and Action Recognition #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE) #cs.CV #cs.LG #cs.NE #stat.ML
  38. International AI Safety Report 2025: First Key Update: Capabilities and Risk Implications
    2025/10/15 by Yoshua Bengio, Bengio, Yoshua, Stephen Clare +134 · 1 citation
    Social Sciences · #Computers and Society (cs.CY) #Ethics and Social Impacts of AI #FOS: Computer and information sciences