Ilya Sutskever
- Language Models are Few-Shot Learners
2020/05/28 by Tom B. Brown, T. B. Brown, Brown, Tom B. +61 · 16 voices · 5023 citations
Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.CL
- Evaluating Large Language Models Trained on Code
2021/07/07 by Mark Chen, Jerry Tworek, Chen, Mark +122 · 9 voices · 1599 citations
Computer Science · #Parallel Computing and Optimization Techniques #Software Engineering Research #Topic Modeling #cs.LG
- Let's Verify Step by Step
2023/05/31 by Hunter Lightman, Lightman, Hunter, Vineet Kosaraju +17 · 9 voices · 906 citations
Computer Science · #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling #cs.AI #cs.CL #cs.LG
- Intriguing properties of neural networks
2013/12/21 by Christian Szegedy, Wojciech Zaremba, Szegedy, Christian +11 · 3 voices · 554 citations
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Neural Networks and Applications #cs.CV #cs.LG #cs.NE
- Learning Transferable Visual Models From Natural Language Supervision
2021/02/26 by Alec Radford, Radford, Alec, Jong Wook Kim +21 · 7 voices · 6261 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Human Pose and Action Recognition #Multimodal Machine Learning Applications #cs.CV #cs.LG
- GPT-4 Technical Report
2023/03/15 by OpenAI, Josh Achiam, Achiam, Josh +556 · 6 voices · 3408 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.AI #cs.CL
- Generative Language Modeling for Automated Theorem Proving
2020/09/07 by Stanislas Polu, Ilya Sutskever, Polu, Stanislas +1 · 4 voices · 74 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Mathematics, Computing, and Information Processing
- ImageNet classification with deep convolutional neural networks
2017/05/24 by Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · 3912 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Advanced Image Processing Techniques
- Learning to Execute
2014/10/17 by Wojciech Zaremba, Ilya Sutskever, Zaremba, Wojciech +1 · 2 voices · 60 citations
Computer Science · #Machine Learning and Algorithms #Neural Networks and Applications #Topic Modeling #cs.AI #cs.LG #cs.NE
- GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
2021/12/20 by Alex Nichol, Prafulla Dhariwal, Nichol, Alex +13 · 1 voice · 406 citations
Computer Science · #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications #Image Retrieval and Classification Techniques
- Zero-Shot Text-to-Image Generation
2021/02/24 by Aditya Ramesh, Mikhail Pavlov, Ramesh, Aditya +13 · 2 voices · 508 citations
Computer Science · #Advanced Neural Network Applications #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications #cs.CV #cs.LG
- RL2: Fast Reinforcement Learning via Slow Reinforcement Learning
2016/11/09 by Yan Duan, Duan, Yan, John Schulman +9 · 1 voice · 136 citations
Computer Science · #Reinforcement Learning in Robotics #Optimization and Search Problems #Advanced Neural Network Applications
- Sequence to Sequence Learning with Neural Networks
2014/09/10 by Ilya Sutskever, Sutskever, Ilya, Oriol Vinyals +3 · 1031 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Multimodal Machine Learning Applications
- Robust Speech Recognition via Large-Scale Weak Supervision
2022/12/06 by Alec Radford, Jong Wook Kim, Radford, Alec +9 · 1095 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Variational Lossy Autoencoder
2016/11/08 by Xi Chen, Chen, Xi, Diederik P. Kingma +13 · 1 voice · 78 citations
Computer Science · #Generative Adversarial Networks and Image Synthesis #Domain Adaptation and Few-Shot Learning #Human Pose and Action Recognition
- Generating Long Sequences with Sparse Transformers
2019/04/23 by Rewon Child, Scott Gray, Child, Rewon +5 · 1 voice · 186 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.LG #stat.ML
- Exploiting Similarities among Languages for Machine Translation
2013/09/17 by Tomas Mikolov, Tomáš Mikolov, Quoc V. Le +4 · 1 voice · 119 citations
Computer Science · #cs.CL
- Evolution Strategies as a Scalable Alternative to Reinforcement Learning
2017/03/10 by Tim Salimans, Jonathan Ho, Salimans, Tim +7 · 1 voice · 163 citations
Computer Science · Mathematics · #Artificial Intelligence (cs.AI) #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Metaheuristic Optimization Algorithms Research #Neural and Evolutionary Computing (cs.NE) #Reinforcement Learning in Robotics #cs.AI #cs.LG #cs.NE #stat.ML
- Reinforcement Learning Neural Turing Machines - Revised
2015/05/04 by Wojciech Zaremba, Ilya Sutskever, Zaremba, Wojciech +1 · 2 voices · 37 citations
Computer Science · #Reinforcement Learning in Robotics #Machine Learning and Algorithms #Computability, Logic, AI Algorithms
- Distributed Representations of Words and Phrases and their Compositionality
2013/10/16 by Tomáš Mikolov, Mikolov, Tomas, Ilya Sutskever +7 · 285 citations
Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Topic Modeling
- Improving neural networks by preventing co-adaptation of feature detectors
2012/07/03 by Geoffrey E. Hinton, Hinton, Geoffrey E., Nitish Srivastava +7 · 337 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE)
- TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
2016/03/14 by Martín Abadi, Ashish Agarwal, Abadi, Martín +77 · 1 voice · 61 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC) #cs.DC #cs.LG
- Consistency Models
2023/03/02 by Yang Song, Prafulla Dhariwal, Song, Yang +5 · 352 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Advanced Image Processing Techniques #Cell Image Analysis Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Recurrent Neural Network Regularization
2014/09/08 by Wojciech Zaremba, Ilya Sutskever, Zaremba, Wojciech +3 · 195 citations
Computer Science · #Neural Networks and Applications #Music and Audio Processing #Image Retrieval and Classification Techniques
- Dota 2 with Large Scale Deep Reinforcement Learning
2019/12/13 by OpenAI, Christopher Berner, : +50 · 1 voice · 147 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Artificial Intelligence in Games #Reinforcement Learning in Robotics #cs.LG #stat.ML
- InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets
2016/06/11 by Xi Chen, Chen, Xi, Yan Duan +9 · 147 citations
Computer Science · #Advanced Image Processing Techniques #FOS: Computer and information sciences #Face recognition and analysis #Generative Adversarial Networks and Image Synthesis #Human Pose and Action Recognition #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Models
2018/10/02 by Will Grathwohl, Ricky T. Q. Chen, Grathwohl, Will +7 · 119 citations
Computer Science · Physics and Astronomy · #Generative Adversarial Networks and Image Synthesis #Model Reduction and Neural Networks #Computational Physics and Python Applications
- Improving Variational Inference with Inverse Autoregressive Flow
2016/06/15 by Diederik P. Kingma, Tim Salimans, Kingma, Diederik P. +9 · 91 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Jukebox: A Generative Model for Music
2020/04/30 by Prafulla Dhariwal, Dhariwal, Prafulla, Heewoo Jun +9 · 105 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Learning Factored Representations in a Deep Mixture of Experts
2013/12/16 by David Eigen, Marc’Aurelio Ranzato, Eigen, David +3 · 34 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Music and Audio Processing #Speech Recognition and Synthesis #Speech and Audio Processing
- Learning to Generate Reviews and Discovering Sentiment
2017/04/05 by Alec Radford, Radford, Alec, Rafał Józefowicz +3 · 63 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Advanced Text Analysis Techniques
- Adding Gradient Noise Improves Learning for Very Deep Networks
2015/11/21 by Arvind Neelakantan, Luke Vilnis, Neelakantan, Arvind +11 · 45 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Topic Modeling
- Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision
2023/12/14 by Collin Burns, Burns, Collin, Pavel Izmailov +21 · 62 citations
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Neural GPUs Learn Algorithms
2015/11/25 by Łukasz Kaiser, Ilya Sutskever, Kaiser, Łukasz +1 · 39 citations
Computer Science · Engineering · #Machine Learning and Algorithms #Neural Networks and Applications #Ferroelectric and Negative Capacitance Devices
- One-Shot Imitation Learning
2017/03/21 by Yan Duan, Marcin Andrychowicz, Duan, Yan +13 · 36 citations
Computer Science · Engineering · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #Robot Manipulation and Learning #Robotics (cs.RO)
- Continuous Adaptation via Meta-Learning in Nonstationary and Competitive\n Environments
2017/10/10 by Maruan Al-Shedivat, Al-Shedivat, Maruan, Trapit Bansal +9 · 33 citations
Computer Science · #Anomaly Detection Techniques and Applications #Domain Adaptation and Few-Shot Learning #Machine Learning and Data Classification
- Emergent Complexity via Multi-Agent Competition
2017/10/10 by Trapit Bansal, Jakub Pachocki, Bansal, Trapit +7 · 28 citations
Computer Science · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Games #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Reinforcement Learning in Robotics
- Formal Mathematics Statement Curriculum Learning
2022/02/03 by Stanislas Polu, Polu, Stanislas, Jesse Michael Han +9 · 18 citations
Computer Science · #Natural Language Processing Techniques #Mathematics, Computing, and Information Processing #Topic Modeling
- Some Considerations on Learning to Explore via Meta-Reinforcement Learning
2018/03/03 by Bradly C. Stadie, Ge Yang, Stadie, Bradly C. +13 · 10 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Reinforcement Learning in Robotics #Robot Manipulation and Learning
- Multi-task Sequence to Sequence Learning
2015/11/19 by Minh-Thang Luong, Quoc V. Le, Luong, Minh-Thang +7 · 7 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Move Evaluation in Go Using Deep Convolutional Neural Networks
2014/12/20 by Chris J. Maddison, Aja Huang, Maddison, Chris J. +5 · 1 voice · 1 citation
Computer Science · Economics, Econometrics and Finance · Psychology · #Artificial Intelligence in Games #Educational Games and Gamification #Sports Analytics and Performance #cs.LG #cs.NE
- Grammar as a Foreign Language
2014/12/23 by Oriol Vinyals, Łukasz Kaiser, Vinyals, Oriol +9 · 10 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Neural Random-Access Machines
2015/11/19 by Karol Kurach, Kurach, Karol, Marcin Andrychowicz +3 · 3 citations
Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE)
- Neural Programmer: Inducing Latent Programs with Gradient Descent
2015/11/16 by Arvind Neelakantan, Quoc V. Le, Neelakantan, Arvind +3 · 3 citations
Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Multimodal Machine Learning Applications