Kaiser, Lukasz
- Attention Is All You Need
The Transformer, an attention-only architecture, beat prior best translation results while training far faster than RNN or CNN models.
2017/06/12 by Ashish Vaswani, Vaswani, Ashish, Noam Shazeer +13 · 85 voices · 6518 citations
#cs.CL #cs.LG
- Evaluating Large Language Models Trained on Code
2021/07/07 by Mark Chen, Jerry Tworek, Chen, Mark +122 · 9 voices · 1212 citations
Computer Science · #Parallel Computing and Optimization Techniques #Software Engineering Research #Topic Modeling #cs.LG
- One Model To Learn Them All
2017/06/16 by Łukasz Kaiser, Lukasz Kaiser, Aidan N. Gomez +12 · 11 voices · 10 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.LG #stat.ML
- Competitive Programming with Large Reasoning Models
2025/02/03 by OpenAI, :, Ahmed El-Kishky +50 · 13 voices · 33 citations
Decision Sciences · Economics, Econometrics and Finance · #Economic theories and models #Multi-Criteria Decision Making #cs.AI #cs.CL #cs.LG
- Model-Based Reinforcement Learning for Atari
2019/03/01 by Łukasz Kaiser, Lukasz Kaiser, Mohammad Babaeizadeh +29 · 3 voices · 53 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Artificial Intelligence in Games #Reinforcement Learning in Robotics #cs.LG #stat.ML
- Training Verifiers to Solve Math Word Problems
2021/10/27 by Karl Cobbe, Vineet Kosaraju, Cobbe, Karl +12 · 1463 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- GPT-4o System Card
2024/10/25 by OpenAI, A. M. Hurst, : +503 · 1141 citations
Medicine · #Cardiovascular Function and Risk Factors #Hyperglycemia and glycemic control in critically ill and hospitalized patients
- TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
2016/03/14 by Martín Abadi, Ashish Agarwal, Abadi, Martín +77 · 1 voice · 46 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC) #cs.DC #cs.LG
- OpenAI o1 System Card
2024/12/21 by OpenAI, Aaron Jaech, : +347 · 485 citations
Computer Science · #Advanced Computational Techniques and Applications
- Rethinking Attention with Performers
2020/09/30 by Krzysztof Choromański, Valerii Likhosherstov, Choromanski, Krzysztof +23 · 171 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications #Topic Modeling
- Generating Wikipedia by Summarizing Long Sequences
2018/01/30 by Peter J. Liu, Mohammad Saleh, Liu, Peter J. +12 · 1 voice · 25 citations
Computer Science · Social Sciences · #Natural Language Processing Techniques #Topic Modeling #Wikis in Education and Collaboration #cs.CL
- Adding Gradient Noise Improves Learning for Very Deep Networks
2015/11/21 by Arvind Neelakantan, Neelakantan, Arvind, Luke Vilnis +11 · 26 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Topic Modeling
- Multi-task Sequence to Sequence Learning
2015/11/19 by Luong, Minh-Thang, Le, Quoc V., Sutskever, Ilya +2 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Parallel Scheduled Sampling
2019/06/11 by Daniel Duckworth, Duckworth, Daniel, Arvind Neelakantan +7 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling #Video Analysis and Summarization
- Depthwise Separable Convolutions for Neural Machine Translation
2017/06/09 by Kaiser, Lukasz, Gomez, Aidan N., Chollet, Francois · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Unsupervised Cipher Cracking Using Discrete GANs
2018/01/15 by Aidan N. Gomez, Gomez, Aidan N., Sicong Huang +8 · 1 citation
Computer Science · #Advanced Malware Detection Techniques #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Packet Processing and Optimization
- Grammar as a Foreign Language
2014/12/23 by Oriol Vinyals, Łukasz Kaiser, Vinyals, Oriol +9 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling