Bengio, Samy
- GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models
2024/10/07 by Iman Mirzadeh, Mirzadeh, Iman, Keivan Alizadeh +9 · 69 voices · 151 citations
Computer Science · #Natural Language Processing Techniques
- Understanding deep learning requires rethinking generalization
2016/11/10 by Chiyuan Zhang, Zhang, Chiyuan, Samy Bengio +7 · 9 voices · 182 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Gaussian Processes and Bayesian Inference #Stochastic Gradient Optimization Techniques #cs.LG
- Adversarial examples in the physical world
2016/07/08 by Alexey Kurakin, Ian Goodfellow, Kurakin, Alexey +3 · 5 voices · 111 citations
Computer Science · Mathematics · #Computer Vision and Pattern Recognition (cs.CV) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.CR #cs.CV #cs.LG #stat.ML
- Tacotron: Towards End-to-End Speech Synthesis
2017/03/29 by Yuxuan Wang, RJ Skerry-Ryan, Wang, Yuxuan +26 · 2 voices · 63 citations
Computer Science · #cs.CL #cs.LG #cs.SD
- Density estimation using Real NVP
2016/05/27 by Dinh, Laurent, Sohl-Dickstein, Jascha, Bengio, Samy · 171 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE)
- Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks
2015/06/09 by Samy Bengio, Oriol Vinyals, Bengio, Samy +5 · 151 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Transfusion: Understanding Transfer Learning for Medical Imaging
2019/02/14 by Maithra Raghu, Chiyuan Zhang, Raghu, Maithra +5 · 1 voice · 36 citations
Medicine · Computer Science · #COVID-19 diagnosis using AI #AI in cancer detection #Radiomics and Machine Learning in Medical Imaging
- The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity
2025/06/07 by Parshin Shojaee, Shojaee, Parshin, Iman Mirzadeh +9 · 14 voices · 129 citations
#cs.AI #cs.CL #cs.LG
- Show and Tell: A Neural Image Caption Generator
2014/11/17 by Vinyals, Oriol, Toshev, Alexander, Bengio, Samy +1 · 56 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Neural Combinatorial Optimization with Reinforcement Learning
2016/11/29 by Irwan Bello, Bello, Irwan, Hieu Pham +7 · 56 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Metaheuristic Optimization Algorithms Research
- Adversarial Machine Learning at Scale
2016/11/04 by Alexey Kurakin, Kurakin, Alexey, Ian Goodfellow +3 · 58 citations
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Sharp Minima Can Generalize For Deep Nets
2017/03/15 by Laurent Dinh, Dinh, Laurent, Razvan Pascanu +5 · 49 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Stochastic Gradient Optimization Techniques
- What Algorithms can Transformers Learn? A Study in Length Generalization
2023/10/24 by Hattie Zhou, Arwen Bradley, Zhou, Hattie +13 · 2 voices · 21 citations
Computer Science · #cs.LG #cs.AI #cs.CL #stat.ML
- Fantastic Generalization Measures and Where to Find Them
2019/12/04 by Jiang, Yiding, Neyshabur, Behnam, Mobahi, Hossein +2 · 30 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Insights on representational similarity in neural networks with canonical correlation
2018/06/14 by Ari S. Morcos, Morcos, Ari S., Maithra Raghu +3 · 21 citations
Computer Science · Materials Science · Neuroscience · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Functional Brain Connectivity Studies #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning in Materials Science #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE) #Neural dynamics and brain function
- Order Matters: Sequence to sequence for sets
2015/11/19 by Oriol Vinyals, Vinyals, Oriol, Samy Bengio +3 · 19 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML
2019/09/19 by Aniruddh Raghu, Raghu, Aniruddh, Maithra Raghu +5 · 20 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Multimodal Machine Learning Applications
- A Study on Overfitting in Deep Reinforcement Learning
2018/04/18 by Chiyuan Zhang, Zhang, Chiyuan, Oriol Vinyals +5 · 20 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics
- Zero-Shot Learning by Convex Combination of Semantic Embeddings
2013/12/19 by Mohammad Norouzi, Norouzi, Mohammad, Tomáš Mikolov +13 · 14 citations
Computer Science · Medicine · #COVID-19 diagnosis using AI #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding
2021/06/05 by Yang Li, Li, Yang, Si Si +7 · 15 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Machine Learning (cs.LG)
- Revisiting Distributed Synchronous SGD
2016/04/04 by Chen, Jianmin, Pan, Xinghao, Monga, Rajat +2 · 10 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #Parallel #and Cluster Computing (cs.DC)
- Device Placement Optimization with Reinforcement Learning
2017/06/13 by Azalia Mirhoseini, Hieu Pham, Mirhoseini, Azalia +17 · 14 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Industrial Vision Systems and Defect Detection #Machine Learning (cs.LG) #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics
- Predicting the Generalization Gap in Deep Networks with Margin Distributions
2018/09/28 by Yiding Jiang, Dilip Krishnan, Jiang, Yiding +5 · 14 citations
Computer Science · #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
- Are All Layers Created Equal?
2019/02/06 by Zhang, Chiyuan, Bengio, Samy, Singer, Yoram · 8 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Reward Augmented Maximum Likelihood for Neural Structured Prediction
2016/09/01 by Mohammad Norouzi, Samy Bengio, Norouzi, Mohammad +11 · 9 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Large Margin Deep Networks for Classification
2018/03/15 by Elsayed, Gamaleldin F., Krishnan, Dilip, Mobahi, Hossein +2 · 6 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- When can transformers reason with abstract symbols?
2023/10/15 by Enric Boix-Adsera, Enric Boix-Adserà, Omid Saremi +12 · 1 voice · 4 citations
Computer Science · #Advanced Text Analysis Techniques #Natural Language Processing Techniques #cs.AI #cs.CL #cs.LG
- End-to-End Text-Dependent Speaker Verification
2015/09/27 by Georg Heigold, Heigold, Georg, Ignacio López Moreno +5 · 5 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #Topic Modeling
- Learning to Remember Rare Events
2017/03/09 by Łukasz Kaiser, Kaiser, Łukasz, Ofir Nachum +5 · 8 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- Fast Decoding in Sequence Models using Discrete Latent Variables
2018/03/09 by Łukasz Kaiser, Kaiser, Łukasz, Aurko Roy +11 · 11 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Characterising Bias in Compressed Models
2020/10/06 by Hooker, Sara, Moorosi, Nyalleng, Clark, Gregory +2 · 6 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Tensor2Tensor for Neural Machine Translation
2018/03/16 by Vaswani, Ashish, Bengio, Samy, Brevdo, Eugene +10 · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Generalization on the Unseen, Logic Reasoning and Degree Curriculum
2023/01/30 by Emmanuel Abbé, Abbe, Emmanuel, Samy Bengio +5 · 8 citations
Computer Science · #Bayesian Modeling and Causal Inference #Machine Learning and Data Classification #Machine Learning and Algorithms
- Transformers learn through gradual rank increase
2023/06/12 by Boix-Adsera, Enric, Littwin, Etai, Abbe, Emmanuel +2 · 7 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- How Far Can Transformers Reason? The Globality Barrier and Inductive Scratchpad
2024/06/10 by Emmanuel Abbe, Emmanuel Abbé, Abbe, Emmanuel +8 · 1 voice · 2 citations
Computer Science · Psychology · #Computability, Logic, AI Algorithms #Deception detection and forensic psychology #Neural Networks and Applications #cs.AI #cs.LG #stat.ML
- Context-aware Captions from Context-agnostic Supervision
2017/01/11 by Ramakrishna Vedantam, Samy Bengio, Vedantam, Ramakrishna +7 · 7 citations
Computer Science · #Multimodal Machine Learning Applications #Human Pose and Action Recognition #Domain Adaptation and Few-Shot Learning
- Content preserving text generation with attribute controls
2018/11/03 by Logeswaran, Lajanugen, Lee, Honglak, Bengio, Samy · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Discrete Autoencoders for Sequence Models
2018/01/29 by Łukasz Kaiser, Samy Bengio, Kaiser, Łukasz +1 · 5 citations
Computer Science · #Generative Adversarial Networks and Image Synthesis #Algorithms and Data Compression #Image Processing and 3D Reconstruction
- Auto Completion of User Interface Layout Design Using Transformer-Based Tree Decoders
2020/01/14 by Yang Li, Li, Yang, Julien Amelot +7 · 2 citations
Computer Science · #Video Analysis and Summarization #Web Data Mining and Analysis #Music and Audio Processing
- Parallel Scheduled Sampling
2019/06/11 by Daniel Duckworth, Arvind Neelakantan, Duckworth, Daniel +7 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling #Video Analysis and Summarization
- N-gram Language Modeling using Recurrent Neural Network Estimation
2017/03/31 by Chelba, Ciprian, Norouzi, Mohammad, Bengio, Samy · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Time-Dependent Representation for Neural Event Sequence Prediction
2017/07/31 by Yang Li, Li, Yang, Nan Du +3 · 1 citation
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Adversarial Attacks and Defences Competition
2018/03/31 by Kurakin, Alexey, Goodfellow, Ian, Bengio, Samy +20 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Semantic Redundancies in Image-Classification Datasets: The 10% You Don't Need
2019/01/29 by Birodkar, Vighnesh, Mobahi, Hossein, Bengio, Samy · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization
2021/07/27 by Zhang, Chiyuan, Raghu, Maithra, Kleinberg, Jon +1 · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Continuous Soft Pseudo-Labeling in ASR
2022/11/11 by Tatiana Likhomanenko, Ronan Collobert, Likhomanenko, Tatiana +5 · 1 citation
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Improving Anytime Prediction with Parallel Cascaded Networks and a Temporal-Difference Loss
2021/02/19 by Iuzzolino, Michael L., Mozer, Michael C., Bengio, Samy · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Adaptivity and Modularity for Efficient Generalization Over Task Complexity
2023/10/13 by Samira Abnar, Omid Saremi, Abnar, Samira +19 · 1 citation
Computer Science · #Machine Learning and Data Classification #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications
- TiC-LM: A Web-Scale Benchmark for Time-Continual LLM Pretraining
2025/04/02 by Jeffrey Li, Li, Jeffrey, Mohammadreza Armandpour +19 · 2 citations
Engineering · #Metallurgy and Material Forming #Advanced Surface Polishing Techniques
- NeurIPS 2020 Competition: Predicting Generalization in Deep Learning
2020/12/14 by Yiding Jiang, Jiang, Yiding, Pierre Foret +17 · 2 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Chain-of-Sketch: Enabling Global Visual Reasoning
2024/10/10 by Aryo Lotfi, Lotfi, Aryo, Enrico Fini +7 · 1 citation
Social Sciences · #Computer Vision and Pattern Recognition (cs.CV) #Educational Tools and Methods #FOS: Computer and information sciences #Machine Learning (cs.LG) #Online and Blended Learning
- RL for Reasoning by Adaptively Revealing Rationales
2025/06/22 by Amani, Mohammad Hossein, Lotfi, Aryo, Baldwin, Nicolas Mario +4 · 3 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)