Adam Santoro
- Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
2024/04/02 by David Raposo, Sam Ritter, Raposo, David +11 · 9 voices · 44 citations
Computer Science · #Natural Language Processing Techniques #cs.CL #cs.LG
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Comanici, Gheorghe, Eric Bieber +6844 · 8 voices · 1357 citations
#cs.CL #cs.AI
- Relational inductive biases, deep learning, and graph networks
2018/06/04 by Peter W. Battaglia, Jessica B. Hamrick, Battaglia, Peter W. +51 · 2 voices · 106 citations
#cs.LG #cs.AI #stat.ML
- A simple neural network module for relational reasoning
2017/06/05 by Adam Santoro, David Raposo, Santoro, Adam +11 · 1 voice · 16 citations
#cs.CL #cs.LG
- Data Distributional Properties Drive Emergent In-Context Learning in Transformers
2022/04/22 by Stephanie C. Y. Chan, Adam Santoro, Chan, Stephanie C. Y. +13 · 4 voices · 37 citations
#cs.LG #cs.AI #cs.CL
- One-shot Learning with Memory-Augmented Neural Networks
2016/05/19 by Adam Santoro, Sergey Bartunov, Santoro, Adam +7 · 1 voice · 29 citations
Computer Science · Engineering · #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications #Geophysical Methods and Applications
- Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
2022/06/09 by Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448 · 3 voices · 129 citations
#cs.CL #cs.AI #cs.CY #cs.LG #stat.ML
- Unsupervised Predictive Memory in a Goal-Directed Agent
2018/03/28 by Greg Wayne, Wayne, Greg, Chia-Chun Hung +50 · 1 voice · 6 citations
Computer Science · Neuroscience · #Explainable Artificial Intelligence (XAI) #Neural dynamics and brain function #Reinforcement Learning in Robotics #cs.LG #stat.ML
- Backpropagation and the brain
2020/04/17 by Timothy Lillicrap, Timothy P. Lillicrap, Adam Santoro +4 · 31 citations
Computer Science · Engineering · Neuroscience · #Advanced Memory and Neural Computing #Neural Networks and Applications #Neural dynamics and brain function
- Measuring abstract reasoning in neural networks
2018/07/11 by David G. T. Barrett, Felix Hill, Barrett, David G. T. +7 · 27 citations
Computer Science · #Neural Networks and Applications #Explainable Artificial Intelligence (XAI) #Machine Learning and Data Classification
- Hyperbolic Attention Networks
2018/05/24 by Çağlar Gülçehre, Gulcehre, Caglar, Misha Denil +19 · 14 citations
Computer Science · #Advanced Graph Neural Networks #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Neural and Evolutionary Computing (cs.NE) #Topic Modeling
- Assessing the Scalability of Biologically-Motivated Deep Learning\n Algorithms and Architectures
2018/07/12 by Sergey Bartunov, Adam Santoro, Bartunov, Sergey +9 · 18 citations
Engineering · Computer Science · #Advanced Memory and Neural Computing #Neural Networks and Reservoir Computing #Ferroelectric and Negative Capacitance Devices
- Symbolic Behaviour in Artificial Intelligence
2021/02/05 by Adam Santoro, Andrew Lampinen, Santoro, Adam +7 · 3 voices · 1 citation
#cs.AI #cs.LG
- Attention over learned object embeddings enables complex visual reasoning
2020/12/15 by Ding, David, Felix Hill, Hill, Felix +6 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Neural Networks and Applications
- Imitating Interactive Intelligence
2020/12/10 by Josh Abramson, Arun Ahuja, Abramson, Josh +55 · 7 citations
Computer Science · #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Domain Adaptation and Few-Shot Learning
- Environmental drivers of systematicity and generalization in a situated agent
2019/10/01 by Felix Hill, Andrew K. Lampinen, Hill, Felix +11 · 5 citations
Social Sciences · Computer Science · #Language and cultural evolution #Evolutionary Algorithms and Applications #Multi-Agent Systems and Negotiation
- Learning to Make Analogies by Contrasting Abstract Relational Structure
2019/01/31 by Felix Hill, Hill, Felix, Adam Santoro +7 · 3 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Human Pose and Action Recognition
- Creating Multimodal Interactive Agents with Imitation and Self-Supervised Learning
2021/12/07 by DeepMind Interactive Agents Team, Josh Abramson, Arun Ahuja +48 · 2 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- Building Machines that Learn and Think for Themselves: Commentary on Lake et al., Behavioral and Brain Sciences, 2017
2017/11/22 by Matthew Botvinick, David G. T. Barrett, Botvinick, M. +35 · 2 citations
Computer Science · #Reinforcement Learning in Robotics #Explainable Artificial Intelligence (XAI) #AI-based Problem Solving and Planning
- Is coding a relevant metaphor for building AI? A commentary on "Is coding a relevant metaphor for the brain?", by Romain Brette
2019/04/18 by Adam Santoro, Felix Hill, Santoro, Adam +9 · 1 citation
Neuroscience · Computer Science · Psychology · #Cognitive Science and Education Research #Cognitive Science and Mapping #Action Observation and Synchronization
- Evaluating Multimodal Interactive Agents
2022/05/26 by Josh Abramson, Abramson, Josh, Arun Ahuja +29 · 1 voice
Computer Science · #AI in Service Interactions #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling #cs.AI #cs.LG
- Tracing the Representation Geometry of Language Models from Pretraining to Post-training
2025/09/27 by Minwei Li, Melody Zixuan Li, Kumar Krishna Agrawal +13 · 2 voices · 4 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG