Sermanet, Pierre
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Comanici, Gheorghe, Eric Bieber +6844 · 8 voices · 1362 citations
#cs.CL #cs.AI
- Going Deeper with Convolutions
2014/09/17 by Christian Szegedy, Szegedy, Christian, Wei Liu +15 · 2 voices · 216 citations
#cs.CV
- RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control
2023/07/28 by Anthony Brohan, Noah Brown, Brohan, Anthony +105 · 559 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics (cs.RO) #Topic Modeling
- Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
2022/04/04 by Ahn, Michael, Anthony Brohan, Brohan, Anthony +84 · 320 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- PaLM-E: An Embodied Multimodal Language Model
2023/03/06 by Danny Driess, Fei Xia, Driess, Danny +41 · 279 citations
Computer Science · #Multimodal Machine Learning Applications #Human Pose and Action Recognition #Domain Adaptation and Few-Shot Learning
- Open X-Embodiment: Robotic Learning Datasets and RT-X Models
2023/10/13 by Embodiment Collaboration, O'Neill, Abby, Rehman, Abdul +349 · 175 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Inner Monologue: Embodied Reasoning through Planning with Language Models
2022/07/12 by Wenlong Huang, Fei Xia, Huang, Wenlong +31 · 118 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Robotics (cs.RO) #Topic Modeling
- Time-Contrastive Networks: Self-Supervised Learning from Video
2017/04/23 by Pierre Sermanet, Sermanet, Pierre, Corey Lynch +11 · 49 citations
Computer Science · Engineering · #Human Pose and Action Recognition #Advanced Vision and Imaging #Robot Manipulation and Learning
- OverFeat: Integrated Recognition, Localization and Detection using\n Convolutional Networks
2013/12/21 by Pierre Sermanet, David Eigen, Sermanet, Pierre +9 · 53 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques
- Gemini Robotics: Bringing AI into the Physical World
2025/03/25 by Gemini Robotics Team, Saminda Abeyruwan, Joshua Ainslie +212 · 134 citations
Engineering · Physics and Astronomy · #FOS: Computer and information sciences #Modular Robots and Swarm Intelligence #Robotics (cs.RO) #Space Science and Extraterrestrial Life
- Wasserstein Dependency Measure for Representation Learning
2019/03/28 by Sherjil Ozair, Ozair, Sherjil, Corey Lynch +9 · 1 voice · 9 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.LG #stat.ML
- Learning Latent Plans from Play
2019/03/05 by Corey Lynch, Lynch, Corey, Mohi Khansari +11 · 27 citations
Computer Science · Engineering · Psychology · #FOS: Computer and information sciences #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO) #Social Robot Interaction and HRI
- RT-H: Action Hierarchies Using Language
2024/03/04 by Suneel Belkhale, Belkhale, Suneel, Tianli Ding +15 · 46 citations
Computer Science · Business, Management and Accounting · #Data Visualization and Analytics #Semantic Web and Ontologies #Business Process Modeling and Analysis
- RoboVQA: Multimodal Long-Horizon Reasoning for Robotics
2023/11/01 by Pierre Sermanet, Sermanet, Pierre, Tianli Ding +39 · 28 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- Video Language Planning
2023/10/16 by Yilun Du, Mengjiao Yang, Du, Yilun +23 · 26 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Robotics (cs.RO)
- Language Conditioned Imitation Learning over Unstructured Data
2020/05/15 by Corey Lynch, Lynch, Corey, Pierre Sermanet +1 · 15 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Robot Manipulation and Learning #Robotics (cs.RO)
- With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations
2021/04/29 by Debidatta Dwibedi, Yusuf Aytar, Dwibedi, Debidatta +7 · 12 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Temporal Cycle-Consistency Learning
2019/04/16 by Dwibedi, Debidatta, Aytar, Yusuf, Tompson, Jonathan +2 · 9 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents
2024/01/23 by Michael J. Ahn, Ahn, Michael, Debidatta Dwibedi +51 · 16 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robot Manipulation and Learning #Robotics (cs.RO)
- Pedestrian Detection with Unsupervised Multi-Stage Feature Learning
2012/12/01 by Pierre Sermanet, Sermanet, Pierre, Koray Kavukcuoglu +5 · 7 citations
Computer Science · Engineering · #Video Surveillance and Tracking Methods #Advanced Neural Network Applications #Gait Recognition and Analysis
- Robotic Skill Acquisition via Instruction Augmentation with Vision-Language Models
2022/11/21 by Xiao, Ted, Chan, Harris, Sermanet, Pierre +5 · 6 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformers
2024/03/19 by Jain, Vidhi, Attarian, Maria, Joshi, Nikhil J +10 · 8 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Robotics (cs.RO)
- Convolutional Neural Networks Applied to House Numbers Digit Classification
2012/04/18 by Sermanet, Pierre, Chintala, Soumith, LeCun, Yann · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE)
- Counting Out Time: Class Agnostic Video Repetition Counting in the Wild
2020/06/27 by Dwibedi, Debidatta, Aytar, Yusuf, Tompson, Jonathan +2 · 3 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Unsupervised Perceptual Rewards for Imitation Learning
2016/12/20 by Pierre Sermanet, Kelvin Xu, Sermanet, Pierre +3 · 2 citations
Computer Science · Engineering · Neuroscience · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Neural and Behavioral Psychology Studies #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Visuomotor Control in Multi-Object Scenes Using Object-Aware Representations
2022/05/12 by Heravi, Negin, Wahid, Ayzaan, Lynch, Corey +6 · 3 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- Broadly-Exploring, Local-Policy Trees for Long-Horizon Task Planning
2020/10/13 by Brian Ichter, Pierre Sermanet, Ichter, Brian +3 · 2 citations
Computer Science · #AI-based Problem Solving and Planning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robotic Path Planning Algorithms #Robotics (cs.RO)
- Predictive Red Teaming: Breaking Policies Without Breaking Robots
2025/02/10 by Anirudha Majumdar, Majumdar, Anirudha, Mohit Sharma +9 · 5 citations
Social Sciences · #Artificial Intelligence (cs.AI) #Ethics and Social Impacts of AI #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Robotics (cs.RO) #Systems and Control (eess.SY) #electronic engineering #information engineering
- Generating Robot Constitutions & Benchmarks for Semantic Safety
2025/03/11 by Pierre Sermanet, Anirudha Majumdar, Sermanet, Pierre +7 · 6 citations
Computer Science · Engineering · #Software Testing and Debugging Techniques #Safety Systems Engineering in Autonomy #Robotics and Automated Systems
- Learning Actionable Representations from Visual Observations
2018/08/02 by Dwibedi, Debidatta, Tompson, Jonathan, Lynch, Corey +1 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- GoalsEye: Learning High Speed Precision Table Tennis on a Physical Robot
2022/10/07 by Tianli Ding, Ding, Tianli, Laura Graesser +13 · 1 citation
Computer Science · Engineering · #FOS: Computer and information sciences #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Can AI Perceive Physical Danger and Intervene?
2025/09/25 by Jindal, Abhishek, Kalashnikov, Dmitry, Hofer, R. Alex +5 · 2 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
- A Short Note on Evaluating RepNet for Temporal Repetition Counting in Videos
2024/11/13 by Dwibedi, Debidatta, Aytar, Yusuf, Tompson, Jonathan +2 · 1 citation
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)