Deepak Pathak
- Open X-Embodiment: Robotic Learning Datasets and RT-X Models
2023/10/13 by Embodiment Collaboration, O'Neill, Abby, Rehman, Abdul +349 · 180 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents
2022/01/18 by Wenlong Huang, Pieter Abbeel, Huang, Wenlong +5 · 122 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- Evaluating Text-to-Visual Generation with Image-to-Text Generation
2024/04/01 by Zhiqiu Lin, Lin, Zhiqiu, Deepak Pathak +13 · 1 voice · 119 citations
Arts and Humanities · Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Digital Humanities and Scholarship #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia (cs.MM) #cs.AI #cs.CL #cs.CV #cs.LG #cs.MM
- RMA: Rapid Motor Adaptation for Legged Robots
2021/07/08 by Ashish Kumar, Zipeng Fu, Kumar, Ashish +5 · 83 citations
Engineering · Computer Science · Medicine · #Robotic Locomotion and Control #Reinforcement Learning in Robotics #Neurogenetic and Muscular Disorders Research
- Diffusion Beats Autoregressive in Data-Constrained Settings
2025/07/21 by Mihir Prabhudesai, Mengning Wu, Prabhudesai, Mihir +9 · 3 voices · 19 citations
Computer Science · Physics and Astronomy · #Model Reduction and Neural Networks #Neural Networks and Applications #cs.AI #cs.CV #cs.LG #cs.RO
- Planning to Explore via Self-Supervised World Models
2020/05/12 by R. Sekar, Sekar, Ramanan, Oleh Rybkin +9 · 41 citations
Computer Science · #Reinforcement Learning in Robotics #Machine Learning and Algorithms #Multimodal Machine Learning Applications
- Affordances from Human Videos as a Versatile Representation for Robotics
2023/04/17 by Shikhar Bahl, Russell Mendonca, Bahl, Shikhar +7 · 50 citations
Computer Science · Engineering · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #Robot Manipulation and Learning #Robotics (cs.RO)
- Aligning Text-to-Image Diffusion Models with Reward Backpropagation
2023/10/05 by Mihir Prabhudesai, Prabhudesai, Mihir, Anirudh Goyal +5 · 45 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Robotics (cs.RO)
- Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotion
2022/10/18 by Zipeng Fu, Fu, Zipeng, Xuxin Cheng +3 · 36 citations
Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Muscle activation and electromyography studies #Prosthetics and Rehabilitation Robotics #Robotic Locomotion and Control #Robotics (cs.RO) #Systems and Control (eess.SY) #electronic engineering #information engineering
- Extreme Parkour with Legged Robots
2023/09/25 by Xuxin Cheng, Kexin Shi, Cheng, Xuxin +5 · 45 citations
Computer Science · Engineering · #Human Pose and Action Recognition #Aerospace Engineering and Energy Systems #Robotic Locomotion and Control
- Your Diffusion Model is Secretly a Zero-Shot Classifier
2023/03/28 by Alexander C. Li, Li, Alexander C., Mihir Prabhudesai +7 · 36 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Topic Modeling #Generative Adversarial Networks and Image Synthesis
- Toward Multimodal Image-to-Image Translation
2017/11/30 by Jun-Yan Zhu, Richard Zhang, Zhu, Jun-Yan +11 · 34 citations
Computer Science · #Generative Adversarial Networks and Image Synthesis #Advanced Vision and Imaging #Advanced Image Processing Techniques
- Human-to-Robot Imitation in the Wild
2022/07/19 by Shikhar Bahl, Abhinav Gupta, Bahl, Shikhar +3 · 29 citations
Computer Science · #Reinforcement Learning in Robotics #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- LEAP Hand: Low-Cost, Efficient, and Anthropomorphic Hand for Robot Learning
2023/09/12 by Kenneth Shaw, Shaw, Kenneth, Ananye Agarwal +3 · 28 citations
Engineering · Neuroscience · Computer Science · #Robot Manipulation and Learning #Tactile and Sensory Interactions #Hand Gesture Recognition Systems
- Legged Locomotion in Challenging Terrains using Egocentric Vision
2022/11/14 by Ananye Agarwal, Agarwal, Ananye, Ashish Kumar +5 · 24 citations
Biochemistry, Genetics and Molecular Biology · Engineering · Medicine · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Diabetic Foot Ulcer Assessment and Management #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Robotic Locomotion and Control #Robotics (cs.RO) #Systems and Control (eess.SY) #Zebrafish Biomedical Research Applications #electronic engineering #information engineering
- One Policy to Control Them All: Shared Modular Policies for Agent-Agnostic Control
2020/07/09 by Wenlong Huang, Huang, Wenlong, Igor Mordatch +3 · 14 citations
Computer Science · Decision Sciences · #Auction Theory and Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Logic, Reasoning, and Knowledge #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics
- Structured World Models from Human Videos
2023/08/21 by Russell Mendonca, Mendonca, Russell, Shikhar Bahl +3 · 21 citations
Computer Science · #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning
- Adaptive Mobile Manipulation for Articulated Objects In the Open World
2024/01/25 by Haoyu Xiong, Russell Mendonca, Xiong, Haoyu +5 · 1 voice · 12 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #IoT-based Smart Home Systems #Machine Learning (cs.LG) #Modular Robots and Swarm Intelligence #Robotic Path Planning Algorithms #Robotics (cs.RO) #Systems and Control (eess.SY) #cs.AI #cs.CV #cs.LG #cs.RO #eess.SY #electronic engineering #information engineering
- Video Diffusion Alignment via Reward Gradients
2024/07/11 by Mihir Prabhudesai, Russell Mendonca, Prabhudesai, Mihir +7 · 27 citations
Computer Science · #Advanced Image Processing Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Image and Signal Denoising Methods #Machine Learning (cs.LG) #Robotics (cs.RO)
- Discovering and Achieving Goals via World Models
2021/10/18 by Russell Mendonca, Oleh Rybkin, Mendonca, Russell +7 · 13 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Robotics (cs.RO)
- Third-Person Visual Imitation Learning via Decoupled Hierarchical Controller
2019/11/21 by Pratyusha Sharma, Sharma, Pratyusha, Deepak Pathak +3 · 9 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Robot Manipulation and Learning #Robotics (cs.RO)
- Robotic Telekinesis: Learning a Robotic Hand Imitator by Watching Humans on Youtube
2022/02/21 by Aravind Sivakumar, Sivakumar, Aravind, Kenneth Shaw +3 · 9 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Hand Gesture Recognition Systems #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics (cs.RO)
- Maximizing Confidence Alone Improves Reasoning
2025/05/28 by Mihir Prabhudesai, Prabhudesai, Mihir, Lili Chen +9 · 41 citations
Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Explainable Artificial Intelligence (XAI)
- FLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolation
2020/12/15 by Tarun Kalluri, Kalluri, Tarun, Deepak Pathak +5 · 7 citations
Computer Science · #Advanced Image Processing Techniques #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition
- Constrained Convolutional Neural Networks for Weakly Supervised Segmentation
2015/06/11 by Deepak Pathak, Pathak, Deepak, Philipp Krähenbühl +3 · 5 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Medical Image Segmentation Techniques
- Auto-Tuned Sim-to-Real Transfer
2021/04/15 by Yuqing Du, Olivia Watkins, Du, Yuqing +7 · 7 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics
- Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal Models
2023/01/16 by Zhiqiu Lin, Lin, Zhiqiu, Samuel Yu +7 · 8 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Cancer-related molecular mechanisms research #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Sound (cs.SD) #electronic engineering #information engineering
- Minimizing Energy Consumption Leads to the Emergence of Gaits in Legged Robots
2021/10/25 by Zipeng Fu, Ashish Kumar, Fu, Zipeng +5 · 6 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics #Robotic Locomotion and Control #Robotics (cs.RO)
- Local Policies Enable Zero-shot Long-horizon Manipulation
2024/10/29 by Murtaza Dalal, Min Liu, Dalal, Murtaza +11 · 14 citations
Engineering · #Infrared Target Detection Methodologies
- PlayFusion: Skill Acquisition via Diffusion from Language-Annotated Play
2023/12/07 by Lili Chen, Shikhar Bahl, Chen, Lili +3 · 8 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robotics (cs.RO) #Systems and Control (eess.SY) #Topic Modeling #electronic engineering #information engineering
- Dexterous Functional Grasping
2023/12/05 by Ananye Agarwal, Shagun Uppal, Agarwal, Ananye +5 · 8 citations
Engineering · Neuroscience · #Robot Manipulation and Learning #Robotic Locomotion and Control #Motor Control and Adaptation
- Revisiting the Role of Language Priors in Vision-Language Models
2023/06/02 by Zhiqiu Lin, Xinyue Chen, Lin, Zhiqiu +7 · 7 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
- Generalization in Dexterous Manipulation via Geometry-Aware Multi-Task Learning
2021/11/04 by Wenlong Huang, Huang, Wenlong, Igor Mordatch +5 · 5 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotic Path Planning Algorithms #Robotics (cs.RO) #Systems and Control (eess.SY) #electronic engineering #information engineering
- Accelerating Robotic Reinforcement Learning via Parameterized Action Primitives
2021/10/28 by Murtaza Dalal, Dalal, Murtaza, Deepak Pathak +3 · 5 citations
Computer Science · Engineering · #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotic Locomotion and Control
- Diffusion-TTA: Test-time Adaptation of Discriminative Models via Generative Feedback
2023/11/27 by Mihir Prabhudesai, Prabhudesai, Mihir, Tsung-Wei Ke +7 · 6 citations
Computer Science · #Generative Adversarial Networks and Image Synthesis #Topic Modeling
- Legs as Manipulator: Pushing Quadrupedal Agility Beyond Locomotion
2023/03/20 by Xuxin Cheng, Ashish Kumar, Cheng, Xuxin +3 · 5 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Human Pose and Action Recognition #Machine Learning (cs.LG) #Robot Manipulation and Learning #Robotic Locomotion and Control #Robotics (cs.RO) #Systems and Control (eess.SY) #electronic engineering #information engineering
- SAPG: Split and Aggregate Policy Gradients
2024/07/29 by Jayesh Singla, Singla, Jayesh, Ananye Agarwal +3 · 8 citations
Economics, Econometrics and Finance · Social Sciences · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Economic Policies and Impacts #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Regional Development and Policy #Robotics (cs.RO) #Systems and Control (eess.SY) #electronic engineering #information engineering
- Understanding Collapse in Non-Contrastive Siamese Representation Learning
2022/09/29 by Alexander C. Li, Li, Alexander C., Alexei A. Efros +3 · 4 citations
Computer Science · Medicine · #Artificial Intelligence (cs.AI) #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Neural and Evolutionary Computing (cs.NE) #Robotics (cs.RO)
- Neural Dynamic Policies for End-to-End Sensorimotor Learning
2020/12/04 by Shikhar Bahl, Bahl, Shikhar, Mustafa Mukadam +5 · 3 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Muscle activation and electromyography studies #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- DexWild: Dexterous Human Interactions for In-the-Wild Robot Policies
2025/05/12 by Tony Tao, Mohan Kumar Srirama, Tao, Tony +7 · 12 citations
Engineering · Psychology · Computer Science · #Robot Manipulation and Learning #Social Robot Interaction and HRI #Reinforcement Learning in Robotics
- FACTR: Force-Attending Curriculum Training for Contact-Rich Policy Learning
2025/02/24 by Jason Liu, Yulong Li, Liu, Jason Jingzhou +9 · 10 citations
Decision Sciences · Social Sciences · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Evaluation and Performance Assessment #FOS: Computer and information sciences #Machine Learning (cs.LG) #Policy Transfer and Learning #Robotics (cs.RO)
- Continuously Improving Mobile Manipulation with Autonomous Real-World RL
2024/09/30 by Russell Mendonca, Mendonca, Russell, Emmanuel Panov +7 · 7 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Human Motion and Animation #Machine Learning (cs.LG) #Robot Manipulation and Learning #Robotic Path Planning Algorithms #Robotics (cs.RO) #Systems and Control (eess.SY) #electronic engineering #information engineering
- Differentiable Spatial Planning using Transformers
2021/12/02 by Devendra Singh Chaplot, Deepak Pathak, Chaplot, Devendra Singh +3 · 3 citations
Computer Science · #Robotic Path Planning Algorithms #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- Functional Regularization for Reinforcement Learning via Learned Fourier Features
2021/12/06 by Alexander C. Li, Li, Alexander C., Deepak Pathak +1 · 3 citations
Computer Science · Engineering · Physics and Astronomy · #Adaptive Dynamic Programming Control #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Control Systems and Identification #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural and Evolutionary Computing (cs.NE) #Reinforcement Learning in Robotics #Robotics (cs.RO)
- SPIN: Simultaneous Perception, Interaction and Navigation
2024/05/13 by Shagun Uppal, Uppal, Shagun, Ananye Agarwal +7 · 5 citations
Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Robotics (cs.RO) #Robotics and Automated Systems #Systems and Control (eess.SY) #electronic engineering #information engineering
- On the Surprising Effectiveness of Attention Transfer for Vision Transformers
2024/11/14 by Alexander C. Li, Li, Alexander C., Yuandong Tian +7 · 3 voices · 2 citations
#cs.LG #cs.AI #cs.CV #cs.NE
- Neural MP: A Generalist Neural Motion Planner
2024/09/09 by Murtaza Dalal, Jiahui Yang, Dalal, Murtaza +9 · 6 citations
Computer Science · Engineering · #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robot Manipulation and Learning #Robotic Mechanisms and Dynamics #Robotics (cs.RO)
- Sparse Graphical Memory for Robust Planning
2020/03/13 by Scott Emmons, Ajay N. Jain, Emmons, Scott +9 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robotic Path Planning Algorithms #Robotics (cs.RO)
- Efficient RL via Disentangled Environment and Agent Representations
2023/09/05 by Kevin Gmelin, Shikhar Bahl, Gmelin, Kevin +5 · 3 citations
Computer Science · Physics and Astronomy · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural and Evolutionary Computing (cs.NE) #Reinforcement Learning in Robotics #Robotics (cs.RO)
- Planning in Learned Latent Action Spaces for Generalizable Legged Locomotion
2020/08/27 by Tianyu Li, Li, Tianyu, Roberto Calandra +9 · 2 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Human Pose and Action Recognition #Prosthetics and Rehabilitation Robotics #Robotic Locomotion and Control #Robotics (cs.RO)
- Adaptive fusion of multi-modal remote sensing data for optimal sub-field crop yield prediction
2024/01/31 by Francisco Mena, Deepak Pathak, Hiba Najjar +11 · 2 citations
- Interesting Object, Curious Agent: Learning Task-Agnostic Exploration
2021/11/25 by Simone Parisi, Parisi, Simone, Victoria Dean +5 · 1 citation
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Reinforcement Learning in Robotics
- HERD: Continuous Human-to-Robot Evolution for Learning from Human Demonstration
2022/12/08 by Xingyu Liu, Deepak Pathak, Liu, Xingyu +3 · 1 citation
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Neural and Evolutionary Computing (cs.NE) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- ViPRA: Video Prediction for Robot Actions
2025/11/11 by Sandeep Routray, Routray, Sandeep, Unnat Jain +6 · 2 citations
Computer Science · #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Generative Adversarial Networks and Image Synthesis
- Attributes Should Come from Images, Not Class Names: Distribution-Conditioned Attribute Selection for Vision-Language Models
2026/07/21 by Gautam Rajendrakumar Gare, Jia Shi, Zhiqiu Lin +3
#cs.CV #cs.AI #cs.LG #eess.IV