Yuke Zhu
- Eureka: Human-Level Reward Design via Coding Large Language Models
2023/10/19 by Yecheng Jason Ma, William Liang, Ma, Yecheng Jason +15 · 6 voices · 138 citations
Computer Science · Materials Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Materials Science #Reinforcement Learning in Robotics #Robotics (cs.RO) #Software Engineering Research #cs.AI #cs.LG #cs.RO
- Voyager: An Open-Ended Embodied Agent with Large Language Models
2023/05/25 by Guanzhi Wang, Yuqi Xie, Wang, Guanzhi +13 · 5 voices · 387 citations
Computer Science · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Games #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
2016/02/23 by Ranjay Krishna, Krishna, Ranjay, Yuke Zhu +22 · 366 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Image Retrieval and Classification Techniques #Multimodal Machine Learning Applications #cs.AI #cs.CV
- DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset
2024/03/19 by Alexander Khazatsky, Khazatsky, Alexander, Karl Pertsch +207 · 1 voice · 313 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotic Path Planning Algorithms #Robotics (cs.RO) #cs.RO
- LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning
2023/06/05 by Bo Liu, Liu, Bo, Yifeng Zhu +11 · 412 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications
- Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning
2016/09/16 by Yuke Zhu, Roozbeh Mottaghi, Zhu, Yuke +11 · 2 voices · 67 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #cs.CV
- What Matters in Learning from Offline Human Demonstrations for Robot Manipulation
2021/08/06 by Ajay Mandlekar, Danfei Xu, Mandlekar, Ajay +17 · 195 citations
Computer Science · Engineering · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Multi-Stage Learning for Grasp-Constrained Object Manipulation with a Simulated Panda Robot
2020/09/25 by Yuke Zhu, Josiah Wong, Zhu, Yuke +15 · 121 citations
Computer Science · Engineering · #Reinforcement Learning in Robotics #Modular Robots and Swarm Intelligence #Robot Manipulation and Learning
- GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
2025/03/18 by Nvidia Nvidia, NVIDIA, : +80 · 396 citations
Engineering · Computer Science · #Robotic Locomotion and Control #Robotic Path Planning Algorithms #Reinforcement Learning in Robotics
- MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
2022/06/17 by Linxi Fan, Fan, Linxi, Guanzhi Wang +17 · 101 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- Scene Graph Generation by Iterative Message Passing
2017/01/10 by Danfei Xu, Yuke Zhu, Xu, Danfei +5 · 77 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Image Retrieval and Classification Techniques
- MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations
2023/10/26 by Ajay Mandlekar, Soroush Nasiriany, Mandlekar, Ajay +13 · 132 citations
Engineering · Computer Science · #Robot Manipulation and Learning #Human Pose and Action Recognition #Reinforcement Learning in Robotics
- Visual7W: Grounded Question Answering in Images
2015/11/11 by Yuke Zhu, Oliver Groth, Zhu, Yuke +6 · 61 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Neural and Evolutionary Computing (cs.NE) #cs.CV #cs.LG #cs.NE
- RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots
2024/06/04 by Soroush Nasiriany, Abhiram Maddukuri, Nasiriany, Soroush +13 · 127 citations
Engineering · Computer Science · #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics #Robot Manipulation and Learning
- Foundation Models in Robotics: Applications, Challenges, and the Future
2023/12/13 by Roya Firoozi, Johnathan Tucker, Firoozi, Roya +27 · 97 citations
Computer Science · #Advanced Neural Network Applications #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Robotics (cs.RO) #Topic Modeling
- MimicPlay: Long-Horizon Imitation Learning by Watching Human Play
2023/02/24 by Chen Wang, Linxi Fan, Wang, Chen +13 · 75 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitation
2018/11/07 by Ajay Mandlekar, Yuke Zhu, Mandlekar, Ajay +21 · 47 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Modular Robots and Swarm Intelligence #Robot Manipulation and Learning #Robotics (cs.RO) #Soft Robotics and Applications
- LongVILA: Scaling Long-Context Visual Language Models for Long Videos
2024/08/19 by Yukang Chen, Fuzhao Xue, Chen, Yukang +33 · 122 citations
Computer Science · #Video Analysis and Summarization #Image Retrieval and Classification Techniques #Multimodal Machine Learning Applications
- DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion
2019/01/15 by Chen Wang, Wang, Chen, Danfei Xu +11 · 43 citations
Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robot Manipulation and Learning #Robotics (cs.RO) #Robotics and Sensor-Based Localization #Soft Robotics and Applications
- PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs
2024/02/12 by Soroush Nasiriany, Nasiriany, Soroush, Fei Xia +43 · 82 citations
Engineering · #Elevator Systems and Control
- MultiBench: Multiscale Benchmarks for Multimodal Representation Learning
2021/07/15 by Paul Pu Liang, Yiwei Lyu, Liang, Paul Pu +21 · 38 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia (cs.MM) #Multimodal Machine Learning Applications #Topic Modeling
- Ditto: Building Digital Twins of Articulated Objects from Interaction
2022/02/16 by Zhenyu Jiang, Cheng-Chun Hsu, Jiang, Zhenyu +3 · 38 citations
Computer Science · Earth and Planetary Sciences · #3D Surveying and Cultural Heritage #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Robotics (cs.RO)
- VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priors
2022/10/20 by Yifeng Zhu, Abhishek Joshi, Zhu, Yifeng +5 · 43 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Robot Manipulation and Learning #Robotics (cs.RO)
- Robot Learning on the Job: Human-in-the-Loop Autonomy and Learning During Deployment
2022/11/15 by Huihan Liu, Soroush Nasiriany, Liu, Huihan +7 · 43 citations
Computer Science · Psychology · #Age of Information Optimization #Human-Automation Interaction and Safety #Reinforcement Learning in Robotics
- Pre-Trained Language Models for Interactive Decision-Making
2022/02/03 by Shuang Li, Li, Shuang, Xavier Puig +25 · 35 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- Making Sense of Vision and Touch: Self-Supervised Learning of Multimodal\n Representations for Contact-Rich Tasks
2018/10/24 by Michelle A. Lee, Lee, Michelle A., Yuke Zhu +12 · 25 citations
Computer Science · Engineering · Neuroscience · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO) #Tactile and Sensory Interactions
- Making Sense of Vision and Touch: Learning Multimodal Representations\n for Contact-Rich Tasks
2019/07/27 by Michelle A. Lee, Lee, Michelle A., Yuke Zhu +14 · 25 citations
Engineering · Computer Science · Neuroscience · #Robot Manipulation and Learning #Reinforcement Learning in Robotics #Tactile and Sensory Interactions
- ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills
2025/02/03 by Tairan He, He, Tairan, Jiawei Gao +32 · 92 citations
Computer Science · #Context-Aware Activity Recognition Systems
- Bottom-Up Skill Discovery from Unsegmented Demonstrations for Long-Horizon Robot Manipulation
2021/09/28 by Yifeng Zhu, Zhu, Yifeng, Peter Stone +3 · 27 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learning
2024/10/31 by Zhenyu Jiang, Yuqi Xie, Jiang, Zhenyu +13 · 65 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mechanics and Biomechanics Studies #Robot Manipulation and Learning #Robotics (cs.RO) #Virtual Reality Applications and Impacts
- Learning and Retrieval from Prior Data for Skill-based Imitation Learning
2022/10/20 by Soroush Nasiriany, Nasiriany, Soroush, Tian Gao +5 · 27 citations
Computer Science · Engineering · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Reinforcement and Imitation Learning for Diverse Visuomotor Skills
2018/02/26 by Yuke Zhu, Zhu, Yuke, Ziyu Wang +19 · 28 citations
Computer Science · Engineering · #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- HOVER: Versatile Neural Whole-Body Controller for Humanoid Robots
2024/10/28 by Tairan He, He, Tairan, Wenli Xiao +21 · 61 citations
Engineering · #FOS: Computer and information sciences #Prosthetics and Rehabilitation Robotics #Robotic Locomotion and Control #Robotics (cs.RO)
- KETO: Learning Keypoint Representations for Tool Manipulation
2019/10/26 by Zengyi Qin, Kuan Fang, Qin, Zengyi +7 · 18 citations
Engineering · Computer Science · #Robot Manipulation and Learning #Human Pose and Action Recognition #Human Motion and Animation
- Human-in-the-Loop Imitation Learning using Remote Teleoperation
2020/12/12 by Ajay Mandlekar, Danfei Xu, Mandlekar, Ajay +9 · 19 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Deep Imitation Learning for Humanoid Loco-manipulation through Human Teleoperation
2023/09/05 by Mingyo Seo, Seo, Mingyo, Steve Han +11 · 26 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Human Motion and Animation #Human Pose and Action Recognition #Robotic Locomotion and Control #Robotics (cs.RO)
- Learning Task-Oriented Grasping for Tool Manipulation from Simulated Self-Supervision
2018/06/25 by Kuan Fang, Fang, Kuan, Yuke Zhu +11 · 15 citations
Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Muscle activation and electromyography studies #Robot Manipulation and Learning #Robotics (cs.RO) #Soft Robotics and Applications
- MUTEX: Learning Unified Policies from Multimodal Task Specifications
2023/09/25 by Rutav Shah, Shah, Rutav, Roberto Martín-Martín +3 · 24 citations
Computer Science · #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Robotics (cs.RO) #Topic Modeling
- LOTUS: Continual Imitation Learning for Robot Manipulation Through Unsupervised Skill Discovery
2023/11/03 by Weikang Wan, Yifeng Zhu, Wan, Weikang +5 · 22 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robot Manipulation and Learning #Robotics (cs.RO)
- Causal Dynamics Learning for Task-Independent State Abstraction
2022/06/27 by Zizhao Wang, Wang, Zizhao, Xuesu Xiao +7 · 15 citations
Computer Science · Neuroscience · #Reinforcement Learning in Robotics #Age of Information Optimization #EEG and Brain-Computer Interfaces
- DrEureka: Language Model Guided Sim-To-Real Transfer
2024/06/04 by Yecheng Jason Ma, William Liang, Ma, Yecheng Jason +13 · 26 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Semantic Web and Ontologies
- OKAMI: Teaching Humanoid Robots Manipulation Skills through Single Video Imitation
2024/10/15 by Jinhan Li, Yifeng Zhu, Li, Jinhan +11 · 33 citations
Engineering · Computer Science · #Robotic Locomotion and Control #Robotics and Automated Systems #Educational Robotics and Engineering
- Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations
2021/04/04 by Zhenyu Jiang, Yifeng Zhu, Jiang, Zhenyu +7 · 13 citations
Engineering · #Robot Manipulation and Learning #Muscle activation and electromyography studies #Soft Robotics and Applications
- DreamGen: Unlocking Generalization in Robot Learning through Video World Models
2025/05/19 by Joel Jang, Seonghyeon Ye, Jang, Joel +52 · 48 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robotics (cs.RO)
- Learning Generalizable Manipulation Policies with Object-Centric 3D Representations
2023/10/22 by Yifeng Zhu, Zhenyu Jiang, Zhu, Yifeng +5 · 19 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics (cs.RO)
- Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learning
2025/01/03 by Zhaoyuan Gu, Junheng Li, Gu, Zhaoyuan +32 · 42 citations
Engineering · #FOS: Computer and information sciences #Robotic Locomotion and Control #Robotics (cs.RO)
- 6-PACK: Category-level 6D Pose Tracker with Anchor-Based Keypoints
2019/10/23 by Chen Wang, Wang, Chen, Roberto Martín-Martín +13 · 10 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Robot Manipulation and Learning #Robotics (cs.RO) #Robotics and Sensor-Based Localization
- Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Tasks
2021/10/07 by Soroush Nasiriany, Nasiriany, Soroush, Huihan Liu +3 · 12 citations
Computer Science · Engineering · #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Adversarial Robustness in Machine Learning
- Target-driven visual navigation in indoor scenes using deep reinforcement learning
2017/05/01 by Yuke Zhu, Roozbeh Mottaghi, Eric Kolve +4 · 1 voice · 12 citations
Computer Science · Engineering · #Advanced Vision and Imaging #Reinforcement Learning in Robotics #Robotics and Sensor-Based Localization
- Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perception
2023/02/02 by Cheng-Chun Hsu, Zhenyu Jiang, Hsu, Cheng-Chun +3 · 15 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Robotics (cs.RO)
- Sim-to-Real Reinforcement Learning for Vision-Based Dexterous Manipulation on Humanoids
2025/02/27 by Toru Lin, Lin, Toru, Kartik Sachdev +7 · 1 voice · 36 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Robotics (cs.RO) #Systems and Control (eess.SY) #cs.AI #cs.CV #cs.LG #cs.RO #eess.SY #electronic engineering #information engineering
- InterPreT: Interactive Predicate Learning from Language Feedback for Generalizable Task Planning
2024/05/30 by Muzhi Han, Yifeng Zhu, Han, Muzhi +7 · 19 citations
Computer Science · #FOS: Computer and information sciences #Natural Language Processing Techniques #Robotics (cs.RO) #Speech and dialogue systems #Topic Modeling
- Few-View Object Reconstruction with Unknown Categories and Camera Poses
2022/12/08 by Hanwen Jiang, Jiang, Hanwen, Zhenyu Jiang +5 · 12 citations
Computer Science · Earth and Planetary Sciences · Engineering · #3D Surveying and Cultural Heritage #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics and Sensor-Based Localization
- Bongard-LOGO: A New Benchmark for Human-Level Concept Learning and Reasoning
2020/10/02 by Weili Nie, Nie, Weili, Zhiding Yu +9 · 9 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Machine Learning and Data Classification
- RT-Affordance: Affordances are Versatile Intermediate Representations for Robot Manipulation
2024/11/05 by Soroush Nasiriany, Sean Kirmani, Nasiriany, Soroush +13 · 24 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computability, Logic, AI Algorithms #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Visual Semantic Planning using Deep Successor Representations
2017/05/23 by Yuke Zhu, Daniel Gordon, Zhu, Yuke +13 · 1 voice · 2 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO) #cs.CV #cs.LG #cs.RO
- One-Step Diffusion Policy: Fast Visuomotor Policies via Diffusion Distillation
2024/10/28 by Zhendong Wang, Wang, Zhendong, Zhaoshuo Li +21 · 23 citations
Engineering · Physics and Astronomy · #Advanced Thermodynamics and Statistical Mechanics #FOS: Computer and information sciences #Machine Learning (cs.LG) #Process Optimization and Integration #Robotics (cs.RO)
- Neural Task Graphs: Generalizing to Unseen Tasks from a Single Video Demonstration
2018/07/10 by De-An Huang, Huang, De-An, Suraj Nair +13 · 8 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics (cs.RO)
- Adversarial Skill Chaining for Long-Horizon Robot Manipulation via Terminal State Regularization
2021/11/15 by Youngwoon Lee, Joseph J. Lim, Lee, Youngwoon +5 · 8 citations
Computer Science · Engineering · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Model-Based Runtime Monitoring with Interactive Imitation Learning
2023/10/26 by Huihan Liu, Liu, Huihan, Shivin Dass +5 · 12 citations
Computer Science · #Anomaly Detection Techniques and Applications #Software System Performance and Reliability #Context-Aware Activity Recognition Systems
- Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactions
2022/05/27 by Huaizu Jiang, Jiang, Huaizu, Xiaojian Ma +9 · 8 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Visual Attention and Saliency Detection
- Coach-Player Multi-Agent Reinforcement Learning for Dynamic Team Composition
2021/05/18 by Бо Лю, Qiang Liu, Liu, Bo +9 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Mobile Crowdsensing and Crowdsourcing #Multi-Agent Systems and Negotiation #Reinforcement Learning in Robotics
- SECANT: Self-Expert Cloning for Zero-Shot Generalization of Visual Policies
2021/06/17 by Linxi Fan, Guanzhi Wang, Fan, Linxi +11 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robotics (cs.RO)
- Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning
2023/02/09 by Zhuolin Yang, Yang, Zhuolin, Ping, Wei +28 · 8 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision
2021/05/13 by Shiyi Lan, Lan, Shiyi, Zhiding Yu +13 · 6 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- DualSMC: Tunneling Differentiable Filtering and Planning under Continuous POMDPs
2019/09/28 by Yunbo Wang, Bo Liu, Wang, Yunbo +11 · 7 citations
Computer Science · #Adversarial Robustness in Machine Learning #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning
- Neural Task Programming: Learning to Generalize Across Hierarchical Tasks
2017/10/04 by Danfei Xu, Xu, Danfei, Suraj Nair +11 · 4 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Causal Induction from Visual Observations for Goal Directed Tasks
2019/10/03 by Suraj Nair, Nair, Suraj, Yuke Zhu +5 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics
- Building a Large-scale Multimodal Knowledge Base System for Answering Visual Queries
2015/07/20 by Yuke Zhu, Zhu, Yuke, Ce Zhang +5 · 7 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #cs.CV #cs.LG
- FLARE: Robot Learning with Implicit World Modeling
2025/05/21 by Ruijie Zheng, Zheng, Ruijie, Jing Wang +39 · 21 citations
Computer Science · #Reinforcement Learning in Robotics
- Multi-Task Interactive Robot Fleet Learning with Visual World Models
2024/10/30 by Huihan Liu, Yu Zhang, Liu, Huihan +9 · 13 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Metaheuristic Optimization Algorithms Research #Optimization and Search Problems #Robotic Path Planning Algorithms #Robotics (cs.RO)
- Deep Affordance Foresight: Planning Through What Can Be Done in the Future
2020/11/17 by Danfei Xu, Xu, Danfei, Ajay Mandlekar +9 · 5 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Machine Learning and Algorithms #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Tesseract: Tensorised Actors for Multi-Agent Reinforcement Learning
2021/05/31 by Anuj Mahajan, Mahajan, Anuj, Mikayel Samvelyan +15 · 5 citations
Engineering · Mathematics · Physics and Astronomy · #FOS: Computer and information sciences #Lattice Boltzmann Simulation Studies #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Tensor decomposition and applications
- Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptions
2024/10/16 by Zhenyu Jiang, Jiang, Zhenyu, Yuqi Xie +9 · 10 citations
Engineering · Computer Science · Psychology · #Human Motion and Animation #Human Pose and Action Recognition #Social Robot Interaction and HRI
- QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
2025/02/07 by Yue Zhao, Zhao, Yue, Fuzhao Xue +15 · 15 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Speech and dialogue systems
- Situational Fusion of Visual Representation for Visual Navigation
2019/08/24 by Bokui Shen, Danfei Xu, Shen, Bokui +9 · 3 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Granger Causal Interaction Skill Chains
2023/06/15 by Caleb Chuck, Kevin Black, Chuck, Caleb +7 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Educational Technology and Assessment #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Robotics (cs.RO)
- FocusLLaVA: A Coarse-to-Fine Approach for Efficient and Effective Visual Token Compression
2024/11/21 by Yuke Zhu, Chi Xie, Zhu, Yuke +7 · 8 citations
Computer Science · #Advanced Vision and Imaging #Advanced Image and Video Retrieval Techniques #Image and Video Stabilization
- World Simulation with Video Foundation Models for Physical AI
2025/10/28 by Nvidia Nvidia, NVIDIA, : +170 · 18 citations
Computer Science · #Multimodal Machine Learning Applications #Generative Adversarial Networks and Image Synthesis #Reinforcement Learning in Robotics
- AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformers
2024/11/17 by Jake Grigsby, Justin Sasek, Grigsby, Jake +9 · 8 citations
Computer Science · Engineering · #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics
- Building Minimal and Reusable Causal State Abstractions for Reinforcement Learning
2024/01/23 by Zizhao Wang, Caroline Wang, Wang, Zizhao +7 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Data Stream Mining Techniques #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #I.2.6 #I.2.8 #I.2.9 #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robotics (cs.RO)
- PRESTO: Fast Motion Planning Using Diffusion Models Based on Key-Configuration Environment Representation
2024/09/24 by Seo, Mingyo, Yoonyoung Cho, Yoonchang Sung +8 · 6 citations
Computer Science · Decision Sciences · Engineering · #FOS: Computer and information sciences #Human Motion and Animation #Reinforcement Learning in Robotics #Robotics (cs.RO) #Simulation Techniques and Applications
- Action Recognition by Hierarchical Mid-level Action Elements
2015/08/31 by Tian Lan, Lan, Tian, Yuke Zhu +6 · 3 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Hand Gesture Recognition Systems #Human Pose and Action Recognition #Multimodal Machine Learning Applications #cs.CV
- SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control
2025/11/11 by Zhengyi Luo, Luo, Zhengyi, Ye Yuan +51 · 1 voice · 12 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Graphics (cs.GR) #Robotics (cs.RO) #Systems and Control (eess.SY) #cs.AI #cs.CV #cs.GR #cs.RO #eess.SY #electronic engineering #information engineering
- FORTE: Tactile Force and Slip Sensing on Compliant Fingers for Delicate Manipulation
2025/06/23 by Siqi Shang, Mingyo Seo, Shang, Siqi +5 · 1 voice
Engineering · #FOS: Computer and information sciences #Robotics (cs.RO)
- Regression Planning Networks
2019/09/28 by Danfei Xu, Xu, Danfei, Roberto Martín-Martín +9 · 2 citations
Computer Science · #Human Pose and Action Recognition #Multimodal Machine Learning Applications #AI-based Problem Solving and Planning
- Cross-Episodic Curriculum for Transformer Agents
2023/10/12 by Lucy Xiaoyang Shi, Shi, Lucy Xiaoyang, Yunfan Jiang +7 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robotics (cs.RO)
- PRIME: Scaffolding Manipulation Tasks with Behavior Primitives for Data-Efficient Imitation Learning
2024/03/01 by Tian Gao, Soroush Nasiriany, Gao, Tian +7 · 4 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Learning to Walk by Steering: Perceptive Quadrupedal Locomotion in Dynamic Environments
2022/09/19 by Mingyo Seo, Ryan Gupta, Seo, Mingyo +9 · 2 citations
Computer Science · Engineering · #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #Evacuation and Crowd Dynamics #FOS: Computer and information sciences #Robotic Locomotion and Control #Robotics (cs.RO)
- GraspMolmo: Generalizable Task-Oriented Grasping via Large-Scale Synthetic Data Generation
2025/05/19 by A. Deshpande, Deshpande, Abhay, Deng, Yuquan +16 · 8 citations
Engineering · Neuroscience · Psychology · #Robot Manipulation and Learning #Motor Control and Adaptation #Action Observation and Synchronization
- ADAPT: Zero-Shot Adaptive Policy Transfer for Stochastic Dynamical\n Systems
2017/07/14 by J. Harrison, Harrison, James, Animesh Garg +11 · 1 citation
Computer Science · Engineering · #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Nuclear reactor physics and engineering #Robotics (cs.RO) #Topic Modeling
- Doduo: Learning Dense Visual Correspondence from Unsupervised Semantic-Aware Flow
2023/09/26 by Zhenyu Jiang, Hanwen Jiang, Jiang, Zhenyu +3 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Robotics (cs.RO)
- ARDuP: Active Region Video Diffusion for Universal Policies
2024/06/19 by Shuaiyi Huang, Mara Levy, Huang, Shuaiyi +13 · 4 citations
Computer Science · #Advanced Image Processing Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image and Signal Denoising Methods #Robotics (cs.RO) #Video Coding and Compression Technologies
- Adaptive Procedural Task Generation for Hard-Exploration Problems
2020/07/01 by Kuan Fang, Fang, Kuan, Yuke Zhu +5 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics #Robotics (cs.RO)
- Self-Improving Vision-Language-Action Models with Data Generation via Residual RL
2025/10/30 by Wenli Xiao, Xiao, Wenli, Haotian Lin +20 · 7 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Reinforcement Learning in Robotics
- Learning a Contact-Adaptive Controller for Robust, Efficient Legged Locomotion
2020/09/21 by Xingye Da, Zhaoming Xie, Da, Xingye +13 · 2 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotic Locomotion and Control #Robotics (cs.RO)
- SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learning
2025/05/28 by Shengdong Zhang, Yuqi Xie, Zhang, Yu +11 · 5 citations
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Music and Audio Processing #Natural Language Processing Techniques #Robotics (cs.RO)
- OSCAR: Data-Driven Operational Space Control for Adaptive and Robust Robot Manipulation
2021/10/02 by Josiah Wong, Viktor Makoviychuk, Wong, Josiah +5 · 1 citation
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Fast Monocular Scene Reconstruction with Global-Sparse Local-Dense Grids
2023/05/22 by Wei Dong, Dong, Wei, Chris Choy +9 · 1 citation
Computer Science · Engineering · #Advanced Vision and Imaging #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics and Sensor-Based Localization
- The PokeAgent Challenge: Competitive and Long-Context Learning at Scale
2026/03/16 by Seth Karten, Jake Grigsby, Tersoo Upaa +28 · 2 voices
Computer Science · #cs.AI #cs.LG
- An AI-aided algorithm for multivariate polynomial reconstruction on Cartesian grids and the PLG finite difference method
2024/08/07 by Qinghai Zhang, Yuke Zhu, Zhang, Qinghai +3 · 3 citations
Earth and Planetary Sciences · Engineering · #Advanced Numerical Analysis Techniques #FOS: Mathematics #Geological Modeling and Analysis #Medical Imaging and Analysis #Numerical Analysis (math.NA)
- MimicDroid: In-Context Learning for Humanoid Robot Manipulation from Human Play Videos
2025/09/11 by Rutav Shah, Shah, Rutav, Shuijing Liu +13 · 5 citations
Computer Science · #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Robotics (cs.RO) #Video Surveillance and Tracking Methods
- Human-Level Competitive Pokémon via Scalable Offline Reinforcement Learning with Transformers
2025/04/06 by Jake Grigsby, Grigsby, Jake, Yuqi Xie +7 · 1 citation
Computer Science · Social Sciences · #Artificial Intelligence in Games #Digital Games and Media #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics
- Opening the Sim-to-Real Door for Humanoid Pixel-to-Action Policy Transfer
2025/11/30 by Haoru Xue, Tairan He, Xue, Haoru +21 · 2 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation #Human Pose and Action Recognition #Robot Manipulation and Learning #Robotics (cs.RO)
- Beyond Episodic Evaluation: Memory Architectural Bottlenecks in Sequential Embodied Question Answering
2026/07/23 by Zikui Cai, Kaushal Janga, Tan Dat Dao +15
Computer Science · #cs.RO