vix.ing · top · new · best · stats · spec

Zhu, Yuke

  1. Voyager: An Open-Ended Embodied Agent with Large Language Models
    2023/05/25 by Wang, Guanzhi, Xie, Yuqi, Jiang, Yunfan +5 · 5 voices · 245 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  2. Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
    2016/02/23 by Ranjay Krishna, Krishna, Ranjay, Yuke Zhu +21 · 212 citations
    Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Image Retrieval and Classification Techniques
  3. LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning
    2023/06/05 by Bo Liu, Liu, Bo, Yifeng Zhu +11 · 282 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications
  4. AI2-THOR: An Interactive 3D Environment for Visual AI
    2017/12/14 by Eric Kolve, Kolve, Eric, Roozbeh Mottaghi +12 · 133 citations
    Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
  5. Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning
    2016/09/16 by Yuke Zhu, Roozbeh Mottaghi, Zhu, Yuke +11 · 2 voices · 36 citations
    Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #cs.CV
  6. DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset
    2024/03/19 by Khazatsky, Alexander, Pertsch, Karl, Nair, Suraj +98 · 206 citations
    #FOS: Computer and information sciences #Robotics (cs.RO)
  7. Open X-Embodiment: Robotic Learning Datasets and RT-X Models
    2023/10/13 by Embodiment Collaboration, O'Neill, Abby, Rehman, Abdul +349 · 175 citations
    Computer Science · Engineering · #FOS: Computer and information sciences #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
  8. What Matters in Learning from Offline Human Demonstrations for Robot Manipulation
    2021/08/06 by Mandlekar, Ajay, Xu, Danfei, Wong, Josiah +7 · 107 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
  9. Multi-Stage Learning for Grasp-Constrained Object Manipulation with a Simulated Panda Robot
    2020/09/25 by Yuke Zhu, Josiah Wong, Zhu, Yuke +15 · 80 citations
    Computer Science · Engineering · #Reinforcement Learning in Robotics #Modular Robots and Swarm Intelligence #Robot Manipulation and Learning
  10. GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
    2025/03/18 by Nvidia Nvidia, NVIDIA, : +80 · 261 citations
    Engineering · Computer Science · #Robotic Locomotion and Control #Robotic Path Planning Algorithms #Reinforcement Learning in Robotics
  11. MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations
    2023/10/26 by Ajay Mandlekar, Soroush Nasiriany, Mandlekar, Ajay +13 · 90 citations
    Engineering · Computer Science · #Robot Manipulation and Learning #Human Pose and Action Recognition #Reinforcement Learning in Robotics
  12. VIMA: General Robot Manipulation with Multimodal Prompts
    2022/10/06 by Jiang, Yunfan, Gupta, Agrim, Zhang, Zichen +7 · 69 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
  13. Eureka: Human-Level Reward Design via Coding Large Language Models
    2023/10/19 by Yecheng Jason Ma, William Liang, Ma, Yecheng Jason +15 · 82 citations
    Computer Science · Materials Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Materials Science #Reinforcement Learning in Robotics #Robotics (cs.RO) #Software Engineering Research
  14. Visual7W: Grounded Question Answering in Images
    2015/11/11 by Yuke Zhu, Oliver Groth, Zhu, Yuke +5 · 38 citations
    Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Neural and Evolutionary Computing (cs.NE)
  15. MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
    2022/06/17 by Fan, Linxi, Wang, Guanzhi, Jiang, Yunfan +7 · 60 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  16. Scene Graph Generation by Iterative Message Passing
    2017/01/10 by Danfei Xu, Yuke Zhu, Xu, Danfei +5 · 47 citations
    Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Image Retrieval and Classification Techniques
  17. RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots
    2024/06/04 by Soroush Nasiriany, Abhiram Maddukuri, Nasiriany, Soroush +13 · 83 citations
    Engineering · Computer Science · #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics #Robot Manipulation and Learning
  18. MimicPlay: Long-Horizon Imitation Learning by Watching Human Play
    2023/02/24 by Chen Wang, Wang, Chen, Linxi Fan +13 · 49 citations
    Computer Science · Engineering · #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
  19. LongVILA: Scaling Long-Context Visual Language Models for Long Videos
    2024/08/19 by Yukang Chen, Chen, Yukang, Fuzhao Xue +33 · 76 citations
    Computer Science · #Video Analysis and Summarization #Image Retrieval and Classification Techniques #Multimodal Machine Learning Applications
  20. Foundation Models in Robotics: Applications, Challenges, and the Future
    2023/12/13 by Roya Firoozi, Johnathan Tucker, Firoozi, Roya +27 · 55 citations
    Computer Science · #Advanced Neural Network Applications #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Robotics (cs.RO) #Topic Modeling
  21. RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitation
    2018/11/07 by Mandlekar, Ajay, Zhu, Yuke, Garg, Animesh +9 · 28 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
  22. DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion
    2019/01/15 by Chen Wang, Wang, Chen, Danfei Xu +11 · 26 citations
    Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robot Manipulation and Learning #Robotics (cs.RO) #Robotics and Sensor-Based Localization #Soft Robotics and Applications
  23. Ditto: Building Digital Twins of Articulated Objects from Interaction
    2022/02/16 by Jiang, Zhenyu, Hsu, Cheng-Chun, Zhu, Yuke · 29 citations
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO)
  24. PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs
    2024/02/12 by Soroush Nasiriany, Nasiriany, Soroush, Fei Xia +43 · 45 citations
    Engineering · #Elevator Systems and Control
  25. MultiBench: Multiscale Benchmarks for Multimodal Representation Learning
    2021/07/15 by Liang, Paul Pu, Lyu, Yiwei, Fan, Xiang +9 · 27 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia (cs.MM)
  26. Making Sense of Vision and Touch: Self-Supervised Learning of Multimodal\n Representations for Contact-Rich Tasks
    2018/10/24 by Michelle A. Lee, Lee, Michelle A., Yuke Zhu +12 · 19 citations
    Computer Science · Engineering · Neuroscience · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO) #Tactile and Sensory Interactions
  27. Robot Learning on the Job: Human-in-the-Loop Autonomy and Learning During Deployment
    2022/11/15 by Huihan Liu, Liu, Huihan, Soroush Nasiriany +7 · 25 citations
    Computer Science · Psychology · #Age of Information Optimization #Human-Automation Interaction and Safety #Reinforcement Learning in Robotics
  28. VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priors
    2022/10/20 by Zhu, Yifeng, Joshi, Abhishek, Stone, Peter +1 · 23 citations
    #FOS: Computer and information sciences #Robotics (cs.RO)
  29. Making Sense of Vision and Touch: Learning Multimodal Representations\n for Contact-Rich Tasks
    2019/07/27 by Michelle A. Lee, Yuke Zhu, Lee, Michelle A. +14 · 16 citations
    Engineering · Computer Science · Neuroscience · #Robot Manipulation and Learning #Reinforcement Learning in Robotics #Tactile and Sensory Interactions
  30. DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learning
    2024/10/31 by Zhenyu Jiang, Yuqi Xie, Jiang, Zhenyu +13 · 47 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mechanics and Biomechanics Studies #Robot Manipulation and Learning #Robotics (cs.RO) #Virtual Reality Applications and Impacts
  31. Bottom-Up Skill Discovery from Unsegmented Demonstrations for Long-Horizon Robot Manipulation
    2021/09/28 by Yifeng Zhu, Peter Stone, Zhu, Yifeng +3 · 19 citations
    Computer Science · Engineering · #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
  32. Learning and Retrieval from Prior Data for Skill-based Imitation Learning
    2022/10/20 by Soroush Nasiriany, Tian Gao, Nasiriany, Soroush +5 · 21 citations
    Computer Science · Engineering · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
  33. ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills
    2025/02/03 by Tairan He, Jiawei Gao, He, Tairan +32 · 58 citations
    Computer Science · #Context-Aware Activity Recognition Systems
  34. Pre-Trained Language Models for Interactive Decision-Making
    2022/02/03 by Shuang Li, Xavier Puig, Li, Shuang +25 · 17 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques
  35. Hierarchical Planning for Long-Horizon Manipulation with Geometric and Symbolic Scene Graphs
    2020/12/14 by Zhu, Yifeng, Tremblay, Jonathan, Birchfield, Stan +1 · 13 citations
    #FOS: Computer and information sciences #Robotics (cs.RO)
  36. HOVER: Versatile Neural Whole-Body Controller for Humanoid Robots
    2024/10/28 by Tairan He, He, Tairan, Wenli Xiao +21 · 33 citations
    Engineering · #FOS: Computer and information sciences #Prosthetics and Rehabilitation Robotics #Robotic Locomotion and Control #Robotics (cs.RO)
  37. DreamGen: Unlocking Generalization in Robot Learning through Video World Models
    2025/05/19 by Joel Jang, Seonghyeon Ye, Jang, Joel +52 · 44 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robotics (cs.RO)
  38. Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Tasks
    2021/10/07 by Soroush Nasiriany, Nasiriany, Soroush, Huihan Liu +3 · 11 citations
    Computer Science · Engineering · #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Adversarial Robustness in Machine Learning
  39. MUTEX: Learning Unified Policies from Multimodal Task Specifications
    2023/09/25 by Shah, Rutav, Martín-Martín, Roberto, Zhu, Yuke · 16 citations
    #FOS: Computer and information sciences #Robotics (cs.RO)
  40. OKAMI: Teaching Humanoid Robots Manipulation Skills through Single Video Imitation
    2024/10/15 by Jinhan Li, Li, Jinhan, Yifeng Zhu +11 · 25 citations
    Engineering · Computer Science · #Robotic Locomotion and Control #Robotics and Automated Systems #Educational Robotics and Engineering
  41. KETO: Learning Keypoint Representations for Tool Manipulation
    2019/10/26 by Zengyi Qin, Qin, Zengyi, Kuan Fang +7 · 9 citations
    Engineering · Computer Science · #Robot Manipulation and Learning #Human Pose and Action Recognition #Human Motion and Animation
  42. Deep Imitation Learning for Humanoid Loco-manipulation through Human Teleoperation
    2023/09/05 by Mingyo Seo, Seo, Mingyo, Steve Han +11 · 13 citations
    Computer Science · Engineering · #FOS: Computer and information sciences #Human Motion and Animation #Human Pose and Action Recognition #Robotic Locomotion and Control #Robotics (cs.RO)
  43. Human-in-the-Loop Imitation Learning using Remote Teleoperation
    2020/12/12 by Mandlekar, Ajay, Xu, Danfei, Martín-Martín, Roberto +3 · 8 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
  44. 6-PACK: Category-level 6D Pose Tracker with Anchor-Based Keypoints
    2019/10/23 by Wang, Chen, Martín-Martín, Roberto, Xu, Danfei +5 · 7 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO)
  45. LOTUS: Continual Imitation Learning for Robot Manipulation Through Unsupervised Skill Discovery
    2023/11/03 by Wan, Weikang, Zhu, Yifeng, Shah, Rutav +1 · 13 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
  46. Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learning
    2025/01/03 by Zhaoyuan Gu, Gu, Zhaoyuan, Junheng Li +32 · 24 citations
    Engineering · #FOS: Computer and information sciences #Robotic Locomotion and Control #Robotics (cs.RO)
  47. Learning Generalizable Manipulation Policies with Object-Centric 3D Representations
    2023/10/22 by Yifeng Zhu, Zhenyu Jiang, Zhu, Yifeng +5 · 11 citations
    Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics (cs.RO)
  48. Learning Task-Oriented Grasping for Tool Manipulation from Simulated Self-Supervision
    2018/06/25 by Kuan Fang, Yuke Zhu, Fang, Kuan +11 · 6 citations
    Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Muscle activation and electromyography studies #Robot Manipulation and Learning #Robotics (cs.RO) #Soft Robotics and Applications
  49. Sim-to-Real Reinforcement Learning for Vision-Based Dexterous Manipulation on Humanoids
    2025/02/27 by Lin, Toru, Sachdev, Kartik, Fan, Linxi +2 · 25 citations
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Robotics (cs.RO) #Systems and Control (eess.SY) #electronic engineering #information engineering
  50. Bongard-LOGO: A New Benchmark for Human-Level Concept Learning and Reasoning
    2020/10/02 by Weili Nie, Nie, Weili, Zhiding Yu +9 · 6 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Machine Learning and Data Classification
  51. One-Step Diffusion Policy: Fast Visuomotor Policies via Diffusion Distillation
    2024/10/28 by Zhendong Wang, Wang, Zhendong, Zhaoshuo Li +21 · 16 citations
    Engineering · Physics and Astronomy · #Advanced Thermodynamics and Statistical Mechanics #FOS: Computer and information sciences #Machine Learning (cs.LG) #Process Optimization and Integration #Robotics (cs.RO)
  52. RT-Affordance: Affordances are Versatile Intermediate Representations for Robot Manipulation
    2024/11/05 by Soroush Nasiriany, Sean Kirmani, Nasiriany, Soroush +13 · 16 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computability, Logic, AI Algorithms #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
  53. Reinforcement and Imitation Learning for Diverse Visuomotor Skills
    2018/02/26 by Yuke Zhu, Ziyu Wang, Zhu, Yuke +19 · 5 citations
    Computer Science · Engineering · #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
  54. Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulation
    2025/03/31 by Maddukuri, Abhiram, Jiang, Zhenyu, Chen, Lawrence Yunliang +12 · 22 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
  55. Adversarial Skill Chaining for Long-Horizon Robot Manipulation via Terminal State Regularization
    2021/11/15 by Lee, Youngwoon, Lim, Joseph J., Anandkumar, Anima +1 · 6 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
  56. DrEureka: Language Model Guided Sim-To-Real Transfer
    2024/06/04 by Yecheng Jason Ma, Ma, Yecheng Jason, William Liang +13 · 10 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Semantic Web and Ontologies
  57. Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perception
    2023/02/02 by Cheng-Chun Hsu, Zhenyu Jiang, Hsu, Cheng-Chun +3 · 7 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Robotics (cs.RO)
  58. Causal Dynamics Learning for Task-Independent State Abstraction
    2022/06/27 by Zizhao Wang, Xuesu Xiao, Wang, Zizhao +7 · 6 citations
    Computer Science · Neuroscience · #Reinforcement Learning in Robotics #Age of Information Optimization #EEG and Brain-Computer Interfaces
  59. Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations
    2021/04/04 by Zhenyu Jiang, Jiang, Zhenyu, Yifeng Zhu +7 · 6 citations
    Engineering · #Robot Manipulation and Learning #Muscle activation and electromyography studies #Soft Robotics and Applications
  60. Neural Task Programming: Learning to Generalize Across Hierarchical Tasks
    2017/10/04 by Danfei Xu, Xu, Danfei, Suraj Nair +11 · 4 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
  61. InterPreT: Interactive Predicate Learning from Language Feedback for Generalizable Task Planning
    2024/05/30 by Muzhi Han, Han, Muzhi, Yifeng Zhu +7 · 10 citations
    Computer Science · #FOS: Computer and information sciences #Natural Language Processing Techniques #Robotics (cs.RO) #Speech and dialogue systems #Topic Modeling
  62. Coach-Player Multi-Agent Reinforcement Learning for Dynamic Team Composition
    2021/05/18 by Liu, Bo, Liu, Qiang, Stone, Peter +3 · 5 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
  63. Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning
    2023/02/09 by Zhuolin Yang, Yang, Zhuolin, Ping, Wei +28 · 6 citations
    Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
  64. BUMBLE: Unifying Reasoning and Acting with Vision-Language Models for Building-wide Mobile Manipulation
    2024/10/08 by Shah, Rutav, Yu, Albert, Zhu, Yifeng +2 · 12 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Robotics (cs.RO)
  65. Few-View Object Reconstruction with Unknown Categories and Camera Poses
    2022/12/08 by Jiang, Hanwen, Jiang, Zhenyu, Grauman, Kristen +1 · 6 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  66. Interactive Robot Learning from Verbal Correction
    2023/10/26 by Liu, Huihan, Chen, Alice, Zhu, Yuke +3 · 7 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
  67. Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactions
    2022/05/27 by Jiang, Huaizu, Ma, Xiaojian, Nie, Weili +4 · 5 citations
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  68. Vision-based Manipulation from Single Human Video with Open-World Object Graphs
    2024/05/30 by Zhu, Yifeng, Lim, Arisrei, Stone, Peter +1 · 9 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
  69. SPOT: SE(3) Pose Trajectory Diffusion for Object-Centric Manipulation
    2024/11/01 by Hsu, Cheng-Chun, Wen, Bowen, Xu, Jie +5 · 11 citations
    #FOS: Computer and information sciences #Robotics (cs.RO)
  70. FLARE: Robot Learning with Implicit World Modeling
    2025/05/21 by Ruijie Zheng, Zheng, Ruijie, Jing Wang +39 · 16 citations
    Computer Science · #Reinforcement Learning in Robotics
  71. Neural Task Graphs: Generalizing to Unseen Tasks from a Single Video Demonstration
    2018/07/10 by De-An Huang, Huang, De-An, Suraj Nair +13 · 3 citations
    Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics (cs.RO)
  72. Model-Based Runtime Monitoring with Interactive Imitation Learning
    2023/10/26 by Huihan Liu, Liu, Huihan, Shivin Dass +5 · 5 citations
    Computer Science · #Anomaly Detection Techniques and Applications #Software System Performance and Reliability #Context-Aware Activity Recognition Systems
  73. Multi-Task Interactive Robot Fleet Learning with Visual World Models
    2024/10/30 by Huihan Liu, Yu Zhang, Liu, Huihan +9 · 8 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Metaheuristic Optimization Algorithms Research #Optimization and Search Problems #Robotic Path Planning Algorithms #Robotics (cs.RO)
  74. Learning Multi-Arm Manipulation Through Collaborative Teleoperation
    2020/12/12 by Tung, Albert, Wong, Josiah, Mandlekar, Ajay +4 · 3 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
  75. Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptions
    2024/10/16 by Zhenyu Jiang, Jiang, Zhenyu, Yuqi Xie +9 · 7 citations
    Engineering · Computer Science · Psychology · #Human Motion and Animation #Human Pose and Action Recognition #Social Robot Interaction and HRI
  76. DualSMC: Tunneling Differentiable Filtering and Planning under Continuous POMDPs
    2019/09/28 by Yunbo Wang, Bo Liu, Wang, Yunbo +11 · 4 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning
  77. PRESTO: Fast Motion Planning Using Diffusion Models Based on Key-Configuration Environment Representation
    2024/09/24 by Seo, Mingyo, Cho, Yoonyoung, Sung, Yoonchang +3 · 6 citations
    #FOS: Computer and information sciences #Robotics (cs.RO)
  78. Situational Fusion of Visual Representation for Visual Navigation
    2019/08/24 by Shen, Bokui, Xu, Danfei, Zhu, Yuke +3 · 2 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  79. FocusLLaVA: A Coarse-to-Fine Approach for Efficient and Effective Visual Token Compression
    2024/11/21 by Yuke Zhu, Zhu, Yuke, Chi Xie +7 · 6 citations
    Computer Science · #Advanced Vision and Imaging #Advanced Image and Video Retrieval Techniques #Image and Video Stabilization
  80. QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
    2025/02/07 by Yue Zhao, Fuzhao Xue, Zhao, Yue +15 · 7 citations
    Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Speech and dialogue systems
  81. SECANT: Self-Expert Cloning for Zero-Shot Generalization of Visual Policies
    2021/06/17 by Linxi Fan, Guanzhi Wang, Fan, Linxi +11 · 2 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robotics (cs.RO)
  82. Building Minimal and Reusable Causal State Abstractions for Reinforcement Learning
    2024/01/23 by Wang, Zizhao, Wang, Caroline, Xiao, Xuesu +2 · 3 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #I.2.6 #I.2.8 #I.2.9 #Machine Learning (cs.LG) #Robotics (cs.RO)
  83. DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision
    2021/05/13 by Lan, Shiyi, Yu, Zhiding, Choy, Christopher +5 · 2 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  84. Tesseract: Tensorised Actors for Multi-Agent Reinforcement Learning
    2021/05/31 by Anuj Mahajan, Mikayel Samvelyan, Mahajan, Anuj +15 · 3 citations
    Engineering · Mathematics · Physics and Astronomy · #FOS: Computer and information sciences #Lattice Boltzmann Simulation Studies #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Tensor decomposition and applications
  85. Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications
    2025/10/08 by Kawaharazuka, Kento, Oh, Jihoon, Yamada, Jun +2 · 16 citations
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
  86. FORTE: Tactile Force and Slip Sensing on Compliant Fingers for Delicate Manipulation
    2025/06/23 by Siqi Shang, Mingyo Seo, Shang, Siqi +5 · 1 voice
    Engineering · #FOS: Computer and information sciences #Robotics (cs.RO)
  87. Regression Planning Networks
    2019/09/28 by Danfei Xu, Xu, Danfei, Roberto Martín-Martín +9 · 2 citations
    Computer Science · #Human Pose and Action Recognition #Multimodal Machine Learning Applications #AI-based Problem Solving and Planning
  88. Isaac Lab: A GPU-Accelerated Simulation Framework for Multi-Modal Robot Learning
    2025/11/06 by NVIDIA, :, Mittal, Mayank +104 · 9 citations
    Engineering · Psychology · #Robot Manipulation and Learning #Human Motion and Animation #Social Robot Interaction and HRI
  89. Deep Affordance Foresight: Planning Through What Can Be Done in the Future
    2020/11/17 by Xu, Danfei, Mandlekar, Ajay, Martín-Martín, Roberto +3 · 2 citations
    #FOS: Computer and information sciences #Robotics (cs.RO)
  90. AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformers
    2024/11/17 by Jake Grigsby, Justin Sasek, Grigsby, Jake +9 · 4 citations
    Computer Science · Engineering · #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics
  91. Granger Causal Interaction Skill Chains
    2023/06/15 by Caleb Chuck, Kevin Black, Chuck, Caleb +7 · 2 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Educational Technology and Assessment #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Robotics (cs.RO)
  92. World Simulation with Video Foundation Models for Physical AI
    2025/10/28 by Nvidia Nvidia, NVIDIA, : +170 · 14 citations
    Computer Science · #Multimodal Machine Learning Applications #Generative Adversarial Networks and Image Synthesis #Reinforcement Learning in Robotics
  93. Wolf: Dense Video Captioning with a World Summarization Framework
    2024/07/26 by Boyi Li, Li, Boyi, Ligeng Zhu +40 · 4 citations
    Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  94. Causal Induction from Visual Observations for Goal Directed Tasks
    2019/10/03 by Suraj Nair, Yuke Zhu, Nair, Suraj +5 · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics
  95. Adaptive Procedural Task Generation for Hard-Exploration Problems
    2020/07/01 by Kuan Fang, Fang, Kuan, Yuke Zhu +5 · 1 citation
    Computer Science · #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics #Robotics (cs.RO)
  96. Emergent Hand Morphology and Control from Optimizing Robust Grasps of Diverse Objects
    2020/12/22 by Pan, Xinlei, Garg, Animesh, Anandkumar, Animashree +1 · 1 citation
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Robotics (cs.RO)
  97. SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learning
    2025/05/28 by Zhang, Yu, Xie, Yuqi, Liu, Huihan +4 · 5 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
  98. OSCAR: Data-Driven Operational Space Control for Adaptive and Robust Robot Manipulation
    2021/10/02 by Wong, Josiah, Makoviychuk, Viktor, Anandkumar, Anima +1 · 1 citation
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
  99. Dynamics Learning with Cascaded Variational Inference for Multi-Step Manipulation
    2019/10/29 by Fang, Kuan, Zhu, Yuke, Garg, Animesh +2 · 1 citation
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
  100. Visually Grounded Task and Motion Planning for Mobile Manipulation
    2022/02/22 by Zhang, Xiaohan, Zhu, Yifeng, Ding, Yan +3 · 2 citations
    #FOS: Computer and information sciences #Robotics (cs.RO)
  101. Learning to Walk by Steering: Perceptive Quadrupedal Locomotion in Dynamic Environments
    2022/09/19 by Seo, Mingyo, Gupta, Ryan, Zhu, Yifeng +3 · 1 citation
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Robotics (cs.RO)
  102. Fast Monocular Scene Reconstruction with Global-Sparse Local-Dense Grids
    2023/05/22 by Dong, Wei, Choy, Chris, Loop, Charles +3 · 1 citation
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  103. GraspMolmo: Generalizable Task-Oriented Grasping via Large-Scale Synthetic Data Generation
    2025/05/19 by A. Deshpande, Deshpande, Abhay, Arijit Ray +16 · 4 citations
    Engineering · Neuroscience · Psychology · #Robot Manipulation and Learning #Motor Control and Adaptation #Action Observation and Synchronization
  104. ARDuP: Active Region Video Diffusion for Universal Policies
    2024/06/19 by Huang, Shuaiyi, Levy, Mara, Jiang, Zhenyu +5 · 2 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO)
  105. Symbolic State Space Optimization for Long Horizon Mobile Manipulation Planning
    2023/07/21 by Zhang, Xiaohan, Zhu, Yifeng, Ding, Yan +4 · 1 citation
    #FOS: Computer and information sciences #Robotics (cs.RO)
  106. Cross-Episodic Curriculum for Transformer Agents
    2023/10/12 by Lucy Xiaoyang Shi, Yunfan Jiang, Shi, Lucy Xiaoyang +7 · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robotics (cs.RO)
  107. Doduo: Learning Dense Visual Correspondence from Unsupervised Semantic-Aware Flow
    2023/09/26 by Jiang, Zhenyu, Jiang, Hanwen, Zhu, Yuke · 1 citation
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO)
  108. Self-Improving Vision-Language-Action Models with Data Generation via Residual RL
    2025/10/30 by Wenli Xiao, Haotian Lin, Xiao, Wenli +20 · 5 citations
    Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Reinforcement Learning in Robotics
  109. MimicDroid: In-Context Learning for Humanoid Robot Manipulation from Human Play Videos
    2025/09/11 by Rutav Shah, Shah, Rutav, Shuijing Liu +13 · 5 citations
    Computer Science · #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Robotics (cs.RO) #Video Surveillance and Tracking Methods
  110. Opening the Sim-to-Real Door for Humanoid Pixel-to-Action Policy Transfer
    2025/11/30 by Xue, Haoru, He, Tairan, Wang, Zi +9 · 2 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO)
  111. Constraint-Preserving Data Generation for Visuomotor Policy Learning
    2025/08/05 by Lin, Kevin, Ragunath, Varun, McAlinden, Andrew +4 · 3 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Robotics (cs.RO)
  112. SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control
    2025/11/11 by Luo, Zhengyi, Yuan, Ye, Wang, Tingwu +23 · 6 citations
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Graphics (cs.GR) #Robotics (cs.RO) #Systems and Control (eess.SY) #electronic engineering #information engineering
  113. VIRAL: Visual Sim-to-Real at Scale for Humanoid Loco-Manipulation
    2025/11/19 by He, Tairan, Wang, Zi, Xue, Haoru +11 · 1 citation
    Engineering · Psychology · #FOS: Computer and information sciences #Robot Manipulation and Learning #Robotic Locomotion and Control #Robotics (cs.RO) #Social Robot Interaction and HRI