Li, Yunzhu
- Open X-Embodiment: Robotic Learning Datasets and RT-X Models
2023/10/13 by Embodiment Collaboration, O'Neill, Abby, Rehman, Abdul +349 · 174 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models
2023/07/12 by Wenlong Huang, Huang, Wenlong, Chen Wang +9 · 130 citations
Computer Science · Engineering · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Robot Manipulation and Learning
- Executable Code Actions Elicit Better LLM Agents
2024/02/01 by Wang, Xingyao, Chen, Yangyi, Yuan, Lifan +4 · 101 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- CLEVRER: CoLlision Events for Video REpresentation and Reasoning
2019/10/03 by Kexin Yi, Chuang Gan, Yi, Kexin +11 · 53 citations
Computer Science · #Multimodal Machine Learning Applications #Explainable Artificial Intelligence (XAI) #Human Pose and Action Recognition
- ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation
2024/09/03 by Wenlong Huang, Huang, Wenlong, Chen Wang +7 · 95 citations
Computer Science · #AI-based Problem Solving and Planning #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Constraint Satisfaction and Optimization #FOS: Computer and information sciences #Robotics (cs.RO) #Semantic Web and Ontologies
- Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluids
2018/10/03 by Li, Yunzhu, Wu, Jiajun, Tedrake, Russ +2 · 18 citations
#Artificial Intelligence (cs.AI) #Computational Physics (physics.comp-ph) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Robotics (cs.RO)
- BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation
2024/03/14 by Chengshu Li, Ruohan Zhang, Li, Chengshu +67 · 36 citations
Computer Science · Social Sciences · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Context-Aware Activity Recognition Systems #Ethics and Social Impacts of AI #FOS: Computer and information sciences #Robotics (cs.RO)
- Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussians
2024/03/14 by Licheng Zhong, Hong-Xing Yu, Zhong, Licheng +5 · 26 citations
Earth and Planetary Sciences · Engineering · Medicine · #3D Shape Modeling and Analysis #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Geological Modeling and Analysis #Winter Sports Injuries and Performance
- RoboCook: Long-Horizon Elasto-Plastic Object Manipulation with Diverse Tools
2023/06/26 by Haochen Shi, Huazhe Xu, Shi, Haochen +7 · 1 voice · 14 citations
#cs.RO
- 3D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensing
2024/10/31 by Binghao Huang, Yixuan Wang, Huang, Binghao +7 · 27 citations
Engineering · Neuroscience · #Additive Manufacturing and 3D Printing Technologies #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robot Manipulation and Learning #Robotics (cs.RO) #Tactile and Sensory Interactions
- D3Fields: Dynamic 3D Descriptor Fields for Zero-Shot Generalizable Rearrangement
2023/09/28 by Wang, Yixuan, Zhang, Mingtong, Li, Zhuoran +5 · 17 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- RoboEXP: Action-Conditioned Scene Graph via Interactive Exploration for Robotic Manipulation
2024/02/23 by Hanxiao Jiang, Binghao Huang, Jiang, Hanxiao +13 · 17 citations
Engineering · Computer Science · #Robot Manipulation and Learning #Reinforcement Learning in Robotics #Multimodal Machine Learning Applications
- Connecting Touch and Vision via Cross-Modal Prediction
2019/06/14 by Li, Yunzhu, Zhu, Jun-Yan, Tedrake, Russ +1 · 7 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- RoboCraft: Learning to See, Simulate, and Shape Elasto-Plastic Objects with Graph Networks
2022/05/05 by Haochen Shi, Shi, Haochen, Huazhe Xu +7 · 8 citations
Engineering · Computer Science · #Robot Manipulation and Learning #Multimodal Machine Learning Applications #Human Pose and Action Recognition
- PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videos
2025/03/23 by Jiang, Hanxiao, Hsu, Hao-Yu, Zhang, Kaifeng +3 · 22 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO)
- AdaptiGraph: Material-Adaptive Graph-Based Neural Dynamics for Robotic Manipulation
2024/07/10 by Kaifeng Zhang, Zhang, Kaifeng, Baoyu Li +5 · 13 citations
Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Modular Robots and Swarm Intelligence #Robot Manipulation and Learning #Robotics (cs.RO)
- PhysGen3D: Crafting a Miniature Interactive World from a Single Image
2025/03/26 by Boyuan Chen, Chen, Boyuan, Hanxiao Jiang +11 · 21 citations
Computer Science · #Augmented Reality Applications
- Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modeling
2024/10/24 by Mingtong Zhang, Zhang, Mingtong, Kaifeng Zhang +3 · 12 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Robotics (cs.RO)
- 3D Neural Scene Representations for Visuomotor Control
2021/07/08 by Yunzhu Li, Li, Yunzhu, Shuang Li +7 · 6 citations
Computer Science · Engineering · #Advanced Vision and Imaging #3D Shape Modeling and Analysis #Computer Graphics and Visualization Techniques
- Learning Compositional Koopman Operators for Model-Based Control
2019/10/18 by Yunzhu Li, Hao He, Li, Yunzhu +7 · 5 citations
Computer Science · Engineering · Physics and Astronomy · #FOS: Computer and information sciences #FOS: Mathematics #Lattice Boltzmann Simulation Studies #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks #Neural Networks and Reservoir Computing #Optimization and Control (math.OC) #Robotics (cs.RO)
- DiffSkill: Skill Abstraction from Differentiable Physics for Deformable Object Manipulations with Tools
2022/03/31 by Xingyu Lin, Zhiao Huang, Lin, Xingyu +9 · 5 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Machine Learning (cs.LG) #Robot Manipulation and Learning #Robotics (cs.RO)
- ComPhy: Compositional Physical Reasoning of Objects and Events from Videos
2022/05/02 by Chen, Zhenfang, Yi, Kexin, Li, Yunzhu +4 · 5 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- Causal Discovery in Physical Systems from Videos
2020/07/01 by Yunzhu Li, Li, Yunzhu, Antonio Torralba +7 · 4 citations
Computer Science · #Anomaly Detection Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objects
2023/06/01 by Gao, Ruohan, Dou, Yiming, Li, Hao +5 · 6 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Human-Computer Interaction (cs.HC) #Robotics (cs.RO)
- Propagation Networks for Model-Based Control Under Partial Observation
2018/09/28 by Li, Yunzhu, Wu, Jiajun, Zhu, Jun-Yan +3 · 3 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- GenDP: 3D Semantic Fields for Category-Level Generalizable Diffusion Policy
2024/10/23 by Wang, Yixuan, Yin, Guang, Huang, Binghao +3 · 7 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- Dynamic-Resolution Model Learning for Object Pile Manipulation
2023/06/29 by Wang, Yixuan, Li, Yunzhu, Driggs-Campbell, Katherine +2 · 4 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- Learning Multi-Object Dynamics with Compositional Neural Radiance Fields
2022/02/24 by Driess, Danny, Huang, Zhiao, Li, Yunzhu +2 · 3 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- RoboPack: Learning Tactile-Informed Dynamics Models for Dense Packing
2024/07/01 by Bo Ai, Stephen Tian, Ai, Bo +11 · 5 citations
Engineering · #Advanced Manufacturing and Logistics Optimization #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #I.2.10 #I.2.6 #I.2.9 #Machine Learning (cs.LG) #Modular Robots and Swarm Intelligence #Optimization and Packing Problems #Robotics (cs.RO)
- Reinforcement Learning with Neural Radiance Fields
2022/06/03 by Danny Driess, Ingmar Schubert, Driess, Danny +7 · 3 citations
Computer Science · #Adversarial Robustness in Machine Learning #Reinforcement Learning in Robotics #Explainable Artificial Intelligence (XAI)
- Predicting Object Interactions with Behavior Primitives: An Application in Stowing Tasks
2023/09/28 by Haonan Chen, Yilong Niu, Chen, Haonan +11 · 4 citations
Engineering · Computer Science · #Robot Manipulation and Learning #Advanced Neural Network Applications #Reinforcement Learning in Robotics
- Planning with Spatial-Temporal Abstraction from Point Clouds for Deformable Object Manipulation
2022/10/27 by Lin, Xingyu, Qi, Carl, Zhang, Yunchu +5 · 3 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Robotics (cs.RO)
- Learning Physical Graph Representations from Visual Scenes
2020/06/22 by Bear, Daniel M., Fan, Chaofei, Mrowca, Damian +8 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #I.2.6 #I.4.8 #Machine Learning (cs.LG)
- Touch in the Wild: Learning Fine-Grained Manipulation with a Portable Visuo-Tactile Gripper
2025/07/20 by Zhu, Xinyue, Huang, Binghao, Li, Yunzhu · 9 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- Does Learning from Decentralized Non-IID Unlabeled Data Benefit from Self Supervision?
2022/10/20 by Wang, Lirui, Zhang, Kaiqing, Li, Yunzhu +2 · 2 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- Robotic Manipulation by Imitating Generated Videos Without Physical Demonstrations
2025/07/01 by Patel, Shivansh, Mohan, Shraddhaa, Mai, Hanlin +3 · 9 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO)
- Model-Based Control with Sparse Neural Dynamics
2023/12/20 by Ziang Liu, Liu, Ziang, Genggeng Zhou +11 · 2 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robotics (cs.RO)
- Particle-Grid Neural Dynamics for Learning Deformable Object Models from RGB-D Videos
2025/06/18 by Zhang, Kaifeng, Li, Baoyu, Hauser, Kris +1 · 8 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation
2024/05/15 by Yunhao Ge, Ge, Yunhao, Yihe Tang +43 · 2 citations
Computer Science · #Advanced Neural Network Applications
- EscapeBench: Towards Advancing Creative Intelligence of Language Model Agents
2024/12/18 by Qian, Cheng, Han, Peixuan, Luo, Qinyu +9 · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Visual Grounding of Learned Physical Models
2020/04/28 by Li, Yunzhu, Lin, Toru, Yi, Kexin +5 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Keypoints into the Future: Self-Supervised Correspondence in Model-Based Reinforcement Learning
2020/09/10 by Manuelli, Lucas, Li, Yunzhu, Florence, Pete +1 · 1 citation
#FOS: Computer and information sciences #Robotics (cs.RO)
- Tool-as-Interface: Learning Robot Policies from Observing Human Tool Use
2025/04/06 by Chen, Haonan, Zhu, Cheng, Liu, Shuijing +2 · 4 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- Compositional Physical Reasoning of Objects and Events from Videos
2024/08/02 by Zhenfang Chen, Shilong Dong, Chen, Zhenfang +13 · 2 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics and Automated Systems #Semantic Web and Ontologies #Video Analysis and Summarization
- Learning Coordinated Bimanual Manipulation Policies using State Diffusion and Inverse Dynamics Models
2025/03/30 by Haonan Chen, Chen, Haonan, Jiaming Xu +10 · 4 citations
Engineering · Computer Science · Psychology · #Robot Manipulation and Learning #Reinforcement Learning in Robotics #Social Robot Interaction and HRI
- 3D-IntPhys: Towards More Generalized 3D-grounded Visual Intuitive Physics under Challenging Scenes
2023/04/22 by Haotian Xue, Xue, Haotian, Antonio Torralba +9 · 1 citation
Computer Science · #Advanced Vision and Imaging #Computer Graphics and Visualization Techniques #Generative Adversarial Networks and Image Synthesis
- CodeDiffuser: Attention-Enhanced Diffusion Policy via VLM-Generated Code for Instruction Ambiguity
2025/06/19 by Yin, Guang, Li, Yitong, Wang, Yixuan +6 · 4 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO) #Software Engineering (cs.SE)
- CuriousBot: Interactive Mobile Exploration via Actionable 3D Relational Object Graph
2025/01/23 by Wang, Yixuan, Fermoselle, Leonor, Kelestemur, Tarik +2 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- KUDA: Keypoints to Unify Dynamics Learning and Visual Prompting for Open-Vocabulary Robotic Manipulation
2025/03/13 by Liu, Zixian, Zhang, Mingtong, Li, Yunzhu · 2 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Robotics (cs.RO)
- Multi-Modal Manipulation via Multi-Modal Policy Consensus
2025/09/27 by Chen, Haonan, Xu, Jiaming, Chen, Hongyu +7 · 2 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)