Zhang, Ruohan
- Open X-Embodiment: Robotic Learning Datasets and RT-X Models
2023/10/13 by Embodiment Collaboration, O'Neill, Abby, Rehman, Abdul +349 · 180 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models
2023/07/12 by Wenlong Huang, Huang, Wenlong, Chen Wang +9 · 136 citations
Computer Science · Engineering · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Robot Manipulation and Learning
- ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation
2024/09/03 by Wenlong Huang, Chen Wang, Huang, Wenlong +7 · 97 citations
Computer Science · #AI-based Problem Solving and Planning #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Constraint Satisfaction and Optimization #FOS: Computer and information sciences #Robotics (cs.RO) #Semantic Web and Ontologies
- MimicPlay: Long-Horizon Imitation Learning by Watching Human Play
2023/02/24 by Chen Wang, Wang, Chen, Linxi Fan +13 · 50 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulation
2024/03/12 by Chen Wang, Wang, Chen, Haochen Shi +9 · 51 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Hand Gesture Recognition Systems #Machine Learning (cs.LG) #Robot Manipulation and Learning #Robotics (cs.RO) #Teleoperation and Haptic Systems
- BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation
2024/03/14 by Chengshu Li, Ruohan Zhang, Li, Chengshu +67 · 38 citations
Computer Science · Social Sciences · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Context-Aware Activity Recognition Systems #Ethics and Social Impacts of AI #FOS: Computer and information sciences #Robotics (cs.RO)
- Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Making
2024/10/09 by Li, Manling, Zhao, Shiyu, Wang, Qineng +12 · 38 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- Automated Creation of Digital Cousins for Robust Policy Learning
2024/10/09 by Tianyuan Dai, Dai, Tianyuan, Josiah Wong +13 · 32 citations
Decision Sciences · #Auction Theory and Applications #FOS: Computer and information sciences #Robotics (cs.RO)
- A Survey on Cross-domain Recommendation: Taxonomies, Methods, and Future Directions
2021/08/07 by Tianzi Zang, Zang, Tianzi, Yanmin Zhu +7 · 13 citations
Computer Science · #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Recommender Systems and Techniques #Topic Modeling
- TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correction
2024/05/16 by Yunfan Jiang, Jiang, Yunfan, Chen Wang +7 · 20 citations
Computer Science · Decision Sciences · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data #Robotics (cs.RO) #Simulation Techniques and Applications
- TeleMoMa: A Modular and Versatile Teleoperation System for Mobile Manipulation
2024/03/12 by Shivin Dass, Dass, Shivin, Wensi Ai +15 · 8 citations
Computer Science · Engineering · Neuroscience · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO) #Tactile and Sensory Interactions #Teleoperation and Haptic Systems #Virtual Reality Applications and Impacts
- BEHAVIOR Robot Suite: Streamlining Real-World Whole-Body Manipulation for Everyday Household Activities
2025/03/07 by Jiang, Yunfan, Zhang, Ruohan, Wong, Josiah +7 · 16 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- AGIL: Learning Attention from Human for Visuomotor Tasks
2018/06/01 by Zhang, Ruohan, Liu, Zhuode, Zhang, Luxin +4 · 3 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Mini-BEHAVIOR: A Procedurally Generated Benchmark for Long-horizon Decision-Making in Embodied AI
2023/10/03 by Jin, Emily, Hu, Jiaheng, Huang, Zhuoyi +4 · 5 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- Modeling Dynamic Environments with Scene Graph Memory
2023/05/27 by Andrey Kurenkov, Kurenkov, Andrey, Michael Lingelbach +17 · 4 citations
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Human Mobility and Location-Based Analysis #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- UAD: Unsupervised Affordance Distillation for Generalization in Robotic Manipulation
2025/06/10 by Yihe Tang, Tang, Yihe, Wenlong Huang +13 · 12 citations
Computer Science · Engineering · #Advanced Vision and Imaging #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Widening the Pipeline in Human-Guided Reinforcement Learning with Explanation and Context-Aware Data Augmentation
2020/06/26 by Lin Guan, Mudit Verma, Guan, Lin +7 · 3 citations
Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Reinforcement Learning in Robotics
- Machine versus Human Attention in Deep Reinforcement Learning Tasks
2020/10/29 by Guo, Sihang, Zhang, Ruohan, Liu, Bo +4 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Learning Compositional Behaviors from Demonstration and Language
2025/05/28 by Weiyu Liu, Neil Nie, Liu, Weiyu +7 · 9 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- Primitive Skill-based Robot Learning from Human Evaluative Feedback
2023/07/28 by Ayano Hiranaka, Minjune Hwang, Hiranaka, Ayano +11 · 2 citations
Computer Science · Neuroscience · #Reinforcement Learning in Robotics #Adversarial Robustness in Machine Learning #EEG and Brain-Computer Interfaces
- NOIR: Neural Signal Operated Intelligent Robots for Everyday Activities
2023/11/02 by Ruohan Zhang, Sharon Lee, Zhang, Ruohan +25 · 2 citations
Neuroscience · Engineering · #EEG and Brain-Computer Interfaces #Advanced Memory and Neural Computing #Neural dynamics and brain function
- BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation
2024/05/15 by Yunhao Ge, Ge, Yunhao, Yihe Tang +43 · 2 citations
Computer Science · #Advanced Neural Network Applications
- Chain-of-Modality: Learning Manipulation Programs from Multimodal Human Videos with Vision-Language-Models
2025/04/17 by Wang, Chen, Xia, Fei, Yu, Wenhao +6 · 4 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Machine Learning (cs.LG) #Multimedia (cs.MM) #Robotics (cs.RO)
- Interaction Modeling with Multiplex Attention
2022/08/23 by Fan-Yun Sun, Sun, Fan-Yun, Isaac Kauvar +11 · 1 citation
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Time Series Analysis and Forecasting
- Task-Driven Graph Attention for Hierarchical Relational Object Navigation
2023/06/23 by Michael Lingelbach, Lingelbach, Michael, Chengshu Li +15 · 1 citation
Computer Science · #Multimodal Machine Learning Applications #Advanced Graph Neural Networks #Advanced Neural Network Applications
- Leveraging Human Guidance for Deep Reinforcement Learning Tasks
2019/09/21 by Ruohan Zhang, Zhang, Ruohan, Faraz Torabi +7 · 1 citation
Computer Science · Engineering · #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Explainable Artificial Intelligence (XAI)
- MARPLE: A Benchmark for Long-Horizon Inference
2024/10/02 by Emily Jin, Jin, Emily, Zhuoyi Huang +17 · 1 citation
Computer Science · #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Multimodal Machine Learning Applications