Gu, Jiayuan

1. Open X-Embodiment: Robotic Learning Datasets and RT-X Models
   2023/10/13 by Embodiment Collaboration, O'Neill, Abby, Rehman, Abdul +349 · 175 citations
   Computer Science · Engineering · #FOS: Computer and information sciences #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
2. Evaluating Real-World Robot Manipulation Policies in Simulation
   2024/05/09 by Xuanlin Li, Kyle Hsu, Li, Xuanlin +29 · 125 citations
   Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robot Manipulation and Learning #Robotics (cs.RO)
3. One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion
   2023/11/14 by Minghua Liu, Ruoxi Shi, Liu, Minghua +17 · 1 voice · 39 citations
   Computer Science · Engineering · #3D Shape Modeling and Analysis #Computer Graphics and Visualization Techniques #Generative Adversarial Networks and Image Synthesis #cs.AI #cs.CV #cs.GR
4. ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skills
   2023/02/09 by Jiayuan Gu, Fanbo Xiang, Gu, Jiayuan +26 · 55 citations
   Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Human Pose and Action Recognition #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
5. RT-Trajectory: Robotic Task Generalization via Hindsight Trajectory Sketches
   2023/11/03 by Jiayuan Gu, Gu, Jiayuan, Sean Kirmani +31 · 24 citations
   Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Robotics (cs.RO)
6. CAST: Component-Aligned 3D Scene Reconstruction from an RGB Image
   2025/02/18 by Yao, Kaixin, Zhang, Longwen, Yan, Xinhao +6 · 28 citations
   #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
7. Generic 3D Diffusion Adapter Using Controlled Multi-View Editing
   2024/03/18 by Chen, Hansheng, Shi, Ruoxi, Liu, Yulin +5 · 14 citations
   #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR)
8. Relation Networks for Object Detection
   2017/11/30 by Han Hu, Jiayuan Gu, Hu, Han +7 · 6 citations
   Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
9. Towards Understanding Learning Representations: To What Extent Do\n Different Neural Networks Learn the Same Representation
   2018/10/27 by Liwei Wang, Wang, Liwei, Lunjia Hu +11 · 7 citations
   Computer Science · #Neural Networks and Applications #Domain Adaptation and Few-Shot Learning #Machine Learning and Data Classification
10. SoFar: Language-Grounded Orientation Bridges Spatial Reasoning and Object Manipulation
    2025/02/18 by Zekun Qi, Qi, Zekun, Wenyao Zhang +33 · 20 citations
    Computer Science · #Speech and dialogue systems #Semantic Web and Ontologies #Natural Language Processing Techniques
11. Point-SAM: Promptable 3D Segmentation Model for Point Clouds
    2024/06/25 by Yuchen Zhou, Zhou, Yuchen, Jiayuan Gu +7 · 11 citations
    Earth and Planetary Sciences · Engineering · Environmental Science · #3D Shape Modeling and Analysis #3D Surveying and Cultural Heritage #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Remote Sensing and LiDAR Applications
12. PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimation
    2023/12/05 by Zhou, Yuchen, Gu, Jiayuan, Li, Xuanlin +3 · 8 citations
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
13. AffordDP: Generalizable Diffusion Policy with Transferable Affordance
    2024/12/04 by Shenglong Wu, Yihang Zhu, Wu, Shijie +12 · 15 citations
    Economics, Econometrics and Finance · #Economic Policies and Impacts
14. Multi-skill Mobile Manipulation for Object Rearrangement
    2022/09/06 by Gu, Jiayuan, Chaplot, Devendra Singh, Su, Hao +1 · 6 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
15. RT-Sketch: Goal-Conditioned Imitation Learning from Hand-Drawn Sketches
    2024/03/05 by Priya Sundaresan, Quan Vuong, Sundaresan, Priya +23 · 8 citations
    Computer Science · Engineering · #FOS: Computer and information sciences #Human Motion and Animation #Human Pose and Action Recognition #Robotics (cs.RO) #Video Analysis and Summarization
16. Close the Optical Sensing Domain Gap by Physics-Grounded Active Stereo Sensor Simulation
    2022/01/28 by Xiaoshuai Zhang, Rui Chen, Zhang, Xiaoshuai +24 · 4 citations
    Computer Science · Physics and Astronomy · #Advanced Optical Sensing Technologies #Advanced Vision and Imaging #FOS: Computer and information sciences #Optical measurement and interference techniques #Robotics (cs.RO)
17. Multi-view PointNet for 3D Scene Understanding
    2019/09/30 by Maximilian Jaritz, Jiayuan Gu, Jaritz, Maximilian +3 · 2 citations
    Computer Science · Engineering · #3D Shape Modeling and Analysis #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics and Sensor-Based Localization
18. Deep Feedback Inverse Problem Solver
    2021/01/19 by Ma, Wei-Chiu, Wang, Shenlong, Gu, Jiayuan +3 · 1 citation
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO)
19. 3D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generation
    2024/10/24 by Hansheng Chen, Bokui Shen, Chen, Hansheng +17 · 2 citations
    Computer Science · Engineering · #3D Shape Modeling and Analysis #Advanced Optical Imaging Technologies #Artificial Intelligence (cs.AI) #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
20. Weakly-supervised 3D Shape Completion in the Wild
    2020/08/20 by Jiayuan Gu, Wei-Chiu Ma, Gu, Jiayuan +13 · 1 citation
    Computer Science · Engineering · #Advanced Vision and Imaging #3D Shape Modeling and Analysis #Robotics and Sensor-Based Localization
21. PartNeXt: A Next-Generation Dataset for Fine-Grained and Hierarchical 3D Part Understanding
    2025/10/23 by Wang, Penghao, He, Yiyang, Lv, Xin +4 · 3 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences