Ding, Mingyu
- Open X-Embodiment: Robotic Learning Datasets and RT-X Models
2023/10/13 by Embodiment Collaboration, O'Neill, Abby, Rehman, Abdul +349 · 175 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Robotics (cs.RO)
- EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thought
2023/05/24 by Yao Mu, Qinglong Zhang, Mu, Yao +17 · 53 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics (cs.RO)
- Planning with Large Language Models for Code Generation
2023/03/09 by Shun Zhang, Zhenfang Chen, Zhang, Shun +9 · 29 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Programming Languages (cs.PL) #Software Engineering Research #Software Testing and Debugging Techniques
- DaViT: Dual Attention Vision Transformers
2022/04/07 by Ding, Mingyu, Xiao, Bin, Codella, Noel +3 · 21 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- AdaptDiffuser: Diffusion Models as Adaptive Self-evolving Planners
2023/02/03 by Zhixuan Liang, Yao Mu, Liang, Zhixuan +9 · 21 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Viral Infectious Diseases and Gene Expression in Insects
- EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning
2023/12/11 by Yi Chen, Yuying Ge, Chen, Yi +15 · 24 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- Context Autoencoder for Self-Supervised Representation Learning
2022/02/07 by Chen, Xiaokang, Ding, Mingyu, Wang, Xiaodi +7 · 16 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- VDT: General-purpose Video Diffusion Transformers via Mask Modeling
2023/05/22 by Haoyu Lu, Guoxing Yang, Lu, Haoyu +11 · 16 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis
- A Survey of Reasoning with Foundation Models
2023/12/17 by Sun, Jiankai, Zheng, Chuanyang, Xie, Enze +31 · 18 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Segmenting Transparent Objects in the Wild
2020/03/31 by Enze Xie, Wenjia Wang, Xie, Enze +9 · 10 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Enhancement Techniques #Visual Attention and Saliency Detection
- GRAPE: Generalizing Robot Policy via Preference Alignment
2024/11/28 by Zijian Zhang, Kaiyuan Zheng, Zhang, Zijian +16 · 27 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robotics (cs.RO)
- LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving
2023/10/04 by Sha, Hao, Mu, Yao, Jiang, Yuxuan +7 · 16 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- Moto: Latent Motion Token as the Bridging Language for Learning Robot Manipulation from Videos
2024/12/05 by Yi‐Ping Phoebe Chen, Chen, Yi, Yuying Ge +12 · 25 citations
Computer Science · Engineering · #Human Pose and Action Recognition #Human Motion and Animation #Robotics and Automated Systems
- Sparse Diffusion Policy: A Sparse, Reusable, and Flexible Policy for Robot Learning
2024/07/01 by Yixiao Wang, Wang, Yixiao, Yifei Zhang +19 · 19 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Robotics (cs.RO)
- SkillDiffuser: Interpretable Hierarchical Planning via Skill Abstractions in Diffusion-Based Task Execution
2023/12/18 by Liang, Zhixuan, Mu, Yao, Ma, Hengbo +3 · 16 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twins
2025/04/17 by Yao Mu, Tianxing Chen, Mu, Yao +25 · 32 citations
Engineering · Computer Science · #Robot Manipulation and Learning #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications
- Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Properties
2023/06/27 by Hsiao-Yu Fish Tung, Tung, Hsiao-Yu, Mingyu Ding +15 · 10 citations
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Data Visualization and Analytics #FOS: Computer and information sciences #Graphics (cs.GR) #Human Pose and Action Recognition #Robotics (cs.RO)
- UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling
2023/02/13 by Haoyu Lu, Lu, Haoyu, Yuqi Huo +11 · 8 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques
- RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesis
2024/02/25 by Mu, Yao, Chen, Junting, Zhang, Qinglong +16 · 10 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO)
- Learning Depth-Guided Convolutions for Monocular 3D Object Detection
2019/12/10 by Ding, Mingyu, Huo, Yuqi, Yi, Hongwei +4 · 4 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- ComPhy: Compositional Physical Reasoning of Objects and Events from Videos
2022/05/02 by Chen, Zhenfang, Yi, Kexin, Li, Yunzhu +4 · 5 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- Doubly Robust Self-Training
2023/06/01 by Banghua Zhu, Zhu, Banghua, Mingyu Ding +11 · 6 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Video Surveillance and Tracking Methods #Advanced Neural Network Applications
- Tree-Planner: Efficient Close-loop Task Planning with Large Language Models
2023/10/12 by Mengkang Hu, Hu, Mengkang, Yao Mu +17 · 7 citations
Computer Science · Decision Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Quality and Management #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Robotics (cs.RO) #Topic Modeling
- Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language
2021/10/28 by Ding, Mingyu, Chen, Zhenfang, Du, Tao +3 · 4 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- RoboScript: Code Generation for Free-Form Manipulation Tasks across Real and Simulation
2024/02/22 by Chen, Junting, Mu, Yao, Yu, Qiaojun +11 · 7 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #I.2.10 #I.2.7 #I.2.8 #I.2.9 #Robotics (cs.RO)
- Interleave-VLA: Enhancing Robot Manipulation with Interleaved Image-Text Instructions
2025/05/04 by Fan, Cunxin, Xiaosong Jia, Yiwen Sun +17 · 14 citations
Computer Science · Engineering · #Multimodal Machine Learning Applications #Robotics and Automated Systems
- MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models
2024/10/14 by Peng Xia, Xia, Peng, Siwei Han +21 · 7 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Quadric Representations for LiDAR Odometry, Mapping and Localization
2023/04/27 by Chao Xia, Xia, Chao, Chenfeng Xu +13 · 4 citations
Engineering · Environmental Science · #3D Shape Modeling and Analysis #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Remote Sensing and LiDAR Applications #Robotics and Sensor-Based Localization
- Multimodal foundation models are better simulators of the human brain
2022/08/17 by Haoyu Lu, Lu, Haoyu, Qiongyi Zhou +19 · 3 citations
Computer Science · Neuroscience · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #EEG and Brain-Computer Interfaces #FOS: Computer and information sciences #Multimedia (cs.MM) #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE)
- ReBot: Scaling Robot Learning with Real-to-Sim-to-Real Robotic Video Synthesis
2025/03/15 by Yu Fang, Fang, Yu, Yue Yang +11 · 9 citations
Computer Science · Engineering · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Graphics (cs.GR) #Human Motion and Animation #Robotics (cs.RO)
- WOMD-Reasoning: A Large-Scale Dataset for Interaction Reasoning in Driving
2024/07/05 by Li, Yiheng, Fan, Cunxin, Ge, Chongjian +9 · 5 citations
#FOS: Computer and information sciences #Robotics (cs.RO)
- Domain-Adaptive Few-Shot Learning
2020/03/19 by Zhao, An, Ding, Mingyu, Lu, Zhiwu +5 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-Making Framework
2024/09/19 by Fang, Shiyu, Liu, Jiaqi, Ding, Mingyu +4 · 5 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Robotics (cs.RO)
- X-Drive: Cross-modality consistent multi-sensor data synthesis for driving scenarios
2024/11/02 by Yichen Xie, Xie, Yichen, Chenfeng Xu +15 · 5 citations
Computer Science · Engineering · #Autonomous Vehicle Technology and Safety #Computer Vision and Pattern Recognition (cs.CV) #Data Management and Algorithms #FOS: Computer and information sciences #Time Series Analysis and Forecasting
- PhyGrasp: Generalizing Robotic Grasping with Physics-informed Large Multimodal Models
2024/02/26 by Guo, Dingkun, Xiang, Yuqi, Zhao, Shuqi +4 · 3 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO)
- GeoManip: Geometric Constraints as General Interfaces for Robot Manipulation
2025/01/16 by Tang, Weiliang, Pan, Jia-Hui, Liu, Yun-Hui +4 · 5 citations
#FOS: Computer and information sciences #Robotics (cs.RO)
- Embodiment-Agnostic Action Planning via Object-Part Scene Flow
2024/09/16 by Weiliang Tang, Tang, Weiliang, Jiahui Pan +15 · 4 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Human Motion and Animation #Human Pose and Action Recognition #Robotic Path Planning Algorithms #Robotics (cs.RO)
- Q-SLAM: Quadric Representations for Monocular SLAM
2024/03/12 by Chensheng Peng, Peng, Chensheng, Chenfeng Xu +15 · 3 citations
Engineering · Computer Science · #Robotics and Sensor-Based Localization #Modular Robots and Swarm Intelligence #Optimization and Search Problems
- MoLE: Enhancing Human-centric Text-to-image Diffusion via Mixture of Low-rank Experts
2024/10/30 by Zhu, Jie, Chen, Yixiong, Ding, Mingyu +3 · 4 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Domain-Invariant Projection Learning for Zero-Shot Recognition
2018/10/19 by An Zhao, Zhao, An, Mingyu Ding +9 · 5 citations
Computer Science · #Domain Adaptation and Few-Shot Learning
- TextPSG: Panoptic Scene Graph Generation from Textual Descriptions
2023/10/10 by Zhao, Chengyang, Shen, Yikang, Chen, Zhenfang +2 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Language-Driven Policy Distillation for Cooperative Driving in Multi-Agent Reinforcement Learning
2024/10/31 by Liu, Jiaqi, Xu, Chengkai, Hang, Peng +4 · 3 citations
#FOS: Computer and information sciences #Robotics (cs.RO)
- DexHandDiff: Interaction-aware Diffusion Planning for Adaptive Dexterous Manipulation
2024/11/27 by Zhixuan Liang, Liang, Zhixuan, Yao Mu +15 · 4 citations
Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Innovations in Concrete and Construction Materials #Machine Learning (cs.LG) #Robot Manipulation and Learning #Robotics (cs.RO) #Teleoperation and Haptic Systems
- REMAC: Self-Reflective and Self-Evolving Multi-Agent Collaboration for Long-Horizon Robot Manipulation
2025/03/28 by Annabel Ma, Yuan, Puzhen, Ma, Angyuan +8 · 5 citations
Computer Science · #AI-based Problem Solving and Planning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robotics (cs.RO)
- RoadBEV: Road Surface Reconstruction in Bird's Eye View
2024/04/09 by Tong Zhao, Lei Yang, Zhao, Tong +9 · 2 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Advanced Vision and Imaging #Autonomous Vehicle Technology and Safety #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- MJ-VIDEO: Fine-Grained Benchmarking and Rewarding Video Preferences in Video Generation
2025/02/03 by Tong, Haibo, Wang, Zhaoyang, Chen, Zhaorun +11 · 3 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- HR-NAS: Searching Efficient High-Resolution Neural Architectures with Lightweight Transformers
2021/06/11 by Mingyu Ding, Ding, Mingyu, Xiaochen Lian +11 · 1 citation
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Compositional Physical Reasoning of Objects and Events from Videos
2024/08/02 by Zhenfang Chen, Chen, Zhenfang, Shilong Dong +13 · 2 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics and Automated Systems #Semantic Web and Ontologies #Video Analysis and Summarization
- DSLO: Deep Sequence LiDAR Odometry Based on Inconsistent Spatio-temporal Propagation
2024/09/01 by Zhang, Huixin, Wang, Guangming, Wu, Xinrui +5 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO)
- P2 Explore: Efficient Exploration in Unknown Cluttered Environment with Floor Plan Prediction
2024/09/17 by Song, Kun, Chen, Gaoming, Tomizuka, Masayoshi +3 · 2 citations
#FOS: Computer and information sciences #Robotics (cs.RO)
- Embodied Concept Learner: Self-supervised Learning of Concepts and Mapping through Instruction Following
2023/04/07 by Ding, Mingyu, Xu, Yan, Chen, Zhenfang +4 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Visual Dependency Transformers: Dependency Tree Emerges from Reversed Attention
2023/04/06 by Mingyu Ding, Yikang Shen, Ding, Mingyu +13 · 1 citation
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Visual Attention and Saliency Detection
- DexH2R: Task-oriented Dexterous Manipulation from Human to Robots
2024/11/07 by Zhao, Shuqi, Zhu, Xinghao, Chen, Yuxin +4 · 2 citations
#FOS: Computer and information sciences #Robotics (cs.RO)
- RSRD: A Road Surface Reconstruction Dataset and Benchmark for Safe and Comfortable Autonomous Driving
2023/10/03 by Zhao, Tong, Xu, Chenfeng, Ding, Mingyu +3 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Robotics (cs.RO)
- Generalizable Long-Horizon Manipulations with Large Language Models
2023/10/03 by Haoyu Zhou, Zhou, Haoyu, Mingyu Ding +9 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Robotics (cs.RO) #Topic Modeling
- Interfacing Foundation Models' Embeddings
2023/12/12 by Zou, Xueyan, Li, Linjie, Wang, Jianfeng +10 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Physics-Aware Robotic Palletization with Online Masking Inference
2025/02/19 by Zhang, Tianqi, Wu, Zheng, Chen, Yuxin +6 · 2 citations
#FOS: Computer and information sciences #Robotics (cs.RO)
- Mixture of Horizons in Action Chunking
2025/11/24 by Jing, Dong, Wang, Gang, Liu, Jiaqi +7 · 2 citations
Computer Science · Engineering · #Multimodal Machine Learning Applications #Robot Manipulation and Learning #Advanced Neural Network Applications
- Human-oriented Representation Learning for Robotic Manipulation
2023/10/04 by Mingxiao Huo, Huo, Mingxiao, Mingyu Ding +15 · 1 citation
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robot Manipulation and Learning #Robotics (cs.RO)
- Depth-aware Volume Attention for Texture-less Stereo Matching
2024/02/14 by Zhao, Tong, Ding, Mingyu, Zhan, Wei +2 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Pre-training on Synthetic Driving Data for Trajectory Prediction
2023/09/18 by Li, Yiheng, Zhao, Seth Z., Xu, Chenfeng +5 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- BOSS: Benchmark for Observation Space Shift in Long-Horizon Task
2025/02/21 by Yang, Yue, Zhao, Linfeng, Ding, Mingyu +2 · 2 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO)
- Incentivizing Multimodal Reasoning in Large Models for Direct Robot Manipulation
2025/05/19 by Weiliang Tang, Dong Jing, Tang, Weiliang +13 · 3 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Robot Manipulation and Learning
- PhysUniBench: An Undergraduate-Level Physics Reasoning Benchmark for Multimodal Models
2025/06/21 by Wang, Lintao, Su, Encheng, Liu, Jiaqi +13 · 4 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
- CompGS: Unleashing 2D Compositionality for Compositional Text-to-3D via Dynamically Optimizing 3D Gaussians
2024/10/28 by Chongjian Ge, Ge, Chongjian, Chenfeng Xu +14 · 1 citation
Computer Science · #Image Processing and 3D Reconstruction #Image Retrieval and Classification Techniques