vix.ing · top · new · best · stats · spec

Sim-to-Real Dynamic Object Manipulation on Conveyor Systems via Optimization Path Shaping

2025/08/19 by Zhuoling Li, Yang, Jinrong, Li, Zhuoling +5
Computer Science · Engineering · #FOS: Computer and information sciences #Robot Manipulation and Learning #Robotic Path Planning Algorithms #Robotics (cs.RO)

paper · pdf · doi:10.48550/arxiv.2508.14042

openalex publication_date 2025/08/19 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/31

Abstract

Realizing generalizable dynamic object manipulation on conveyor systems is important for enhancing manufacturing efficiency, as it eliminates specialized engineering for different scenarios. To this end, imitation learning emerges as a promising paradigm, leveraging expert demonstrations to teach a policy manipulation skills. Although the generalization of an imitation learning policy can be improved by increasing demonstrations, demonstration collection is labor-intensive. Besides, public dynamic object manipulation data is scarce. In this work, we address this data scarcity problem via generating demonstrations in a simulator. A significant challenge of using simulated data lies in the appearance gap between simulated and real-world observations. To tackle this challenge, we propose Geometry-Enhanced Model (GEM), which employs our designed appearance noise annealing strategy to shape the policy optimization path, thereby prioritizing the geometry information in observations. Extensive experiments in simulated and real-world tasks demonstrate that GEM can generalize across environment backgrounds, robot embodiments, motion dynamics, and object geometries. Notably, GEM is deployed in a real canteen for tableware collection. Without test-scene data, GEM achieves a success rate of over 97% across more than 10,000 operations.

Citations

Related