2025/04/23 by Ilyass Taouil, Taouil, Ilyass, Haizhou Zhao +5 · 1 citation
Computer Science · Engineering · #FOS: Computer and information sciences #Graphics (cs.GR) #Human Motion and Animation #Human Pose and Action Recognition #Robotic Locomotion and Control #Robotics (cs.RO)
paper · pdf · doi:10.48550/arxiv.2504.16843
openalex publication_date 2025/04/23 · openalex created_date 2025/10/11 · openalex updated_date 2026/07/28
This paper uses the capabilities of latent diffusion models (LDMs) to generate realistic RGB human-object interaction scenes to guide humanoid loco-manipulation planning. To do so, we extract from the generated images both the contact locations and robot configurations that are then used inside a whole-body trajectory optimization (TO) formulation to generate physically consistent trajectories for humanoids. We validate our full pipeline in simulation for different long-horizon loco-manipulation scenarios and perform an extensive analysis of the proposed contact and robot configuration extraction pipeline. Our results show that using the information extracted from LDMs, we can generate physically consistent trajectories that require long-horizon reasoning.