vix.ing · top · new · best · stats · spec

Real-time and Controllable Reactive Motion Synthesis via Intention Guidance

2025/07/13 by Xiaotang Zhang, Zhang, Xiaotang, Ziyi Chang +5
Engineering · #FOS: Computer and information sciences #Graphics (cs.GR) #Human Motion and Animation #Robot Manipulation and Learning #Teleoperation and Haptic Systems

paper · pdf · doi:10.48550/arxiv.2507.09704

openalex publication_date 2025/07/13 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We propose a real-time method for reactive motion synthesis based on the known trajectory of input character, predicting instant reactions using only historical, user-controlled motions. Our method handles the uncertainty of future movements by introducing an intention predictor, which forecasts key joint intentions to make pose prediction more deterministic from the historical interaction. The intention is later encoded into the latent space of its reactive motion, matched with a codebook which represents mappings between input and output. It samples a categorical distribution for pose generation and strengthens model robustness through adversarial training. Unlike previous offline approaches, the system can recursively generate intentions and reactive motions using feedback from earlier steps, enabling real-time, long-term realistic interactive synthesis. Both quantitative and qualitative experiments show our approach outperforms other matching-based motion synthesis approaches, delivering superior stability and generalizability. In our method, user can also actively influence the outcome by controlling the moving directions, creating a personalized interaction path that deviates from predefined trajectories.

Citations

Related