vix.ing · top · new · best · stats · spec

Learning from Demonstration with Hierarchical Policy Abstractions Toward High-Performance and Courteous Autonomous Racing

2024/11/07 by Chanyoung Chung, Chung, Chanyoung, Hyunki Seong +3
Computer Science · Economics, Econometrics and Finance · #FOS: Computer and information sciences #Reinforcement Learning in Robotics #Robotics (cs.RO) #Sports Analytics and Performance

paper · pdf · doi:10.48550/arxiv.2411.04735

openalex publication_date 2024/11/07 · openalex created_date 2024/11/15 · openalex updated_date 2026/07/28

Abstract

Fully autonomous racing demands not only high-speed driving but also fair and courteous maneuvers. In this paper, we propose an autonomous racing framework that learns complex racing behaviors from expert demonstrations using hierarchical policy abstractions. At the trajectory level, our policy model predicts a dense distribution map indicating the likelihood of trajectories learned from offline demonstrations. The maximum likelihood trajectory is then passed to the control-level policy, which generates control inputs in a residual fashion, considering vehicle dynamics at the limits of performance. We evaluate our framework in a high-fidelity racing simulator and compare it against competing baselines in challenging multi-agent adversarial scenarios. Quantitative and qualitative results show that our trajectory planning policy significantly outperforms the baselines, and the residual control policy improves lap time and tracking accuracy. Moreover, challenging closed-loop experiments with ten opponents show that our framework can overtake other vehicles by understanding nuanced interactions, effectively balancing performance and courtesy like professional drivers.

Related