vix.ing · top · new · best · stats · spec

Controllable Traffic Simulation through LLM-Guided Hierarchical Reasoning and Refinement

2024/09/23 by Zhiyuan Liu, Liu, Zhiyuan, Leheng Li +12 · 3 citations
Business, Management and Accounting · Decision Sciences · #Business Process Modeling and Analysis #FOS: Computer and information sciences #Robotics (cs.RO) #Scientific Computing and Data Management #Simulation Techniques and Applications

paper · pdf · doi:10.48550/arxiv.2409.15135

openalex publication_date 2024/09/23 · openalex created_date 2024/10/26 · openalex updated_date 2026/07/28

Abstract

Evaluating autonomous driving systems in complex and diverse traffic scenarios through controllable simulation is essential to ensure their safety and reliability. However, existing traffic simulation methods face challenges in their controllability. To address this, we propose a novel diffusion-based and LLM-enhanced traffic simulation framework. Our approach incorporates a high-level understanding module and a low-level refinement module, which systematically examines the hierarchical structure of traffic elements, guides LLMs to thoroughly analyze traffic scenario descriptions step by step, and refines the generation by self-reflection, enhancing their understanding of complex situations. Furthermore, we propose a Frenet-frame-based cost function framework that provides LLMs with geometrically meaningful quantities, improving their grasp of spatial relationships in a scenario and enabling more accurate cost function generation. Experiments on the Waymo Open Motion Dataset (WOMD) demonstrate that our method can handle more intricate descriptions and generate a broader range of scenarios in a controllable manner.

Cited by

Related