vix.ing · top · new · best · stats · spec

Fine-grained Testing for Autonomous Driving Software: a Study on Autoware with LLM-driven Unit Testing

2025/01/16 by Wenhan Wang, Xuan Xie, Wang, Wenhan +9 · 1 citation
Computer Science · Engineering · #FOS: Computer and information sciences #Real-time simulation and control systems #Software Engineering (cs.SE) #Software Testing and Debugging Techniques

paper · pdf · doi:10.48550/arxiv.2501.09866

openalex publication_date 2025/01/16 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Testing autonomous driving systems (ADS) is critical to ensuring their reliability and safety. Existing ADS testing works focuses on designing scenarios to evaluate system-level behaviors, while fine-grained testing of ADS source code has received comparatively little attention. To address this gap, we present the first study on testing, specifically unit testing, for ADS source code. Our study focuses on an industrial ADS framework, Autoware. We analyze both human-written test cases and those generated by large language models (LLMs). Our findings reveal that human-written test cases in Autoware exhibit limited test coverage, and significant challenges remain in applying LLM-generated tests for Autoware unit testing. To overcome these challenges, we propose AwTest-LLM, a novel approach to enhance test coverage and improve test case pass rates across Autoware packages.

Cited by

Related