vix.ing · top · new · best · stats · spec

Using Taint Analysis and Reinforcement Learning (TARL) to Repair Autonomous Robot Software

2020/05/08 by Damian M. Lyons, Lyons, D. M., Saba B. Zahra +1
Computer Science · #FOS: Computer and information sciences #Robotics (cs.RO) #Software Engineering (cs.SE) #Software Engineering Research #Software Reliability and Analysis Research #Software Testing and Debugging Techniques

paper · pdf · doi:10.48550/arxiv.2005.03813

openalex publication_date 2020/05/08 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/01

Abstract

It is important to be able to establish formal performance bounds for autonomous systems. However, formal verification techniques require a model of the environment in which the system operates; a challenge for autonomous systems, especially those expected to operate over longer timescales. This paper describes work in progress to automate the monitor and repair of ROS-based autonomous robot software written for an a-priori partially known and possibly incorrect environment model. A taint analysis method is used to automatically extract the data-flow sequence from input topic to publish topic, and instrument that code. A unique reinforcement learning approximation of MDP utility is calculated, an empirical and non-invasive characterization of the inherent objectives of the software designers. By comparing off-line (a-priori) utility with on-line (deployed system) utility, we show, using a small but real ROS example, that it's possible to monitor a performance criterion and relate violations of the criterion to parts of the software. The software is then patched using automated software repair techniques and evaluated against the original off-line utility.

Citations

Related