2024/03/23 by Edi Muškardin, Martin Tappler, Bernhard K. Aichernig +1 · 1 voice · 1 citation
Computer Science · Engineering · #Fault Detection and Control Systems #Formal Methods in Verification #Machine Learning and Algorithms
paper · pdf · doi:10.1007/s10270-024-01158-0
openalex publication_date 2024/03/23 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/23
Abstract Black-box systems are inherently hard to verify. Many verification techniques, like model checking, require formal models as a basis. However, such models often do not exist, or they might be outdated. Active automata learning helps to address this issue by offering to automatically infer formal models from system interactions. Hence, automata learning has been receiving much attention in the verification community in recent years. This led to various efficiency improvements, paving the way toward industrial applications. Most research, however, has been focusing on deterministic systems. In this article, we present an approach to efficiently learn models of stochastic reactive systems. Our approach adapts L^* <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:msup> <mml:mi>L</mml:mi> <mml:mo>∗</mml:mo> </mml:msup> </mml:math> -based learning for Markov decision processes, which we improve and extend to stochastic Mealy machines. When compared with previous work, our evaluation demonstrates that the proposed optimizations and adaptations to stochastic Mealy machines can reduce learning costs by an order of magnitude while improving the accuracy of learned models.