Mutation Testing with Hyperproperties

2019/07/17 by Fellner, Andreas, Befrouei, Mitra Tabaei, Weissenbacher, Georg · 2 citations
#B.6.2 #D.2.5 #F.3.1 #FOS: Computer and information sciences #Logic in Computer Science (cs.LO) #Software Engineering (cs.SE)

paper · doi:10.48550/arxiv.1907.07368

Abstract

We present a new method for model-based mutation-driven test case generation. Mutants are generated by making small syntactical modifications to the model or source code of the system under test. A test case kills a mutant if the behavior of the mutant deviates from the original system when running the test. In this work, we use hyperproperties-which allow to express relations between multiple executions-to formalize different notions of killing for both deterministic as well as non-deterministic models. The resulting hyperproperties are universal in the sense that they apply to arbitrary reactive models and mutants. Moreover, an off-the-shelf model checking tool for hyperproperties can be used to generate test cases. We evaluate our approach on a number of models expressed in two different modeling languages by generating tests using a state-of-the-art mutation testing tool.

Cited by

• Model checking of hyperproperties for high-level relational models
• A formalization of Heisenbugs and their causes in terms of hyperproperties

Related

• A Theoretical Framework for Understanding Mutation-Based Testing Methods
• μBERT: Mutation Testing using Pre-Trained Language Models
• Mutation Testing via Iterative Large Language Model-Driven Scientific Debugging
• Efficient Mutation Testing via Pre-Trained Language Models
• Using State Infection Conditions to Detect Equivalent Mutants and Speed up Mutation Analysis