vix.ing · top · new · best · stats · spec

Robust Dynamic Selection of Tested Modules in Software Testing for Maximizing Delivered Reliability

2013/09/12 by Ping Cao, Cao, Ping, Zhao Dong +6
Computer Science · Engineering · #FOS: Computer and information sciences #Reliability and Maintenance Optimization #Software Engineering (cs.SE) #Software Reliability and Analysis Research #Software Testing and Debugging Techniques #cs.SE

paper · pdf · doi:10.48550/arxiv.1309.3052

19 pages, 4 figures

openalex publication_date 2013/09/12 · openalex created_date 2016/06/24 · arxiv created 2017/01/16 · arxiv updated 2017/01/17 · openalex updated_date 2026/07/28

Abstract

Software testing is aimed to improve the delivered reliability of the users. Delivered reliability is the reliability of using the software after it is delivered to the users. Usually the software consists of many modules. Thus, the delivered reliability is dependent on the operational profile which specifies how the users will use these modules as well as the defect number remaining in each module. Therefore, a good testing policy should take the operational profile into account and dynamically select tested modules according to the current state of the software during the testing process. This paper discusses how to dynamically select tested modules in order to maximize delivered reliability by formulating the selection problem as a dynamic programming problem. As the testing process is performed only once, risk must be considered during the testing process, which is described by the tester's utility function in this paper. Besides, since usually the tester has no accurate estimate of the operational profile, by employing robust optimization technique, we analysis the selection problem in the worst case, given the uncertainty set of operational profile. By numerical examples, we show the necessity of maximizing delivered reliability directly and using robust optimization technique when the tester has no clear idea of the operational profile. Moreover, it is shown that the risk averse behavior of the tester has a major influence on the delivered reliability.

Related