vix.ing · top · new · best · stats · spec

A Systematic Mapping Study of Empirical Studies performed with Collections of Software Projects

2021/09/15 by Juan Andrés Carruthers, Carruthers, Juan Andres, Jorge Andrés Díaz Pace +3
Computer Science · #FOS: Computer and information sciences #Software Engineering (cs.SE) #Software Engineering Research #Software Engineering Techniques and Practices

paper · pdf · doi:10.48550/arxiv.2109.07624

openalex publication_date 2021/09/15 · openalex created_date 2023/01/06 · openalex updated_date 2026/07/28

Abstract

Context: software projects are common resources in Software Engineering experiments, although these are often selected without following a specific strategy, which reduces the representativeness and replication of the results. An option is the use of preserved collections of software projects, but these must be current, with explicit guidelines that guarantee their updating over a long period of time. Goal: to carry out a systematic secondary study about the strategies to select software projects in empirical studies to discover the guidelines taken into account, the degree of use of project collections, the meta-data extracted and the subsequent statistical analysis conducted. Method: A systematic mapping study to identify studies published from January 2013 to December 2020. Results: 122 studies were identified, of which the 72% used their own guidelines for project selection and the 27% used existent project collections. Likewise, there was no evidence of a standardized framework for the project selection process, nor the application of statistical methods that relates with the sample collection strategy.

Related