vix.ing · top · new · best · stats · spec

Detection of Performance Changes in MooBench Results Using Nyrkiö on GitHub Actions

2025/10/13 by Shinhyung Yang, David Georg Reichelt, Yang, Shinhyung +5
Computer Science · #Software System Performance and Reliability #Mobile Agent-Based Network Management #Software Testing and Debugging Techniques

paper · doi:10.48550/arxiv.2510.11310

Abstract

In GitHub with its 518 million hosted projects, performance changes within these projects are highly relevant to the project's users. Although performance measurement is supported by GitHub CI/CD, performance change detection is a challenging topic. In this paper, we demonstrate how we incorporated Nyrkiö to MooBench. Prior to this work, Moobench continuously ran on GitHub virtual machines, measuring overhead of tracing agents, but without change detection. By adding the upload of the measurements to the Nyrkiö change detection service, we made it possible to detect performance changes. We identified one major performance regression and examined the performance change in depth. We report that (1) it is reproducible with GitHub actions, and (2) the performance regression is caused by a Linux Kernel version change.

Citations

Related