vix.ing · top · new · best · stats

Breakdown of a Benchmark Score Without Internal Analysis of Benchmarking Program

2016/10/20 by Naoki Matagawa, Matagawa, Naoki, Kazuyuki Shudo +1
Computer Science · Engineering · #FOS: Computer and information sciences #Green IT and Sustainability #Parallel Computing and Optimization Techniques #Performance (cs.PF) #Software System Performance and Reliability #cs.PF

paper · pdf · doi:10.48550/arxiv.1610.06307

6 pages, 2 figures

arxiv created 2016/10/20 · openalex publication_date 2016/10/20 · arxiv updated 2016/10/21 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

A breakdown of a benchmark score is how much each aspect of the system performance affects the score. Existing methods require internal analysis on the benchmarking program and then involve the following problems: (1) require a certain amount of labor for code analysis, profiling, simulation, and so on and (2) require the benchmarking program itself. In this paper, we present a method for breaking down a benchmark score without internal analysis of the benchmarking program. The method utilizes regression analysis of benchmark scores on a number of systems. Experimental results with 3 benchmarks on 15 Android smartphones showed that our method could break down those benchmark scores even though there is room for improvement in accuracy.

Related