vix.ing · top · new · best · stats · spec

Breakdown of a Benchmark Score Without Internal Analysis of Benchmarking Program

2016/10/20 by Matagawa, Naoki, Shudo, Kazuyuki
#FOS: Computer and information sciences #Performance (cs.PF)

paper · doi:10.48550/arxiv.1610.06307

Abstract

A breakdown of a benchmark score is how much each aspect of the system performance affects the score. Existing methods require internal analysis on the benchmarking program and then involve the following problems: (1) require a certain amount of labor for code analysis, profiling, simulation, and so on and (2) require the benchmarking program itself. In this paper, we present a method for breaking down a benchmark score without internal analysis of the benchmarking program. The method utilizes regression analysis of benchmark scores on a number of systems. Experimental results with 3 benchmarks on 15 Android smartphones showed that our method could break down those benchmark scores even though there is room for improvement in accuracy.

Related