
AbstractHigh-performance computing (HPC) benchmarks are widely used to evaluate and rank system performance. This paper introduces a benchmark assessment tool equipped with a rigorous statistical method to evaluate HPC benchmarks against a set of scientific applications. The method is based on the combination of Variable Clustering (VarCluster) and Principal Component Analysis (PCA). We built the tool upon HPC Challenge (HPCC) benchmark suite and six popular scientific applications of Kraken, a petaflop supercomputer. Experimental results show that HPCC's Fast Fourier Transform (FFT) kernel, rather than the High-Performance Linpack (HPL) on which Top500 is based, is more representative of the HPC workloads on Kraken.
statistical method, principal component analysis, performance analysis, variable clustering
statistical method, principal component analysis, performance analysis, variable clustering
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 8 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
