Journal Article

FZJ-2021-03216

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Influence of Noisy Environments on Behavior of HPC Applications

Nikitenko, D. A. (Corresponding author) ; Wolf, F. ; Mohr, B.FZJ* ; Hoefler, T. ; Stefanov, K. S. ; Voevodin, V. V. ; Antonov, A. S. ; Calotoiu, A.

2021
Springer Heidelberg

This record in other databases:  

Please use a persistent id in citations: http://hdl.handle.net/2128/28515  doi:10.1134/S1995080221070192

Abstract: Many contemporary HPC systems expose their jobs to substantial amounts of interference, leading to significant run-to-run variation. For example, application runtimes on Theta, a Cray XC40 system at Argonne National Laboratory, vary by up to 70%, caused by a mix of node-level and system-level effects, including network and file-system congestion in the presence of concurrently running jobs. This makes performance measurements generally irreproducible, heavily complicating performance analysis and modeling. On noisy systems, performance analysts usually have to repeat performance measurements several times and then apply statistics to capture trends. First, this is expensive and, second, extracting trends from a limited series of experiments is far from trivial, as the noise can follow quite irregular patterns. Attempts to learn from performance data how a program would perform under different execution configurations experience serious perturbation, resulting in models that reflect noise rather than intrinsic application behavior. On the other hand, although noise heavily influences execution time and energy consumption, it does not change the computational effort a program performs. Effort metrics that count how many operations a machine executes on behalf of a program, such as floating-point operations, the exchange of MPI messages, or file reads and writes, remain largely unaffected and—rare non-determinism set aside—reproducible. This paper addresses initial stage of an ExtraNoise project, which is aimed at revealing and tackling key questions of system noise influence on HPC applications.

---

Contributing Institute(s):

1. Jülich Supercomputing Center (JSC)

Research Program(s):

1. 5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511) (POF4-511)
2. ExtraNoise – Leistungsanalyse von HPC-Anwendungen in verrauschten Umgebungen (449683531) (449683531)
3. ATMLPP - ATML Parallel Performance (ATMLPP) (ATMLPP)

Appears in the scientific report 2021

---

Database coverage:
; Clarivate Analytics Master Journal List ; DEAL Springer ; Emerging Sources Citation Index ; SCOPUS ; Web of Science Core Collection

---