Contribution to a conference proceedings

FZJ-2018-00596

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Job Management and Task Bundling

Berkowitz, E. (Corresponding author)FZJ* ; Jansen, G. R. ; McElvain, K. ; Walker-Loud, A.

2017

This record in other databases:

Please use a persistent id in citations: http://hdl.handle.net/2128/17005

Abstract: High Performance Computing is often performed on scarce and shared computing resources. To ensure computers are used to their full capacity, administrators often incentivize large workloads that are not possible on smaller systems. Measurements in Lattice QCD frequently do not scale to machine-size workloads. By bundling tasks together we can create large jobs suitable for gigantic partitions. We discuss METAQ and mpi_jm, software developed to dynamically group computational tasks together, that can intelligently backfill to consume idle time without substantial changes to users' current workflows or executables.

Note: 8 pages, 3 figures, LATTICE 2017 proceedings

---

Contributing Institute(s):

1. Theorie der Starken Wechselwirkung (IAS-4)
2. Theorie der starken Wechselwirkung (IKP-3)

Research Program(s):

1. 511 - Computational Science and Mathematical Methods (POF3-511) (POF3-511)
2. DFG project 196253076 - TRR 110: Symmetrien und Strukturbildung in der Quantenchromodynamik (196253076) (196253076)

Appears in the scientific report 2017

---

Database coverage:

---