JUWELS Booster – A Supercomputer for Large-Scale AI Research

Kesselheim, Stefan; Kamath, Roshni; Stadtler, Scarlet; Gong, Bing; Schug, Alexander; Schultz, Martin G.; Cherti, Mehdi; Herten, Andreas; Sedona, Rocco; Ebert, Jan; Krajsek, Kai; Jitsev, Jenia; Mozaffari, Amirpasha; Strube, Alexandre; Cavallaro, Gabriele; Riedel, Morris; Langguth, Michael; Lippert, Thomas

doi:10.1007/978-3-030-90539-2_31

Contribution to a conference proceedings/Contribution to a book

FZJ-2021-04644

JUWELS Booster – A Supercomputer for Large-Scale AI Research

Kesselheim, S. (Corresponding author)FZJ* ; Herten, A.FZJ* ; Krajsek, K.FZJ* ; Ebert, J.FZJ* ; Jitsev, J.FZJ* ; Cherti, M.FZJ* ; Langguth, M.FZJ* ; Gong, B.FZJ* ; Stadtler, S.FZJ* ; Mozaffari, A.FZJ* ; Cavallaro, G.FZJ* ; Sedona, R.FZJ* ; Schug, A.FZJ* ; Strube, A.FZJ* ; Kamath, R.FZJ* ; Schultz, M. G.FZJ* ; Riedel, M.FZJ* ; Lippert, T.FZJ*

2021

ISBN: 978-3-030-90538-5 (print), 978-3-030-90539-2 (electronic)

High Performance Computing / Jagode, Heike (Editor)
ISC High Performance 2021, ISC21, Digital, Germany, 24 Jun 2021 - 2 Jul 2021 Lecture Notes in Computer Science 12761, 453 - 468 (2021) [10.1007/978-3-030-90539-2_31]

This record in other databases:

Please use a persistent id in citations: http://hdl.handle.net/2128/29225 doi:10.1007/978-3-030-90539-2_31

Abstract: In this article, we present JUWELS Booster, a recently commissioned high-performance computing system at the Jülich Supercomputing Center. With its system architecture, most importantly its large number of powerful Graphics Processing Units (GPUs) and its fast interconnect via InfiniBand, it is an ideal machine for large-scale Artificial Intelligence (AI) research and applications. We detail its system architecture, parallel, distributed model training, and benchmarks indicating its outstanding performance. We exemplify its potential for research application by presenting large-scale AI research highlights from various scientific fields that require such a facility.

Contributing Institute(s):