000902889 001__ 902889 000902889 005__ 20250822121304.0 000902889 020__ $$a978-3-030-90538-5 (print) 000902889 020__ $$a978-3-030-90539-2 (electronic) 000902889 0247_ $$2doi$$a10.1007/978-3-030-90539-2_31 000902889 0247_ $$2ISSN$$a0302-9743 000902889 0247_ $$2ISSN$$a1611-3349 000902889 0247_ $$2Handle$$a2128/29225 000902889 0247_ $$2WOS$$aWOS:000763168300034 000902889 037__ $$aFZJ-2021-04644 000902889 041__ $$aEnglish 000902889 1001_ $$0P:(DE-Juel1)185654$$aKesselheim, Stefan$$b0$$eCorresponding author 000902889 1112_ $$aISC High Performance 2021$$cDigital$$d2021-06-24 - 2021-07-02$$gISC21$$wGermany 000902889 245__ $$aJUWELS Booster – A Supercomputer for Large-Scale AI Research 000902889 260__ $$c2021 000902889 29510 $$aHigh Performance Computing / Jagode, Heike (Editor) 000902889 300__ $$a453 - 468 000902889 3367_ $$2ORCID$$aCONFERENCE_PAPER 000902889 3367_ $$033$$2EndNote$$aConference Paper 000902889 3367_ $$2BibTeX$$aINPROCEEDINGS 000902889 3367_ $$2DRIVER$$aconferenceObject 000902889 3367_ $$2DataCite$$aOutput Types/Conference Paper 000902889 3367_ $$0PUB:(DE-HGF)8$$2PUB:(DE-HGF)$$aContribution to a conference proceedings$$bcontrib$$mcontrib$$s1638856598_11998 000902889 3367_ $$0PUB:(DE-HGF)7$$2PUB:(DE-HGF)$$aContribution to a book$$mcontb 000902889 4900_ $$aLecture Notes in Computer Science$$v12761 000902889 520__ $$aIn this article, we present JUWELS Booster, a recently commissioned high-performance computing system at the Jülich Supercomputing Center. With its system architecture, most importantly its large number of powerful Graphics Processing Units (GPUs) and its fast interconnect via InfiniBand, it is an ideal machine for large-scale Artificial Intelligence (AI) research and applications. We detail its system architecture, parallel, distributed model training, and benchmarks indicating its outstanding performance. We exemplify its potential for research application by presenting large-scale AI research highlights from various scientific fields that require such a facility. 000902889 536__ $$0G:(DE-HGF)POF4-5112$$a5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511)$$cPOF4-511$$fPOF IV$$x0 000902889 536__ $$0G:(DE-HGF)POF4-5111$$a5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511)$$cPOF4-511$$fPOF IV$$x1 000902889 536__ $$0G:(DE-HGF)POF4-5121$$a5121 - Supercomputing & Big Data Facilities (POF4-512)$$cPOF4-512$$fPOF IV$$x2 000902889 536__ $$0G:(DE-Juel1)Helmholtz-SLNS$$aSLNS - SimLab Neuroscience (Helmholtz-SLNS)$$cHelmholtz-SLNS$$x3 000902889 536__ $$0G:(DE-Juel-1)ESDE$$aEarth System Data Exploration (ESDE)$$cESDE$$x4 000902889 536__ $$0G:(DE-Juel-1)ATML-X-DEV$$aATML-X-DEV - ATML Accelerating Devices (ATML-X-DEV)$$cATML-X-DEV$$x5 000902889 588__ $$aDataset connected to CrossRef Book Series, Journals: juser.fz-juelich.de 000902889 7001_ $$0P:(DE-Juel1)145478$$aHerten, Andreas$$b1 000902889 7001_ $$0P:(DE-Juel1)129347$$aKrajsek, Kai$$b2 000902889 7001_ $$0P:(DE-Juel1)187002$$aEbert, Jan$$b3 000902889 7001_ $$0P:(DE-Juel1)158080$$aJitsev, Jenia$$b4 000902889 7001_ $$0P:(DE-Juel1)180894$$aCherti, Mehdi$$b5 000902889 7001_ $$0P:(DE-Juel1)180790$$aLangguth, Michael$$b6 000902889 7001_ $$0P:(DE-Juel1)177767$$aGong, Bing$$b7 000902889 7001_ $$0P:(DE-Juel1)180752$$aStadtler, Scarlet$$b8 000902889 7001_ $$0P:(DE-Juel1)166264$$aMozaffari, Amirpasha$$b9 000902889 7001_ $$0P:(DE-Juel1)171343$$aCavallaro, Gabriele$$b10 000902889 7001_ $$0P:(DE-Juel1)178695$$aSedona, Rocco$$b11 000902889 7001_ $$0P:(DE-Juel1)173652$$aSchug, Alexander$$b12 000902889 7001_ $$0P:(DE-Juel1)140202$$aStrube, Alexandre$$b13 000902889 7001_ $$0P:(DE-Juel1)181065$$aKamath, Roshni$$b14 000902889 7001_ $$0P:(DE-Juel1)6952$$aSchultz, Martin G.$$b15 000902889 7001_ $$0P:(DE-Juel1)132239$$aRiedel, Morris$$b16 000902889 7001_ $$0P:(DE-Juel1)132179$$aLippert, Thomas$$b17 000902889 773__ $$a10.1007/978-3-030-90539-2_31 000902889 8564_ $$uhttps://juser.fz-juelich.de/record/902889/files/2108.11976.pdf$$yOpenAccess 000902889 909CO $$ooai:juser.fz-juelich.de:902889$$pdnbdelivery$$pdriver$$pVDB$$popen_access$$popenaire 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)185654$$aForschungszentrum Jülich$$b0$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)145478$$aForschungszentrum Jülich$$b1$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)129347$$aForschungszentrum Jülich$$b2$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)187002$$aForschungszentrum Jülich$$b3$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)158080$$aForschungszentrum Jülich$$b4$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)180894$$aForschungszentrum Jülich$$b5$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)180790$$aForschungszentrum Jülich$$b6$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)177767$$aForschungszentrum Jülich$$b7$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)180752$$aForschungszentrum Jülich$$b8$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)166264$$aForschungszentrum Jülich$$b9$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)171343$$aForschungszentrum Jülich$$b10$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)178695$$aForschungszentrum Jülich$$b11$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)173652$$aForschungszentrum Jülich$$b12$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)140202$$aForschungszentrum Jülich$$b13$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)181065$$aForschungszentrum Jülich$$b14$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)6952$$aForschungszentrum Jülich$$b15$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)132239$$aForschungszentrum Jülich$$b16$$kFZJ 000902889 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)132179$$aForschungszentrum Jülich$$b17$$kFZJ 000902889 9131_ $$0G:(DE-HGF)POF4-511$$1G:(DE-HGF)POF4-510$$2G:(DE-HGF)POF4-500$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$9G:(DE-HGF)POF4-5112$$aDE-HGF$$bKey Technologies$$lEngineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action$$vEnabling Computational- & Data-Intensive Science and Engineering$$x0 000902889 9131_ $$0G:(DE-HGF)POF4-511$$1G:(DE-HGF)POF4-510$$2G:(DE-HGF)POF4-500$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$9G:(DE-HGF)POF4-5111$$aDE-HGF$$bKey Technologies$$lEngineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action$$vEnabling Computational- & Data-Intensive Science and Engineering$$x1 000902889 9131_ $$0G:(DE-HGF)POF4-512$$1G:(DE-HGF)POF4-510$$2G:(DE-HGF)POF4-500$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$9G:(DE-HGF)POF4-5121$$aDE-HGF$$bKey Technologies$$lEngineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action$$vSupercomputing & Big Data Infrastructures$$x2 000902889 9141_ $$y2021 000902889 915__ $$0StatID:(DE-HGF)0200$$2StatID$$aDBCoverage$$bSCOPUS$$d2020-08-25 000902889 915__ $$0StatID:(DE-HGF)0510$$2StatID$$aOpenAccess 000902889 915__ $$0StatID:(DE-HGF)0420$$2StatID$$aNationallizenz$$d2020-08-25$$wger 000902889 920__ $$lyes 000902889 9201_ $$0I:(DE-Juel1)JSC-20090406$$kJSC$$lJülich Supercomputing Center$$x0 000902889 980__ $$acontrib 000902889 980__ $$aVDB 000902889 980__ $$acontb 000902889 980__ $$aI:(DE-Juel1)JSC-20090406 000902889 980__ $$aUNRESTRICTED 000902889 9801_ $$aFullTexts