guest ::
| Home > Publications database > Efficient Distributed GPU Programming for Exascale > print |
| 001 | 916372 | ||
| 005 | 20250822121410.0 | ||
| 024 | 7 | _ | |a 10.5281/ZENODO.6603470 |2 doi |
| 037 | _ | _ | |a FZJ-2022-06173 |
| 041 | _ | _ | |a English |
| 100 | 1 | _ | |a Garcia de Gonzalo, Simon |0 0000-0002-5699-1793 |b 0 |
| 111 | 2 | _ | |a ISC High Performance 2022 |g ISC22 |c Hamburg |d 2022-05-29 - 2022-05-29 |w Germany |
| 245 | _ | _ | |a Efficient Distributed GPU Programming for Exascale |
| 260 | _ | _ | |c 2022 |
| 336 | 7 | _ | |a lecture |2 DRIVER |
| 336 | 7 | _ | |a Generic |0 31 |2 EndNote |
| 336 | 7 | _ | |a MISC |2 BibTeX |
| 336 | 7 | _ | |a Lecture |b lecture |m lecture |0 PUB:(DE-HGF)17 |s 1671622902_4311 |2 PUB:(DE-HGF) |x After Call |
| 336 | 7 | _ | |a LECTURE_SPEECH |2 ORCID |
| 336 | 7 | _ | |a Text |2 DataCite |
| 520 | _ | _ | |a Over the past years, GPUs became ubiquitous in HPC installations around the world. Today, they provide the majority of performance of some of the largest supercomputers (e.g. Summit, Sierra, JUWELS Booster). This trend continues in the pre-exascale and exascale systems (LUMI, Leonardo; Perlmutter, Frontier): GPUs are chosen as the core computing devices to enter this next era of HPC. To take advantage of future GPU-accelerated systems with tens of thousands of devices, application developers need to have the propers skills and tools to understand, manage, and optimize distributed GPU applications. In this tutorial, participants will learn techniques to efficiently program large-scale multi-GPU systems. While programming multiple GPUs with MPI is explained in detail, advanced tuning techniques and complementary programming models like NCCL and NVSHMEM are presented as well. Tools for analysis are shown and used to motivate and implement performance optimizations. The tutorial is a combination of lectures and hands-on exercises, using Europe's fastest supercomputer, JUWELS Booster with NVIDIA GPUs, for interactive learning and discovery. |
| 536 | _ | _ | |a 5122 - Future Computing & Big Data Systems (POF4-512) |0 G:(DE-HGF)POF4-5122 |c POF4-512 |f POF IV |x 0 |
| 536 | _ | _ | |a 5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511) |0 G:(DE-HGF)POF4-5112 |c POF4-511 |f POF IV |x 1 |
| 536 | _ | _ | |a 5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511) |0 G:(DE-HGF)POF4-5111 |c POF4-511 |f POF IV |x 2 |
| 536 | _ | _ | |a ATML-X-DEV - ATML Accelerating Devices (ATML-X-DEV) |0 G:(DE-Juel-1)ATML-X-DEV |c ATML-X-DEV |x 3 |
| 588 | _ | _ | |a Dataset connected to DataCite |
| 700 | 1 | _ | |a Oden, Lena |0 P:(DE-Juel1)188270 |b 1 |u fzj |
| 700 | 1 | _ | |a Herten, Andreas |0 P:(DE-Juel1)145478 |b 2 |e Corresponding author |
| 700 | 1 | _ | |a Hrywniak, Markus |0 P:(DE-Juel1)180799 |b 3 |
| 700 | 1 | _ | |a Kraus, Jiri |0 P:(DE-Juel1)137023 |b 4 |
| 773 | _ | _ | |a 10.5281/ZENODO.6603470 |
| 856 | 4 | _ | |u https://github.com/FZJ-JSC/tutorial-multi-gpu/tree/v2.0-isc22 |
| 909 | C | O | |o oai:juser.fz-juelich.de:916372 |p VDB |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 1 |6 P:(DE-Juel1)188270 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 2 |6 P:(DE-Juel1)145478 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 3 |6 P:(DE-Juel1)180799 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 4 |6 P:(DE-Juel1)137023 |
| 913 | 1 | _ | |a DE-HGF |b Key Technologies |l Engineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action |1 G:(DE-HGF)POF4-510 |0 G:(DE-HGF)POF4-512 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-500 |4 G:(DE-HGF)POF |v Supercomputing & Big Data Infrastructures |9 G:(DE-HGF)POF4-5122 |x 0 |
| 913 | 1 | _ | |a DE-HGF |b Key Technologies |l Engineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action |1 G:(DE-HGF)POF4-510 |0 G:(DE-HGF)POF4-511 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-500 |4 G:(DE-HGF)POF |v Enabling Computational- & Data-Intensive Science and Engineering |9 G:(DE-HGF)POF4-5112 |x 1 |
| 913 | 1 | _ | |a DE-HGF |b Key Technologies |l Engineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action |1 G:(DE-HGF)POF4-510 |0 G:(DE-HGF)POF4-511 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-500 |4 G:(DE-HGF)POF |v Enabling Computational- & Data-Intensive Science and Engineering |9 G:(DE-HGF)POF4-5111 |x 2 |
| 914 | 1 | _ | |y 2022 |
| 920 | 1 | _ | |0 I:(DE-Juel1)JSC-20090406 |k JSC |l Jülich Supercomputing Center |x 0 |
| 980 | _ | _ | |a lecture |
| 980 | _ | _ | |a VDB |
| 980 | _ | _ | |a I:(DE-Juel1)JSC-20090406 |
| 980 | _ | _ | |a UNRESTRICTED |
| Library | Collection | CLSMajor | CLSMinor | Language | Author |
|---|