Home > Workflow collections > Publication Charges > Accelerating Lagrangian transport simulations on graphics processing units: performance optimizations of Massive-Parallel Trajectory Calculations (MPTRAC) v2.6 > print

001     1026442
005     20250822121332.0
024 7 _ |a 10.5194/gmd-17-4077-2024
|2 doi
024 7 _ |a 1991-959X
|2 ISSN
024 7 _ |a 1991-9603
|2 ISSN
024 7 _ |a 10.34734/FZJ-2024-03395
|2 datacite_doi
024 7 _ |a WOS:001226505800001
|2 WOS
037 _ _ |a FZJ-2024-03395
041 _ _ |a English
082 _ _ |a 550
100 1 _ |a Hoffmann, Lars
|0 P:(DE-Juel1)129125
|b 0
|e Corresponding author
|u fzj
245 _ _ |a Accelerating Lagrangian transport simulations on graphics processing units: performance optimizations of Massive-Parallel Trajectory Calculations (MPTRAC) v2.6
260 _ _ |a Katlenburg-Lindau
|c 2024
|b Copernicus
336 7 _ |a article
|2 DRIVER
336 7 _ |a Output Types/Journal article
|2 DataCite
336 7 _ |a Journal Article
|b journal
|m journal
|0 PUB:(DE-HGF)16
|s 1717745098_3799
|2 PUB:(DE-HGF)
336 7 _ |a ARTICLE
|2 BibTeX
336 7 _ |a JOURNAL_ARTICLE
|2 ORCID
336 7 _ |a Journal Article
|0 0
|2 EndNote
520 _ _ |a Lagrangian particle dispersion models are indispensable tools for the study of atmospheric transport processes. However, Lagrangian transport simulations can become numerically expensive when large numbers of air parcels are involved. To accelerate these simulations, we made considerable efforts to port the Massive-Parallel Trajectory Calculations (MPTRAC) model to graphics processing units (GPUs). Here we discuss performance optimizations of the major bottleneck of the GPU code of MPTRAC, the advection kernel. Timeline, roofline, and memory analyses of the baseline GPU code revealed that the application is memory-bound, and performance suffers from near-random memory access patterns. By changing the data structure of the horizontal wind and vertical velocity fields of the global meteorological data driving the simulations from structure of arrays (SoAs) to array of structures (AoSs) and by introducing a sorting method for better memory alignment of the particle data, performance was greatly improved. We evaluated the performance on NVIDIA A100 GPUs of the Jülich Wizard for European Leadership Science (JUWELS) Booster module at the Jülich Supercomputing Center, Germany. For our largest test case, transport simulations with 108 particles driven by the European Centre for Medium-Range Weather Forecasts (ECMWF) ERA5 reanalysis, we found that the runtime for the full set of physics computations was reduced by 75 %, including a reduction of 85 % for the advection kernel. In addition to demonstrating the benefits of code optimization for GPUs, we show that the runtime of central processing unit (CPU-)only simulations is also improved. For our largest test case, we found a runtime reduction of 34 % for the physics computations, including a reduction of 65 % for the advection kernel. The code optimizations discussed here bring the MPTRAC model closer to applications on upcoming exascale high-performance computing systems and will also be of interest for optimizing the performance of other models using particle methods.
536 _ _ |a 5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511)
|0 G:(DE-HGF)POF4-5111
|c POF4-511
|f POF IV
|x 0
536 _ _ |a 2112 - Climate Feedbacks (POF4-211)
|0 G:(DE-HGF)POF4-2112
|c POF4-211
|f POF IV
|x 1
536 _ _ |a 5122 - Future Computing & Big Data Systems (POF4-512)
|0 G:(DE-HGF)POF4-5122
|c POF4-512
|f POF IV
|x 2
536 _ _ |a 5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511)
|0 G:(DE-HGF)POF4-5112
|c POF4-511
|f POF IV
|x 3
536 _ _ |a ATML-X-DEV - ATML Accelerating Devices (ATML-X-DEV)
|0 G:(DE-Juel-1)ATML-X-DEV
|c ATML-X-DEV
|x 4
588 _ _ |a Dataset connected to CrossRef, Journals: juser.fz-juelich.de
700 1 _ |a Haghighi Mood, Kaveh
|0 P:(DE-Juel1)176293
|b 1
700 1 _ |a Herten, Andreas
|0 P:(DE-Juel1)145478
|b 2
700 1 _ |a Hrywniak, Markus
|0 P:(DE-HGF)0
|b 3
700 1 _ |a Kraus, Jiri
|0 P:(DE-HGF)0
|b 4
700 1 _ |a Clemens, Jan
|0 P:(DE-Juel1)180256
|b 5
700 1 _ |a Liu, Mingzhao
|0 P:(DE-Juel1)187051
|b 6
773 _ _ |a 10.5194/gmd-17-4077-2024
|g Vol. 17, no. 9, p. 4077 - 4094
|0 PERI:(DE-600)2456725-5
|n 9
|p 4077 - 4094
|t Geoscientific model development
|v 17
|y 2024
|x 1991-959X
856 4 _ |u https://juser.fz-juelich.de/record/1026442/files/Invoice_Helmholtz-PUC-2024-57.pdf
856 4 _ |x icon
|u https://juser.fz-juelich.de/record/1026442/files/Invoice_Helmholtz-PUC-2024-57.gif?subformat=icon
856 4 _ |x icon-1440
|u https://juser.fz-juelich.de/record/1026442/files/Invoice_Helmholtz-PUC-2024-57.jpg?subformat=icon-1440
856 4 _ |x icon-180
|u https://juser.fz-juelich.de/record/1026442/files/Invoice_Helmholtz-PUC-2024-57.jpg?subformat=icon-180
856 4 _ |x icon-640
|u https://juser.fz-juelich.de/record/1026442/files/Invoice_Helmholtz-PUC-2024-57.jpg?subformat=icon-640
856 4 _ |y OpenAccess
|u https://juser.fz-juelich.de/record/1026442/files/gmd-17-4077-2024.pdf
856 4 _ |y OpenAccess
|x icon
|u https://juser.fz-juelich.de/record/1026442/files/gmd-17-4077-2024.gif?subformat=icon
856 4 _ |y OpenAccess
|x icon-1440
|u https://juser.fz-juelich.de/record/1026442/files/gmd-17-4077-2024.jpg?subformat=icon-1440
856 4 _ |y OpenAccess
|x icon-180
|u https://juser.fz-juelich.de/record/1026442/files/gmd-17-4077-2024.jpg?subformat=icon-180
856 4 _ |y OpenAccess
|x icon-640
|u https://juser.fz-juelich.de/record/1026442/files/gmd-17-4077-2024.jpg?subformat=icon-640
909 C O |o oai:juser.fz-juelich.de:1026442
|p openaire
|p open_access
|p OpenAPC
|p driver
|p VDB
|p openCost
|p dnbdelivery
910 1 _ |a Forschungszentrum Jülich
|0 I:(DE-588b)5008462-8
|k FZJ
|b 0
|6 P:(DE-Juel1)129125
910 1 _ |a Forschungszentrum Jülich
|0 I:(DE-588b)5008462-8
|k FZJ
|b 1
|6 P:(DE-Juel1)176293
910 1 _ |a Forschungszentrum Jülich
|0 I:(DE-588b)5008462-8
|k FZJ
|b 2
|6 P:(DE-Juel1)145478
910 1 _ |a Forschungszentrum Jülich
|0 I:(DE-588b)5008462-8
|k FZJ
|b 5
|6 P:(DE-Juel1)180256
910 1 _ |a Forschungszentrum Jülich
|0 I:(DE-588b)5008462-8
|k FZJ
|b 6
|6 P:(DE-Juel1)187051
913 1 _ |a DE-HGF
|b Key Technologies
|l Engineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action
|1 G:(DE-HGF)POF4-510
|0 G:(DE-HGF)POF4-511
|3 G:(DE-HGF)POF4
|2 G:(DE-HGF)POF4-500
|4 G:(DE-HGF)POF
|v Enabling Computational- & Data-Intensive Science and Engineering
|9 G:(DE-HGF)POF4-5111
|x 0
913 1 _ |a DE-HGF
|b Forschungsbereich Erde und Umwelt
|l Erde im Wandel – Unsere Zukunft nachhaltig gestalten
|1 G:(DE-HGF)POF4-210
|0 G:(DE-HGF)POF4-211
|3 G:(DE-HGF)POF4
|2 G:(DE-HGF)POF4-200
|4 G:(DE-HGF)POF
|v Die Atmosphäre im globalen Wandel
|9 G:(DE-HGF)POF4-2112
|x 1
913 1 _ |a DE-HGF
|b Key Technologies
|l Engineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action
|1 G:(DE-HGF)POF4-510
|0 G:(DE-HGF)POF4-512
|3 G:(DE-HGF)POF4
|2 G:(DE-HGF)POF4-500
|4 G:(DE-HGF)POF
|v Supercomputing & Big Data Infrastructures
|9 G:(DE-HGF)POF4-5122
|x 2
913 1 _ |a DE-HGF
|b Key Technologies
|l Engineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action
|1 G:(DE-HGF)POF4-510
|0 G:(DE-HGF)POF4-511
|3 G:(DE-HGF)POF4
|2 G:(DE-HGF)POF4-500
|4 G:(DE-HGF)POF
|v Enabling Computational- & Data-Intensive Science and Engineering
|9 G:(DE-HGF)POF4-5112
|x 3
914 1 _ |y 2024
915 p c |a APC keys set
|0 PC:(DE-HGF)0000
|2 APC
915 p c |a DOAJ Journal
|0 PC:(DE-HGF)0003
|2 APC
915 _ _ |a DBCoverage
|0 StatID:(DE-HGF)0160
|2 StatID
|b Essential Science Indicators
|d 2023-10-25
915 _ _ |a Creative Commons Attribution CC BY 4.0
|0 LIC:(DE-HGF)CCBY4
|2 HGFVOC
915 _ _ |a DBCoverage
|0 StatID:(DE-HGF)0501
|2 StatID
|b DOAJ Seal
|d 2022-12-20T09:29:04Z
915 _ _ |a DBCoverage
|0 StatID:(DE-HGF)0500
|2 StatID
|b DOAJ
|d 2022-12-20T09:29:04Z
915 _ _ |a WoS
|0 StatID:(DE-HGF)0113
|2 StatID
|b Science Citation Index Expanded
|d 2023-10-25
915 _ _ |a Fees
|0 StatID:(DE-HGF)0700
|2 StatID
|d 2023-10-25
915 _ _ |a OpenAccess
|0 StatID:(DE-HGF)0510
|2 StatID
915 _ _ |a Article Processing Charges
|0 StatID:(DE-HGF)0561
|2 StatID
|d 2023-10-25
915 _ _ |a DBCoverage
|0 StatID:(DE-HGF)0200
|2 StatID
|b SCOPUS
|d 2024-12-21
915 _ _ |a DBCoverage
|0 StatID:(DE-HGF)0300
|2 StatID
|b Medline
|d 2024-12-21
915 _ _ |a Peer Review
|0 StatID:(DE-HGF)0030
|2 StatID
|b DOAJ : Open peer review
|d 2022-12-20T09:29:04Z
915 _ _ |a DBCoverage
|0 StatID:(DE-HGF)0600
|2 StatID
|b Ebsco Academic Search
|d 2024-12-21
915 _ _ |a Peer Review
|0 StatID:(DE-HGF)0030
|2 StatID
|b ASC
|d 2024-12-21
915 _ _ |a DBCoverage
|0 StatID:(DE-HGF)0199
|2 StatID
|b Clarivate Analytics Master Journal List
|d 2024-12-21
915 _ _ |a DBCoverage
|0 StatID:(DE-HGF)1150
|2 StatID
|b Current Contents - Physical, Chemical and Earth Sciences
|d 2024-12-21
915 _ _ |a DBCoverage
|0 StatID:(DE-HGF)0150
|2 StatID
|b Web of Science Core Collection
|d 2024-12-21
920 _ _ |l yes
920 1 _ |0 I:(DE-Juel1)JSC-20090406
|k JSC
|l Jülich Supercomputing Center
|x 0
920 1 _ |0 I:(DE-Juel1)IEK-7-20101013
|k IEK-7
|l Stratosphäre
|x 1
920 1 _ |0 I:(DE-Juel1)CASA-20230315
|k CASA
|l Center for Advanced Simulation and Analytics
|x 2
980 1 _ |a APC
980 1 _ |a FullTexts
980 _ _ |a journal
980 _ _ |a VDB
980 _ _ |a UNRESTRICTED
980 _ _ |a I:(DE-Juel1)JSC-20090406
980 _ _ |a I:(DE-Juel1)IEK-7-20101013
980 _ _ |a I:(DE-Juel1)CASA-20230315
980 _ _ |a APC
981 _ _ |a I:(DE-Juel1)ICE-4-20101013

LibraryCollectionCLSMajorCLSMinorLanguageAuthor
Marc 21