Home > Online First > Performance Analysis of Inline Compression in pySDC > print

001     1047360
005     20251127153434.0
024 7 _ |a 10.1109/HPEC67600.2025.11196695
|2 doi
037 _ _ |a FZJ-2025-04254
100 1 _ |a Lattanzio, Emily
|0 P:(DE-HGF)0
|b 0
|e Corresponding author
111 2 _ |a 2025 IEEE High Performance Extreme Computing Conference (HPEC)
|c Wakefield
|d 2025-09-15 - 2025-09-19
|w MA
245 _ _ |a Performance Analysis of Inline Compression in pySDC
260 _ _ |c 2025
|b IEEE
295 1 0 |a 2025 IEEE High Performance Extreme Computing Conference (HPEC) : [Proceedings] - IEEE, 2025. - ISBN 979-8-3315-7844-2 - doi:10.1109/HPEC67600.2025.11196695
300 _ _ |a 1-8
336 7 _ |a CONFERENCE_PAPER
|2 ORCID
336 7 _ |a Conference Paper
|0 33
|2 EndNote
336 7 _ |a INPROCEEDINGS
|2 BibTeX
336 7 _ |a conferenceObject
|2 DRIVER
336 7 _ |a Output Types/Conference Paper
|2 DataCite
336 7 _ |a Contribution to a conference proceedings
|b contrib
|m contrib
|0 PUB:(DE-HGF)8
|s 1764253743_10231
|2 PUB:(DE-HGF)
336 7 _ |a Contribution to a book
|0 PUB:(DE-HGF)7
|2 PUB:(DE-HGF)
|m contb
520 _ _ |a The volume of data required for High Performance Computing (HPC) jobs is growing faster than the memory storage available to store the required data, leading to performance bottlenecks. Hence the need for inline data compression, which reduces the amount of allocated memory needed by storing all data in its compressed format and decompressing/recompressing single variables as needed. We apply inline compression to the HPC application pySDC, a framework for parallel-in-time integration of partial differential equations. We introduce a new version of pySDC that has a compression manager to add inline compression functionality, along with a software cache that stores the decompressed state of the most frequently used variables. We use the ZFP lossy compressor to test our model with varying software cache sizes. Results show that having no cache has the best compression ratio (CR) at size 5.8, but having a cache size of 16 reduces total execution time by 2.6× while also slightly improving the memory footprint with a CR of 1.5. Our framework overall provides user versatility in the trade-off between execution time and memory savings.
536 _ _ |a 5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511)
|0 G:(DE-HGF)POF4-5112
|c POF4-511
|f POF IV
|x 0
536 _ _ |a RGRSE - RG Research Software Engineering for HPC (RG RSE) (RG-RSE)
|0 G:(DE-Juel-1)RG-RSE
|c RG-RSE
|x 1
588 _ _ |a Dataset connected to CrossRef Conference
700 1 _ |a Ranjan, Sansriti
|0 P:(DE-HGF)0
|b 1
700 1 _ |a Underwood, Robert
|0 P:(DE-HGF)0
|b 2
700 1 _ |a Baumann, Thomas
|0 P:(DE-Juel1)190575
|b 3
|u fzj
700 1 _ |a Speck, Robert
|0 P:(DE-Juel1)132268
|b 4
|u fzj
700 1 _ |a Calhoun, Jon C.
|0 P:(DE-HGF)0
|b 5
773 _ _ |a 10.1109/HPEC67600.2025.11196695
856 4 _ |u https://doi.org/10.1109/HPEC67600.2025.11196695
856 4 _ |u https://juser.fz-juelich.de/record/1047360/files/Performance_Analysis_of_Inline_Compression_in_pySDC.pdf
|y Restricted
910 1 _ |a Forschungszentrum Jülich
|0 I:(DE-588b)5008462-8
|k FZJ
|b 3
|6 P:(DE-Juel1)190575
910 1 _ |a Forschungszentrum Jülich
|0 I:(DE-588b)5008462-8
|k FZJ
|b 4
|6 P:(DE-Juel1)132268
913 1 _ |a DE-HGF
|b Key Technologies
|l Engineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action
|1 G:(DE-HGF)POF4-510
|0 G:(DE-HGF)POF4-511
|3 G:(DE-HGF)POF4
|2 G:(DE-HGF)POF4-500
|4 G:(DE-HGF)POF
|v Enabling Computational- & Data-Intensive Science and Engineering
|9 G:(DE-HGF)POF4-5112
|x 0
914 1 _ |y 2025
920 1 _ |0 I:(DE-Juel1)JSC-20090406
|k JSC
|l Jülich Supercomputing Center
|x 0
980 _ _ |a contrib
980 _ _ |a EDITORS
980 _ _ |a VDBINPRINT
980 _ _ |a contb
980 _ _ |a I:(DE-Juel1)JSC-20090406
980 _ _ |a UNRESTRICTED

LibraryCollectionCLSMajorCLSMinorLanguageAuthor
Marc 21