Conference Presentation (After Call) FZJ-2025-02971

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Compression of meteorological reanalysis data using multiresolution analysis and their application to trajectory calculations

 ;  ;  ;

2025

Platform for Advanced Scientific Computing, PASC25, BruggBrugg, Switzerland, 16 Jun 2025 - 18 Jun 20252025-06-162025-06-18

Abstract: The storage requirements for meteorological reanalysis data have increased significantly in recent years. To address the challenges of handling these large data sets, efficient compression techniques are required. In addition, the error of the compressed data should be as small as possible. Although lossless compression algorithms exist, the resulting data are still too large. Conversely, lossy compression formats allow a small file size, but are often not able to control the error relative to the original data. We propose a multiresolution-based grid adaptation as an alternative method for lossy compression. To do this, we perform a multiresolution analysis using multiwavelets on a hierarchy of nestedgrids. This method provides us with local information on the differences between successive refinement levels. Since smooth regions have small local differences, we apply hard thresholding to resolve these regions on a coarser grid. Thus, the data is projected onto an adaptive grid where only regions with steep gradients or discontinuities have a high resolution, which significantly reduces the file size. We present how data compression is achieved by applying multiresolution-based grid adaptation using ERA5 meteorological reanalysis data. We additionally discuss the implementation of this method into the Lagrangian model for Massive-Parallel Trajectory Calculation (MPTRAC).


Contributing Institute(s):
  1. Jülich Supercomputing Center (JSC)
Research Program(s):
  1. 5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511) (POF4-511)
  2. ADAPTEX - Adaptive Erdsystemmodellierung mit stark reduzierter Berechnungsdauer für Exascale-Supercomputer (16ME0670) (16ME0670)

Appears in the scientific report 2025
Click to display QR Code for this record

The record appears in these collections:
Document types > Presentations > Conference Presentations
Workflow collections > Public records
Institute Collections > JSC
Publications database

 Record created 2025-07-04, last modified 2025-07-31


External link:
Download fulltext
Fulltext
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)