Contribution to a conference proceedings/Contribution to a book FZJ-2026-05606

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
An Algorithm for Feature Extraction from Large Scale Meteorological Data Stores on Irregular Grids

 ;  ;  ;

2026
ACM New York, NY, USA NY, USA

Proceedings of the Platform for Advanced Scientific Computing Conference
Platform for Advanced Scientific Computing Conference, PASC '26, BernBern, Switzerland, 29 Jun 2026 - 1 Jul 20262026-06-292026-07-01
NY, USA : ACM New York, NY, USA 1 - 11 () [10.1145/3815572.3815740]

This record in other databases:  

Please use a persistent id in citations: doi:  doi:

Abstract: In recent years, the volume of meteorological data has grown rapidly due to higher model resolutions and more frequent data output. To handle this increase efficiently, the European Centre for Medium-Range Weather Forecasts has developed new ways to extract data without accessing full meteorological fields through their feature extraction capabilities. This includes in particular the Polytope algorithm, which lets users extract time series or regional subsets directly from the data backends, greatly reducing data transfer and processing time. However, the current algorithm only works on structured iso-latitude grids such as octahedral or HEALPix grids. Many modern meteorological models, by contrast, use unstructured grids where points do not align along latitudes, such as Lambert conformal or ICON icosahedral grids. In this paper, we extend the Polytope algorithm to support these irregular grids. We first explain why the original approach was limited to structured data before introducing a new extraction method, which uses the well-studied quadtree data structure. As a popular data structure in geospatial applications, we focus on describing how quadtrees can be integrated within the Polytope feature extraction framework to handle complex grid geometries. We then assess the performance and scalability of this algorithm, which performs on par with state-of-the-art alternatives used in geospatial applications. In particular, the extended algorithm outperforms other methods when accessing large or complex regions and therefore offers a compelling alternative to current data extraction techniques for large-scale datasets. Finally, we conclude by discussing how this algorithm can be integrated into an operational data service.


Contributing Institute(s):
  1. Jülich Supercomputing Center (JSC)
Research Program(s):
  1. 5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511) (POF4-511)
  2. Earth System Data Exploration (ESDE) (ESDE)

Appears in the scientific report 2026
Database coverage:
Creative Commons Attribution CC BY 4.0 ; OpenAccess
Click to display QR Code for this record

The record appears in these collections:
Document types > Events > Contributions to a conference proceedings
Document types > Books > Contribution to a book
Workflow collections > Public records
Institute Collections > JSC
Publications database
Open Access

 Record created 2026-11-05, last modified 2026-11-16


OpenAccess:
Download fulltext PDF
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)