guest ::
| Home > Publications database > Performance Analysis of an Efficient Algorithm for Feature Extraction from Large Scale Meteorological Data Stores > print |
| Home > Publications database > Performance Analysis of an Efficient Algorithm for Feature Extraction from Large Scale Meteorological Data Stores > print |
| 001 | 1052688 | ||
| 005 | 20260127203443.0 | ||
| 024 | 7 | _ | |a 10.1145/3732775.3733573 |2 doi |
| 024 | 7 | _ | |a 10.34734/FZJ-2026-01056 |2 datacite_doi |
| 037 | _ | _ | |a FZJ-2026-01056 |
| 100 | 1 | _ | |a Leuridan, Mathilde |0 P:(DE-HGF)0 |b 0 |
| 111 | 2 | _ | |a PASC '25: Platform for Advanced Scientific Computing Conference |g PASC 2025 |c FHNW University of Applied Sciences and Arts Northwestern Switzerland Brugg-Windisch |d 2025-06-16 - 2025-06-18 |w Switzerland |
| 245 | _ | _ | |a Performance Analysis of an Efficient Algorithm for Feature Extraction from Large Scale Meteorological Data Stores |
| 260 | _ | _ | |a New York, NY, USA |c 2025 |b ACM |
| 295 | 1 | 0 | |a Proceedings of the Platform for Advanced Scientific Computing Conference |
| 300 | _ | _ | |a 9 p. |
| 336 | 7 | _ | |a CONFERENCE_PAPER |2 ORCID |
| 336 | 7 | _ | |a Conference Paper |0 33 |2 EndNote |
| 336 | 7 | _ | |a INPROCEEDINGS |2 BibTeX |
| 336 | 7 | _ | |a conferenceObject |2 DRIVER |
| 336 | 7 | _ | |a Output Types/Conference Paper |2 DataCite |
| 336 | 7 | _ | |a Contribution to a conference proceedings |b contrib |m contrib |0 PUB:(DE-HGF)8 |s 1769455145_15815 |2 PUB:(DE-HGF) |
| 336 | 7 | _ | |a Contribution to a book |0 PUB:(DE-HGF)7 |2 PUB:(DE-HGF) |m contb |
| 520 | _ | _ | |a In recent years, Numerical Weather Prediction (NWP) has undergone a major shift with the rapid move towards kilometer-scale global weather forecasts and the emergence of AI-based forecasting models. Together, these trends will contribute to a significant increase in the daily data volume generated by NWP models. Ensuring efficient and timely access to this growing data requires innovative data extraction techniques. As an alternative to traditional data extraction algorithms, the European Centre for Medium-Range Weather Forecasts (ECMWF) has introduced the Polytope feature extraction algorithm. This algorithm is designed to reduce data transfer between systems to a bare minimum by allowing the extraction of non-orthogonal shapes of data. In this paper, we evaluate Polytope's suitability as a replacement for current extraction mechanisms in operational weather forecasting. We first adapt the Polytope algorithm to operate on ECMWF's FDB (Fields DataBase) meteorological data stores, before evaluating this integrated system's performance and scalability on real-time operational data. Our analysis shows that the low overhead of running the Polytope algorithm, which is in the order of a few seconds at most, is far outweighed by the benefits of significantly reducing the size of the extracted data by up to several orders of magnitude compared to traditional bounding box methods. Our ensuing discussion focuses on quantifying the strengths and limitations of each individual part of the system to identify potential bottlenecks and areas for future improvement. |
| 536 | _ | _ | |a 5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511) |0 G:(DE-HGF)POF4-5111 |c POF4-511 |f POF IV |x 0 |
| 536 | _ | _ | |a Earth System Data Exploration (ESDE) |0 G:(DE-Juel-1)ESDE |c ESDE |x 1 |
| 588 | _ | _ | |a Dataset connected to CrossRef Conference |
| 700 | 1 | _ | |a Bradley, Christopher |0 0009-0008-4227-4778 |b 1 |
| 700 | 1 | _ | |a Hawkes, James |0 0000-0001-7744-517X |b 2 |
| 700 | 1 | _ | |a Quintino, Tiago |0 0000-0003-0602-0531 |b 3 |
| 700 | 1 | _ | |a Schultz, Martin |0 P:(DE-Juel1)6952 |b 4 |
| 770 | _ | _ | |z 9798400718861 |
| 773 | _ | _ | |a 10.1145/3732775.3733573 |
| 856 | 4 | _ | |u https://juser.fz-juelich.de/record/1052688/files/3732775.3733573.pdf |y OpenAccess |
| 909 | C | O | |o oai:juser.fz-juelich.de:1052688 |p openaire |p open_access |p VDB |p driver |p dnbdelivery |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 4 |6 P:(DE-Juel1)6952 |
| 913 | 1 | _ | |a DE-HGF |b Key Technologies |l Engineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action |1 G:(DE-HGF)POF4-510 |0 G:(DE-HGF)POF4-511 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-500 |4 G:(DE-HGF)POF |v Enabling Computational- & Data-Intensive Science and Engineering |9 G:(DE-HGF)POF4-5111 |x 0 |
| 915 | _ | _ | |a OpenAccess |0 StatID:(DE-HGF)0510 |2 StatID |
| 915 | _ | _ | |a Creative Commons Attribution CC BY 4.0 |0 LIC:(DE-HGF)CCBY4 |2 HGFVOC |
| 920 | 1 | _ | |0 I:(DE-Juel1)JSC-20090406 |k JSC |l Jülich Supercomputing Center |x 0 |
| 980 | _ | _ | |a contrib |
| 980 | _ | _ | |a VDB |
| 980 | _ | _ | |a UNRESTRICTED |
| 980 | _ | _ | |a contb |
| 980 | _ | _ | |a I:(DE-Juel1)JSC-20090406 |
| 980 | 1 | _ | |a FullTexts |
| Library | Collection | CLSMajor | CLSMinor | Language | Author |
|---|