001052688 001__ 1052688
001052688 005__ 20260127203443.0
001052688 0247_ $$2doi$$a10.1145/3732775.3733573
001052688 0247_ $$2datacite_doi$$a10.34734/FZJ-2026-01056
001052688 037__ $$aFZJ-2026-01056
001052688 1001_ $$0P:(DE-HGF)0$$aLeuridan, Mathilde$$b0
001052688 1112_ $$aPASC '25: Platform for Advanced Scientific Computing Conference$$cFHNW University of Applied Sciences and Arts Northwestern Switzerland Brugg-Windisch$$d2025-06-16 - 2025-06-18$$gPASC 2025$$wSwitzerland
001052688 245__ $$aPerformance Analysis of an Efficient Algorithm for Feature Extraction from Large Scale Meteorological Data Stores
001052688 260__ $$aNew York, NY, USA$$bACM $$c2025
001052688 29510 $$aProceedings of the Platform for Advanced Scientific Computing Conference
001052688 300__ $$a9 p.
001052688 3367_ $$2ORCID$$aCONFERENCE_PAPER
001052688 3367_ $$033$$2EndNote$$aConference Paper
001052688 3367_ $$2BibTeX$$aINPROCEEDINGS
001052688 3367_ $$2DRIVER$$aconferenceObject
001052688 3367_ $$2DataCite$$aOutput Types/Conference Paper
001052688 3367_ $$0PUB:(DE-HGF)8$$2PUB:(DE-HGF)$$aContribution to a conference proceedings$$bcontrib$$mcontrib$$s1769455145_15815
001052688 3367_ $$0PUB:(DE-HGF)7$$2PUB:(DE-HGF)$$aContribution to a book$$mcontb
001052688 520__ $$aIn recent years, Numerical Weather Prediction (NWP) has undergone a major shift with the rapid move towards kilometer-scale global weather forecasts and the emergence of AI-based forecasting models. Together, these trends will contribute to a significant increase in the daily data volume generated by NWP models. Ensuring efficient and timely access to this growing data requires innovative data extraction techniques. As an alternative to traditional data extraction algorithms, the European Centre for Medium-Range Weather Forecasts (ECMWF) has introduced the Polytope feature extraction algorithm. This algorithm is designed to reduce data transfer between systems to a bare minimum by allowing the extraction of non-orthogonal shapes of data. In this paper, we evaluate Polytope's suitability as a replacement for current extraction mechanisms in operational weather forecasting. We first adapt the Polytope algorithm to operate on ECMWF's FDB (Fields DataBase) meteorological data stores, before evaluating this integrated system's performance and scalability on real-time operational data. Our analysis shows that the low overhead of running the Polytope algorithm, which is in the order of a few seconds at most, is far outweighed by the benefits of significantly reducing the size of the extracted data by up to several orders of magnitude compared to traditional bounding box methods. Our ensuing discussion focuses on quantifying the strengths and limitations of each individual part of the system to identify potential bottlenecks and areas for future improvement.
001052688 536__ $$0G:(DE-HGF)POF4-5111$$a5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511)$$cPOF4-511$$fPOF IV$$x0
001052688 536__ $$0G:(DE-Juel-1)ESDE$$aEarth System Data Exploration (ESDE)$$cESDE$$x1
001052688 588__ $$aDataset connected to CrossRef Conference
001052688 7001_ $$00009-0008-4227-4778$$aBradley, Christopher$$b1
001052688 7001_ $$00000-0001-7744-517X$$aHawkes, James$$b2
001052688 7001_ $$00000-0003-0602-0531$$aQuintino, Tiago$$b3
001052688 7001_ $$0P:(DE-Juel1)6952$$aSchultz, Martin$$b4
001052688 770__ $$z9798400718861
001052688 773__ $$a10.1145/3732775.3733573
001052688 8564_ $$uhttps://juser.fz-juelich.de/record/1052688/files/3732775.3733573.pdf$$yOpenAccess
001052688 909CO $$ooai:juser.fz-juelich.de:1052688$$popenaire$$popen_access$$pVDB$$pdriver$$pdnbdelivery
001052688 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)6952$$aForschungszentrum Jülich$$b4$$kFZJ
001052688 9131_ $$0G:(DE-HGF)POF4-511$$1G:(DE-HGF)POF4-510$$2G:(DE-HGF)POF4-500$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$9G:(DE-HGF)POF4-5111$$aDE-HGF$$bKey Technologies$$lEngineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action$$vEnabling Computational- & Data-Intensive Science and Engineering$$x0
001052688 915__ $$0StatID:(DE-HGF)0510$$2StatID$$aOpenAccess
001052688 915__ $$0LIC:(DE-HGF)CCBY4$$2HGFVOC$$aCreative Commons Attribution CC BY 4.0
001052688 9201_ $$0I:(DE-Juel1)JSC-20090406$$kJSC$$lJülich Supercomputing Center$$x0
001052688 980__ $$acontrib
001052688 980__ $$aVDB
001052688 980__ $$aUNRESTRICTED
001052688 980__ $$acontb
001052688 980__ $$aI:(DE-Juel1)JSC-20090406
001052688 9801_ $$aFullTexts