001047551 001__ 1047551
001047551 005__ 20251127160238.0
001047551 037__ $$aFZJ-2025-04377
001047551 041__ $$aEnglish
001047551 1001_ $$0P:(DE-Juel1)171304$$aHinz, Carsten$$b0$$eCorresponding author
001047551 1112_ $$aSemester of Algorithmic Earth System Sciences: Kick-off and networking event$$cKöln$$d2025-10-07 - 2025-10-10$$wGermany
001047551 245__ $$aStoring, Finding and Accessing Earth System Modeling Data: Insights and Challenges from WarmWorld-Easier
001047551 260__ $$c2025
001047551 3367_ $$033$$2EndNote$$aConference Paper
001047551 3367_ $$2BibTeX$$aINPROCEEDINGS
001047551 3367_ $$2DRIVER$$aconferenceObject
001047551 3367_ $$2ORCID$$aCONFERENCE_POSTER
001047551 3367_ $$2DataCite$$aOutput Types/Conference Poster
001047551 3367_ $$0PUB:(DE-HGF)24$$2PUB:(DE-HGF)$$aPoster$$bposter$$mposter$$s1764255376_7863$$xAfter Call
001047551 500__ $$aFile only for internal use.
001047551 520__ $$aImprovements in computational speed lead to better resolutions in Earth System Models (ESM) allowing them to resolve scales of a few kilometers. The volume of the resulting data greatly increases with the improvements in resolution and introduces a challenge to processing and storing these results. While modern HPC systems provide petabyte-scale capacity for file storage, analyzing such data on local user systems can become a prohibitive bottleneck. Beyond the sheer demands on processing high-volume ESM data, there is also increasing demand to make them FAIR and in particular findable. The goal of the “Easier” module of the Warmworld project aims to simplify the access to ESM data from different HPC centers, in particular the German Climate Computing Center (DKRZ) and the Jülich Supercomputing Centre (JSC). One aspect is the creation of a joint catalog following the SpatioTemporal Asset Catalogs (STAC) specification. This enhances the findability for data available at both centers. The accessibility is provided by links in the catalog to access the data, either directly on disk, as a download or, as a mid term goal, through streaming of data on demand with zarr over http. The explicit implementation of the required REST-APIs depends on the infrastructure, hardware and software, of the data centers as well as the organization of the stored data. As the first data backend at JSC, we set up a Fields DataBase (FDB), developed by European Centre for Medium-Range Weather Forecasts (ECMWF), to store the ESM results as multi-dimensional data cubes. For data retrieval, we provide a download service. Data are identified within the FDB by their metadata according to the Meteorological Archival and Retrieval System (MARS), developed by ECMWF. The automated access to HPC system is achived with the UNiform Interface to COmputing REsources (UNICORE). The download service integrates HelmholtzID, the Helmholtz authentication and authorization infrastructure. This will allow a large number of institutions to access these services with the possibility to control access and resource use. ƒOur poster will illustrate the combination of these various tools and services for creating the envisoned services for the infrastructure at JSC as well as our federated STAC catalog. We wish to close our presentation with an overview on further challenges related to ESM data addressing aspects of data management and data access.
001047551 536__ $$0G:(DE-HGF)POF4-5111$$a5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511)$$cPOF4-511$$fPOF IV$$x0
001047551 536__ $$0G:(DE-HGF)POF4-5112$$a5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511)$$cPOF4-511$$fPOF IV$$x1
001047551 536__ $$0G:(DE-Juel-1)ESDE$$aEarth System Data Exploration (ESDE)$$cESDE$$x2
001047551 536__ $$0G:(DE-Juel1)BMBF-01LK2204D$$aBMBF 01LK2204D - WarmWorld Modul 3 "Easier" (BMBF-01LK2204D)$$cBMBF-01LK2204D$$x3
001047551 7001_ $$0P:(DE-HGF)0$$aPeters-von Gehlen, Karsten$$b1
001047551 7001_ $$0P:(DE-HGF)0$$aRao Modali, Kameswar$$b2
001047551 7001_ $$0P:(DE-Juel1)157761$$aSaini, Rajveer$$b3
001047551 7001_ $$0P:(DE-Juel1)6952$$aSchultz, Martin$$b4
001047551 8564_ $$uhttps://juser.fz-juelich.de/record/1047551/files/Poster_AlgoEarth_2025-1.pdf$$yRestricted
001047551 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)171304$$aForschungszentrum Jülich$$b0$$kFZJ
001047551 9101_ $$0I:(DE-HGF)0$$6P:(DE-HGF)0$$a DKRZ: Deutsches Klimarechenzentrum$$b1
001047551 9101_ $$0I:(DE-HGF)0$$6P:(DE-HGF)0$$a DKRZ: Deutsches Klimarechenzentrum$$b2
001047551 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)157761$$aForschungszentrum Jülich$$b3$$kFZJ
001047551 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)6952$$aForschungszentrum Jülich$$b4$$kFZJ
001047551 9131_ $$0G:(DE-HGF)POF4-511$$1G:(DE-HGF)POF4-510$$2G:(DE-HGF)POF4-500$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$9G:(DE-HGF)POF4-5111$$aDE-HGF$$bKey Technologies$$lEngineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action$$vEnabling Computational- & Data-Intensive Science and Engineering$$x0
001047551 9131_ $$0G:(DE-HGF)POF4-511$$1G:(DE-HGF)POF4-510$$2G:(DE-HGF)POF4-500$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$9G:(DE-HGF)POF4-5112$$aDE-HGF$$bKey Technologies$$lEngineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action$$vEnabling Computational- & Data-Intensive Science and Engineering$$x1
001047551 9141_ $$y2025
001047551 920__ $$lyes
001047551 9201_ $$0I:(DE-Juel1)JSC-20090406$$kJSC$$lJülich Supercomputing Center$$x0
001047551 980__ $$aposter
001047551 980__ $$aEDITORS
001047551 980__ $$aVDBINPRINT
001047551 980__ $$aI:(DE-Juel1)JSC-20090406
001047551 980__ $$aUNRESTRICTED