001050041 001__ 1050041
001050041 005__ 20251219202235.0
001050041 0247_ $$2doi$$a10.5194/gmd-18-4009-2025
001050041 0247_ $$2ISSN$$a1991-959X
001050041 0247_ $$2ISSN$$a1991-9603
001050041 0247_ $$2datacite_doi$$a10.34734/FZJ-2025-05755
001050041 037__ $$aFZJ-2025-05755
001050041 082__ $$a550
001050041 1001_ $$00000-0001-5251-0158$$aSchlund, Manuel$$b0$$eCorresponding author
001050041 245__ $$aAdvanced climate model evaluation with ESMValTool v2.11.0 using parallel, out-of-core, and distributed computing
001050041 260__ $$aKatlenburg-Lindau$$bCopernicus$$c2025
001050041 3367_ $$2DRIVER$$aarticle
001050041 3367_ $$2DataCite$$aOutput Types/Journal article
001050041 3367_ $$0PUB:(DE-HGF)16$$2PUB:(DE-HGF)$$aJournal Article$$bjournal$$mjournal$$s1766155096_15646
001050041 3367_ $$2BibTeX$$aARTICLE
001050041 3367_ $$2ORCID$$aJOURNAL_ARTICLE
001050041 3367_ $$00$$2EndNote$$aJournal Article
001050041 520__ $$aEarth system models (ESMs) allow numerical simulations of the Earth's climate system. Driven by the need to better understand climate change and its impacts, these models have become increasingly sophisticated over time, generating vast amounts of data. To effectively evaluate the complex state-of-the-art ESMs and ensure their reliability, new tools for comprehensive analysis are essential. The open-source community-driven Earth System Model Evaluation Tool (ESMValTool) addresses this critical need by providing a software package for scientists to assess the performance of ESMs using common diagnostics and metrics. In this paper, we describe recent significant improvements of ESMValTool's computational efficiency, which allow a more effective evaluation of these complex ESMs and also high-resolution models. These optimizations include parallel computing (execute multiple computation tasks simultaneously), out-of-core computing (process data larger than available memory), and distributed computing (spread computation tasks across multiple interconnected nodes or machines). When comparing the latest ESMValTool version with a previous not yet optimized version, we find significant performance improvements for many relevant applications running on a single node of a high-performance computing (HPC) system, ranging from 2.3 times faster runs in a multi-model setup up to 23 times faster runs for processing a single high-resolution model. By utilizing distributed computing on two nodes of an HPC system, these speedup factors can be further improved to 3.0 and 44, respectively. Moreover, evaluation runs with the latest version of ESMValTool also require significantly less computational resources than before, which in turn reduces power consumption and thus the overall carbon footprint of ESMValTool runs. For example, the previously mentioned use cases use 2.3 (multi-model evaluation) and 23 (high-resolution model evaluation) times less resources compared to the reference version on one HPC node. Finally, analyses which could previously only be performed on machines with large amounts of memory can now be conducted on much smaller hardware through the use of out-of-core computation. For instance, the high-resolution single-model evaluation use case can now be run with 8 GB of available memory despite an input data size of 35 GB, which was not possible with earlier versions of ESMValTool. This enables running much more complex evaluation tasks on a personal laptop than before.
001050041 536__ $$0G:(DE-HGF)POF4-5111$$a5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511)$$cPOF4-511$$fPOF IV$$x0
001050041 536__ $$0G:(DE-HGF)POF4-2A5$$a2A5 - Exascale Earth System Modeling  (CARF - CCA) (POF4-2A5)$$cPOF4-2A5$$fPOF IV$$x1
001050041 536__ $$0G:(EU-Grant)855187$$aUSMILE - Understanding and Modelling the Earth System with Machine Learning (855187)$$c855187$$fERC-2019-SyG$$x2
001050041 536__ $$0G:(EU-Grant)101003536$$aESM2025 - Earth system models for the future (101003536)$$c101003536$$fH2020-LC-CLA-2020-2$$x3
001050041 536__ $$0G:(EU-Grant)824084$$aIS-ENES3 - Infrastructure for the European Network for Earth System modelling - Phase 3 (824084)$$c824084$$fH2020-INFRAIA-2018-1$$x4
001050041 536__ $$0G:(EU-Grant)776613$$aEUCP - European Climate Prediction system (776613)$$c776613$$fH2020-SC5-2017-OneStageB$$x5
001050041 536__ $$0G:(EU-Grant)101093054$$aESiWACE3 - Center of excellence for weather and climate phase 3 (101093054)$$c101093054$$fHORIZON-EUROHPC-JU-2021-COE-01$$x6
001050041 588__ $$aDataset connected to CrossRef, Journals: juser.fz-juelich.de
001050041 7001_ $$00000-0001-9005-8940$$aAndela, Bouwe$$b1
001050041 7001_ $$0P:(DE-Juel1)185943$$aBenke, Jörg$$b2$$ufzj
001050041 7001_ $$0P:(DE-HGF)0$$aComer, Ruth$$b3
001050041 7001_ $$00000-0003-2724-709X$$aHassler, Birgit$$b4
001050041 7001_ $$0P:(DE-HGF)0$$aHogan, Emma$$b5
001050041 7001_ $$00000-0002-5025-7862$$aKalverla, Peter$$b6
001050041 7001_ $$00000-0002-9270-1044$$aLauer, Axel$$b7
001050041 7001_ $$0P:(DE-HGF)0$$aLittle, Bill$$b8
001050041 7001_ $$0P:(DE-HGF)0$$aLoosveldt Tomas, Saskia$$b9
001050041 7001_ $$00000-0003-3286-0139$$aNattino, Francesco$$b10
001050041 7001_ $$0P:(DE-HGF)0$$aPeglar, Patrick$$b11
001050041 7001_ $$0P:(DE-HGF)0$$aPredoi, Valeriu$$b12
001050041 7001_ $$0P:(DE-HGF)0$$aSmeets, Stef$$b13
001050041 7001_ $$0P:(DE-HGF)0$$aWorsley, Stephen$$b14
001050041 7001_ $$00009-0000-6857-560X$$aYeo, Martin$$b15
001050041 7001_ $$0P:(DE-HGF)0$$aZimmermann, Klaus$$b16
001050041 773__ $$0PERI:(DE-600)2456725-5$$a10.5194/gmd-18-4009-2025$$gVol. 18, no. 13, p. 4009 - 4021$$n13$$p4009 - 4021$$tGeoscientific model development$$v18$$x1991-959X$$y2025
001050041 8564_ $$uhttps://juser.fz-juelich.de/record/1050041/files/gmd-18-4009-2025.pdf$$yOpenAccess
001050041 909CO $$ooai:juser.fz-juelich.de:1050041$$popenaire$$popen_access$$pdriver$$pVDB$$pec_fundedresources$$pdnbdelivery
001050041 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)185943$$aForschungszentrum Jülich$$b2$$kFZJ
001050041 9131_ $$0G:(DE-HGF)POF4-511$$1G:(DE-HGF)POF4-510$$2G:(DE-HGF)POF4-500$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$9G:(DE-HGF)POF4-5111$$aDE-HGF$$bKey Technologies$$lEngineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action$$vEnabling Computational- & Data-Intensive Science and Engineering$$x0
001050041 9131_ $$0G:(DE-HGF)POF4-2A5$$1G:(DE-HGF)POF4-2A0$$2G:(DE-HGF)POF4-200$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$aDE-HGF$$bForschungsbereich Erde und Umwelt$$lCOOPERATION ACROSS RESEARCH FIELDS (CARFs)$$vExascale Earth System Modeling  (CARF - CCA)$$x1
001050041 9141_ $$y2025
001050041 915__ $$0StatID:(DE-HGF)0200$$2StatID$$aDBCoverage$$bSCOPUS$$d2024-12-21
001050041 915__ $$0StatID:(DE-HGF)0160$$2StatID$$aDBCoverage$$bEssential Science Indicators$$d2024-12-21
001050041 915__ $$0LIC:(DE-HGF)CCBY4$$2HGFVOC$$aCreative Commons Attribution CC BY 4.0
001050041 915__ $$0StatID:(DE-HGF)0600$$2StatID$$aDBCoverage$$bEbsco Academic Search$$d2024-12-21
001050041 915__ $$0StatID:(DE-HGF)1150$$2StatID$$aDBCoverage$$bCurrent Contents - Physical, Chemical and Earth Sciences$$d2024-12-21
001050041 915__ $$0StatID:(DE-HGF)0501$$2StatID$$aDBCoverage$$bDOAJ Seal$$d2022-12-20T09:29:04Z
001050041 915__ $$0StatID:(DE-HGF)0500$$2StatID$$aDBCoverage$$bDOAJ$$d2022-12-20T09:29:04Z
001050041 915__ $$0StatID:(DE-HGF)0113$$2StatID$$aWoS$$bScience Citation Index Expanded$$d2024-12-21
001050041 915__ $$0StatID:(DE-HGF)0700$$2StatID$$aFees$$d2024-12-21
001050041 915__ $$0StatID:(DE-HGF)0150$$2StatID$$aDBCoverage$$bWeb of Science Core Collection$$d2024-12-21
001050041 915__ $$0StatID:(DE-HGF)0510$$2StatID$$aOpenAccess
001050041 915__ $$0StatID:(DE-HGF)0030$$2StatID$$aPeer Review$$bASC$$d2024-12-21
001050041 915__ $$0StatID:(DE-HGF)0561$$2StatID$$aArticle Processing Charges$$d2024-12-21
001050041 915__ $$0StatID:(DE-HGF)0300$$2StatID$$aDBCoverage$$bMedline$$d2024-12-21
001050041 915__ $$0StatID:(DE-HGF)0199$$2StatID$$aDBCoverage$$bClarivate Analytics Master Journal List$$d2024-12-21
001050041 920__ $$lyes
001050041 9201_ $$0I:(DE-Juel1)JSC-20090406$$kJSC$$lJülich Supercomputing Center$$x0
001050041 980__ $$ajournal
001050041 980__ $$aVDB
001050041 980__ $$aUNRESTRICTED
001050041 980__ $$aI:(DE-Juel1)JSC-20090406
001050041 9801_ $$aFullTexts