MAELSTROM

MAchinE Learning for Scalable meTeoROlogy and cliMate

Grant period2021-04-01 - 2024-03-31
Funding bodyEuropean Union
Call numberH2020-JTI-EuroHPC-2019-1
Grant number955513
IdentifierG:(EU-Grant)955513

Note: To develop Europe’s computer architecture of the future, MAELSTROM will co-design bespoke compute system designs for optimal application performance and energy efficiency, a software framework to optimise usability and training efficiency for machine learning at scale, and large-scale machine learning applications for the domain of weather and climate science. The MAELSTROM compute system designs will benchmark the applications across a range of computing systems regarding energy consumption, time-to-solution, numerical precision and solution accuracy. Customised compute systems will be designed that are optimised for application needs to strengthen Europe’s high-performance computing portfolio and to pull recent hardware developments, driven by general machine learning applications, toward needs of weather and climate applications. The MAELSTROM software framework will enable scientists to apply and compare machine learning tools and libraries efficiently across a wide range of computer systems. A user interface will link application developers with compute system designers, and automated benchmarking and error detection of machine learning solutions will be performed during the development phase. Tools will be published as open source. The MAELSTROM machine learning applications will cover all important components of the workflow of weather and climate predictions including the processing of observations, the assimilation of observations to generate initial and reference conditions, model simulations, as well as post-processing of model data and the development of forecast products. For each application, benchmark datasets with up to 10 terabytes of data will be published online for training and machine learning tool-developments at the scale of the fastest supercomputers in the world. MAELSTROM machine learning solutions will serve as blueprint for a wide range of machine learning applications on supercomputers in the future.
   

Recent Publications

All known publications ...
Download: BibTeX | EndNote XML,  Text | RIS | 

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Journal Article  ;  ;  ;  ;  ;  ;  ;  ;
Mantik: A Workflow Platform for the Development of Artificial Intelligence on High-Performance Computing Infrastructures
The journal of open source software 9(98), 6136 () [10.21105/joss.06136] OpenAccess  Download fulltext Files BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Poster (After Call)  ;  ;  ;
Downscaling with the foundation model AtmoRep
European Geosciences Union General Assembly 2024, EGU 2024, ViennaVienna, Austria, 14 Apr 2024 - 19 Apr 20242024-04-142024-04-19 [10.5194/egusphere-egu24-18331] OpenAccess  Download fulltext Files BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Poster (Other)  ;  ;  ;  ;  ;  ;
A Benchmark Dataset for Meteorological Downscaling
International Conference on Learning Representations, ICLR 2024, ViennaVienna, Austria, 7 May 2024 - 11 May 20242024-05-072024-05-11 [10.34734/FZJ-2024-07390] OpenAccess  Download fulltext Files  Download fulltextFulltext BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Conference Presentation (Other)  ;  ;  ;  ;  ;  ;
DownscaleBench: A benchmark dataset for statisticaldownscaling of meteorological fields
Workshop on Large-Scale Deep Learning for the Earth System, LSDL4ES 2024, BonnBonn, Germany, 29 Aug 2024 - 30 Aug 20242024-08-292024-08-30 [10.34734/FZJ-2024-07387] OpenAccess  Download fulltext Files  Download fulltextFulltext BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Contribution to a conference proceedings  ;  ;  ;  ;  ;  ;
A Benchmark Dataset for Meteorological Downscaling
International Conference on Learning Representations, ICLR 2024, ViennaVienna, Austria, 7 May 2024 - 11 May 20242024-05-072024-05-11 N/A () [10.34734/FZJ-2024-07378] OpenAccess  Download fulltext Files  Download fulltextFulltext BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Contribution to a conference proceedings  ;  ;  ;
Performance and Power: Systematic Evaluation of AI Workloads on Accelerators with CARAML
Supercomputing Conference 2024, 2024 International Workshop on Performance, Portability, and Productivity in HPC, SC24, AtlantaAtlanta, USA, 17 Nov 2024 - 22 Nov 20242024-11-172024-11-22 Nan () [10.1109/SCW63240.2024.00158] OpenAccess  Download fulltext Files  Download fulltextFulltext BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Poster (Other)  ;  ;  ;
CARAML: Systematic Evaluation of AI Workloads on Accelerators
OpenGPT-X Forum, BerlinBerlin, Germany, 5 Nov 2024 - 5 Nov 20242024-11-052024-11-05 [10.34734/FZJ-2024-06308] OpenAccess  Download fulltext Files BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Journal Article  ;  ;  ;  ;  ;  ;
Temperature forecasting by deep learning methods
Geoscientific model development 15(23), 8931 - 8956 () [10.5194/gmd-15-8931-2022] OpenAccess  Download fulltext Files  Download fulltextFulltext by OpenAccess repository BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Notes
Notes about Introduction to HPC at MAELSTROM Bootcamp
[10.34732/XDVBLG-VGFSAZ] BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Conference Presentation (Other)  ;  ;  ;  ;  ;
Statistical Downscaling of Surface Temperature and Precipitation with Deep Neural Networks
Platform for Advanced Scientific Computing Conference 2022, PASC2022, BaselBasel, Switzerland, 27 Jun 2022 - 30 Jun 20222022-06-272022-06-30 OpenAccess  Download fulltext Files  Download fulltextFulltext Download fulltextFulltext by OpenAccess repository BibTeX | EndNote: XML, Text | RIS

All known publications ...
Download: BibTeX | EndNote XML,  Text | RIS | 


 Record created 2021-10-08, last modified 2023-02-10



Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)