TY  - CONF
AU  - Patnala, Ankit
AU  - Semcheddine, Asma
AU  - Langguth, Michael
AU  - Schultz, Martin
AU  - Lessig, Christian
AU  - Luise, Ilaria
TI  - Applying AtmoRep for Diverse Weather Applications
VL  - 52
M1  - FZJ-2025-02398
SP  - 301-  311
PY  - 2025
N1  - Proceedings: https://doi.org/10.34734/FZJ-2025-01965  ISBN: 978-3-95806-793-6
AB  - Machine learning has recently seen a rapid wide-spread adoption across various fields of science including atmospheric and weather research. The emergence of foundation models has marked a transformation in the science of machine learning. These foundation models are general-purpose models trained on huge amounts of data using self-supervised methods, eliminating the need for labeled data. Once trained, the parameters of these models can be utilized as a starting point for a range of domain-specific tasks. This approach is advantageous in terms of both cost and performance, as it minimizes the reliance on annotated data compared to models trained from scratch. Motivated by this, our study explores the foundational capabilities of AtmoRep, a stochastic atmospheric foundation model, for two distinct weather-related applications, data compression and statistical downscaling. The training of the 3.5 billion parameter AtmoRep model consumed about a few weeks of compute time on 32 JUWELS Booster nodes.
T2  - The 12th John von Neumann Institute for Computing (NIC) Symposium
CY  - 6 Mar 2025 - 7 Mar 2025, Jülich (Germany)
Y2  - 6 Mar 2025 - 7 Mar 2025
M2  - Jülich, Germany
LB  - PUB:(DE-HGF)8 ; PUB:(DE-HGF)7
DO  - DOI:10.34734/FZJ-2025-02398
UR  - https://juser.fz-juelich.de/record/1041713
ER  -