guest ::
| Home > External Publications > Vita Publications > The Artificial Scientist -- in-transit Machine Learning of Plasma Simulations > print |
| Home > External Publications > Vita Publications > The Artificial Scientist -- in-transit Machine Learning of Plasma Simulations > print |
| 001 | 1053125 | ||
| 005 | 20260130140311.0 | ||
| 024 | 7 | _ | |a 10.48550/ARXIV.2501.03383 |2 doi |
| 037 | _ | _ | |a FZJ-2026-01458 |
| 100 | 1 | _ | |a Kelling, Jeffrey |0 P:(DE-HGF)0 |b 0 |
| 245 | _ | _ | |a The Artificial Scientist -- in-transit Machine Learning of Plasma Simulations |
| 260 | _ | _ | |c 2025 |b arXiv |
| 336 | 7 | _ | |a Preprint |b preprint |m preprint |0 PUB:(DE-HGF)25 |s 1769767131_29795 |2 PUB:(DE-HGF) |
| 336 | 7 | _ | |a WORKING_PAPER |2 ORCID |
| 336 | 7 | _ | |a Electronic Article |0 28 |2 EndNote |
| 336 | 7 | _ | |a preprint |2 DRIVER |
| 336 | 7 | _ | |a ARTICLE |2 BibTeX |
| 336 | 7 | _ | |a Output Types/Working Paper |2 DataCite |
| 520 | _ | _ | |a Increasing HPC cluster sizes and large-scale simulations that produce petabytes of data per run, create massive IO and storage challenges for analysis. Deep learning-based techniques, in particular, make use of these amounts of domain data to extract patterns that help build scientific understanding. Here, we demonstrate a streaming workflow in which simulation data is streamed directly to a machine-learning (ML) framework, circumventing the file system bottleneck. Data is transformed in transit, asynchronously to the simulation and the training of the model. With the presented workflow, data operations can be performed in common and easy-to-use programming languages, freeing the application user from adapting the application output routines. As a proof-of-concept we consider a GPU accelerated particle-in-cell (PIConGPU) simulation of the Kelvin- Helmholtz instability (KHI). We employ experience replay to avoid catastrophic forgetting in learning from this non-steady process in a continual manner. We detail challenges addressed while porting and scaling to Frontier exascale system. |
| 536 | _ | _ | |a 5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511) |0 G:(DE-HGF)POF4-5112 |c POF4-511 |f POF IV |x 0 |
| 536 | _ | _ | |a Helmholtz AI Consultant Team FB Information (E54.303.11) |0 G:(DE-Juel-1)E54.303.11 |c E54.303.11 |x 1 |
| 588 | _ | _ | |a Dataset connected to DataCite |
| 650 | _ | 7 | |a Computational Physics (physics.comp-ph) |2 Other |
| 650 | _ | 7 | |a Distributed, Parallel, and Cluster Computing (cs.DC) |2 Other |
| 650 | _ | 7 | |a Machine Learning (cs.LG) |2 Other |
| 650 | _ | 7 | |a FOS: Physical sciences |2 Other |
| 650 | _ | 7 | |a FOS: Computer and information sciences |2 Other |
| 700 | 1 | _ | |a Bolea, Vicente |0 P:(DE-HGF)0 |b 1 |
| 700 | 1 | _ | |a Bussmann, Michael |0 P:(DE-HGF)0 |b 2 |
| 700 | 1 | _ | |a Checkervarty, Ankush |0 P:(DE-HGF)0 |b 3 |
| 700 | 1 | _ | |a Debus, Alexander |0 P:(DE-HGF)0 |b 4 |
| 700 | 1 | _ | |a Ebert, Jan |0 P:(DE-Juel1)187002 |b 5 |
| 700 | 1 | _ | |a Eisenhauer, Greg |0 P:(DE-HGF)0 |b 6 |
| 700 | 1 | _ | |a Gutta, Vineeth |0 P:(DE-HGF)0 |b 7 |
| 700 | 1 | _ | |a Kesselheim, Stefan |0 P:(DE-Juel1)185654 |b 8 |
| 700 | 1 | _ | |a Klasky, Scott |0 P:(DE-HGF)0 |b 9 |
| 700 | 1 | _ | |a Pandit, Vedhas |0 P:(DE-HGF)0 |b 10 |
| 700 | 1 | _ | |a Pausch, Richard |0 P:(DE-HGF)0 |b 11 |
| 700 | 1 | _ | |a Podhorszki, Norbert |0 P:(DE-HGF)0 |b 12 |
| 700 | 1 | _ | |a Poschel, Franz |0 P:(DE-HGF)0 |b 13 |
| 700 | 1 | _ | |a Rogers, David |0 P:(DE-HGF)0 |b 14 |
| 700 | 1 | _ | |a Rustamov, Jeyhun |0 P:(DE-HGF)0 |b 15 |
| 700 | 1 | _ | |a Schmerler, Steve |0 P:(DE-HGF)0 |b 16 |
| 700 | 1 | _ | |a Schramm, Ulrich |0 P:(DE-HGF)0 |b 17 |
| 700 | 1 | _ | |a Steiniger, Klaus |0 P:(DE-HGF)0 |b 18 |
| 700 | 1 | _ | |a Widera, Rene |0 P:(DE-HGF)0 |b 19 |
| 700 | 1 | _ | |a Willmann, Anna |0 P:(DE-HGF)0 |b 20 |
| 700 | 1 | _ | |a Chandrasekaran, Sunita |0 P:(DE-HGF)0 |b 21 |
| 773 | _ | _ | |a 10.48550/ARXIV.2501.03383 |
| 856 | 4 | _ | |u https://juser.fz-juelich.de/record/1053125/files/2501.03383v3.pdf |y Restricted |
| 909 | C | O | |o oai:juser.fz-juelich.de:1053125 |p extern4vita |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 5 |6 P:(DE-Juel1)187002 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 8 |6 P:(DE-Juel1)185654 |
| 913 | 1 | _ | |a DE-HGF |b Key Technologies |l Engineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action |1 G:(DE-HGF)POF4-510 |0 G:(DE-HGF)POF4-511 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-500 |4 G:(DE-HGF)POF |v Enabling Computational- & Data-Intensive Science and Engineering |9 G:(DE-HGF)POF4-5112 |x 0 |
| 920 | _ | _ | |l yes |
| 980 | 1 | _ | |a EXTERN4VITA |
| 980 | _ | _ | |a preprint |
| 980 | _ | _ | |a I:(DE-Juel1)JSC-20090406 |
| 980 | _ | _ | |a I:(DE-Juel1)ZB-20090406 |
| Library | Collection | CLSMajor | CLSMinor | Language | Author |
|---|