Home > Publications database > Staged deployment of interactive multi-application HPC workflows > print |
001 | 864600 | ||
005 | 20240313094929.0 | ||
024 | 7 | _ | |a 10.1109/HPCS48598.2019.9188104 |2 doi |
024 | 7 | _ | |a 2128/25761 |2 Handle |
037 | _ | _ | |a FZJ-2019-04310 |
100 | 1 | _ | |a Klijn, Wouter |0 P:(DE-Juel1)168169 |b 0 |e Corresponding author |u fzj |
111 | 2 | _ | |a The 2019 International Conference on High Performance Computing & Simulation |g HPCS 2019 |c Dublin |d 2019-07-15 - 2019-07-19 |w Ireland |
245 | _ | _ | |a Staged deployment of interactive multi-application HPC workflows |
260 | _ | _ | |c 2020 |b IEEE |
300 | _ | _ | |a 305-311 |
336 | 7 | _ | |a CONFERENCE_PAPER |2 ORCID |
336 | 7 | _ | |a Conference Paper |0 33 |2 EndNote |
336 | 7 | _ | |a INPROCEEDINGS |2 BibTeX |
336 | 7 | _ | |a conferenceObject |2 DRIVER |
336 | 7 | _ | |a Output Types/Conference Paper |2 DataCite |
336 | 7 | _ | |a Contribution to a conference proceedings |b contrib |m contrib |0 PUB:(DE-HGF)8 |s 1601037757_14614 |2 PUB:(DE-HGF) |
520 | _ | _ | |a Running scientific workflows on a supercomputer can be a daunting task for a scientific domain specialist. Workflow management solutions (WMS) are a standard method for reducing the complexity of application deployment on high performance computing (HPC) infrastructure. We introduce the design for a middleware system that extends and combines the functionality from existing solutions in order to create a high-level, staged user-centric operation/deployment model. This design addresses the requirements of several use cases in the life sciences, with a focus on neuroscience. In this manuscript we focus on two use cases: 1) three coupled neuronal simulators (for three different space/time scales) with in-transit visualization and 2) a closed-loop workflow optimized by machine learning, coupling a robot with a neural network simulation. We provide a detailed overview of the application-integrated monitoring in relationship with the HPC job. We present here a novel usage model for large scale interactive multi-application workflows running on HPC systems which aims at reducing the complexity of deployment and execution, thus enabling new science. |
536 | _ | _ | |a 511 - Computational Science and Mathematical Methods (POF3-511) |0 G:(DE-HGF)POF3-511 |c POF3-511 |f POF III |x 0 |
536 | _ | _ | |a HBP SGA2 - Human Brain Project Specific Grant Agreement 2 (785907) |0 G:(EU-Grant)785907 |c 785907 |f H2020-SGA-FETFLAG-HBP-2017 |x 1 |
536 | _ | _ | |a HBP SGA1 - Human Brain Project Specific Grant Agreement 1 (720270) |0 G:(EU-Grant)720270 |c 720270 |f H2020-Adhoc-2014-20 |x 2 |
536 | _ | _ | |a SLNS - SimLab Neuroscience (Helmholtz-SLNS) |0 G:(DE-Juel1)Helmholtz-SLNS |c Helmholtz-SLNS |x 3 |
588 | _ | _ | |a Dataset connected to CrossRef Conference |
700 | 1 | _ | |a Diaz, Sandra |0 P:(DE-Juel1)165859 |b 1 |u fzj |
700 | 1 | _ | |a Morrison, Abigail |0 P:(DE-Juel1)151166 |b 2 |u fzj |
700 | 1 | _ | |a Peyser, Alexander |0 P:(DE-Juel1)161525 |b 3 |u fzj |
773 | _ | _ | |a 10.1109/HPCS48598.2019.9188104 |
856 | 4 | _ | |y OpenAccess |u https://juser.fz-juelich.de/record/864600/files/HPCS%202019%20Staged%20deployment%20of%20interactive%20multi-application%20HPC%20workflows%20Wouter%20Klijn.pdf |
856 | 4 | _ | |y OpenAccess |x pdfa |u https://juser.fz-juelich.de/record/864600/files/HPCS%202019%20Staged%20deployment%20of%20interactive%20multi-application%20HPC%20workflows%20Wouter%20Klijn.pdf?subformat=pdfa |
909 | C | O | |o oai:juser.fz-juelich.de:864600 |p openaire |p open_access |p driver |p VDB |p ec_fundedresources |p dnbdelivery |
910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 0 |6 P:(DE-Juel1)168169 |
910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 1 |6 P:(DE-Juel1)165859 |
910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 2 |6 P:(DE-Juel1)151166 |
910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 3 |6 P:(DE-Juel1)161525 |
913 | 1 | _ | |a DE-HGF |b Key Technologies |1 G:(DE-HGF)POF3-510 |0 G:(DE-HGF)POF3-511 |2 G:(DE-HGF)POF3-500 |v Computational Science and Mathematical Methods |x 0 |4 G:(DE-HGF)POF |3 G:(DE-HGF)POF3 |l Supercomputing & Big Data |
914 | 1 | _ | |y 2020 |
915 | _ | _ | |a OpenAccess |0 StatID:(DE-HGF)0510 |2 StatID |
920 | _ | _ | |l yes |
920 | 1 | _ | |0 I:(DE-Juel1)JSC-20090406 |k JSC |l Jülich Supercomputing Center |x 0 |
920 | 1 | _ | |0 I:(DE-Juel1)INM-6-20090406 |k INM-6 |l Computational and Systems Neuroscience |x 1 |
980 | 1 | _ | |a FullTexts |
980 | _ | _ | |a contrib |
980 | _ | _ | |a VDB |
980 | _ | _ | |a UNRESTRICTED |
980 | _ | _ | |a I:(DE-Juel1)JSC-20090406 |
980 | _ | _ | |a I:(DE-Juel1)INM-6-20090406 |
981 | _ | _ | |a I:(DE-Juel1)IAS-6-20130828 |
Library | Collection | CLSMajor | CLSMinor | Language | Author |
---|