Home > Publications database > Supporting Software Engineering Practices in the Development of Data-Intensive HPC Applications with the JuML Framework > print |
001 | 841394 | ||
005 | 20210129232018.0 | ||
024 | 7 | _ | |a 10.1145/3144763.3144765 |2 doi |
024 | 7 | _ | |a 2128/26302 |2 Handle |
037 | _ | _ | |a FZJ-2017-08469 |
041 | _ | _ | |a English |
100 | 1 | _ | |a Götz, Markus |0 P:(DE-Juel1)162390 |b 0 |e Corresponding author |u fzj |
111 | 2 | _ | |a Workshop on Software Engineering for High Performance Computing in Computational and Data-enabled Science & Engineering |g SE-CoDeSe 17 |c Denver |d 2017-11-12 - 2017-11-17 |w USA |
245 | _ | _ | |a Supporting Software Engineering Practices in the Development of Data-Intensive HPC Applications with the JuML Framework |
260 | _ | _ | |c 2017 |b ACM Press |
295 | 1 | 0 | |a Proceedings of the 1st International Workshop on Software Engineering for High Performance Computing in Computational and Data-enabled Science & Engineering |
300 | _ | _ | |a 1-8 |
336 | 7 | _ | |a CONFERENCE_PAPER |2 ORCID |
336 | 7 | _ | |a Conference Paper |0 33 |2 EndNote |
336 | 7 | _ | |a INPROCEEDINGS |2 BibTeX |
336 | 7 | _ | |a conferenceObject |2 DRIVER |
336 | 7 | _ | |a Output Types/Conference Paper |2 DataCite |
336 | 7 | _ | |a Contribution to a conference proceedings |b contrib |m contrib |0 PUB:(DE-HGF)8 |s 1528088884_1612 |2 PUB:(DE-HGF) |
336 | 7 | _ | |a Contribution to a book |0 PUB:(DE-HGF)7 |2 PUB:(DE-HGF) |m contb |
520 | _ | _ | |a The development of high performance computing applications is considerably different from traditional software development. This distinction is due to the complex hardware systems, inherent parallelism, different software lifecycle and workflow, as well as (especially for scientific computing applications) partially unknown requirements at design time. This makes the use of software engineering practices challenging, so only a small subset of them are actually applied. In this paper, we discuss the potential for applying software engineering techniques to an emerging field in high performance computing, namely large-scale data analysis and machine learning. We argue for the employment of software engineering techniques in the development of such applications from the start, and the design of generic, reusable components. Using the example of the Juelich Machine Learning Library (JuML), we demonstrate how such a framework can not only simplify the design of new parallel algorithms, but also increase the productivity of the actual data analysis workflow. We place particular focus on the abstraction from heterogeneous hardware, the architectural design as well as aspects of parallel and distributed unit testing. |
536 | _ | _ | |a 512 - Data-Intensive Science and Federated Computing (POF3-512) |0 G:(DE-HGF)POF3-512 |c POF3-512 |f POF III |x 0 |
536 | _ | _ | |0 G:(DE-Juel1)PHD-NO-GRANT-20170405 |x 1 |c PHD-NO-GRANT-20170405 |a PhD no Grant - Doktorand ohne besondere Förderung (PHD-NO-GRANT-20170405) |
536 | _ | _ | |a DEEP-EST - DEEP - Extreme Scale Technologies (754304) |0 G:(EU-Grant)754304 |c 754304 |f H2020-FETHPC-2016 |x 2 |
588 | _ | _ | |a Dataset connected to CrossRef Conference |
700 | 1 | _ | |a Book, Matthias |0 P:(DE-HGF)0 |b 1 |
700 | 1 | _ | |a Bodenstein, Christian |0 P:(DE-Juel1)164357 |b 2 |u fzj |
700 | 1 | _ | |a Riedel, Morris |0 P:(DE-Juel1)132239 |b 3 |u fzj |
773 | _ | _ | |a 10.1145/3144763.3144765 |
856 | 4 | _ | |y Restricted |u https://juser.fz-juelich.de/record/841394/files/paper_.pdf |
856 | 4 | _ | |y Restricted |x icon |u https://juser.fz-juelich.de/record/841394/files/paper_.gif?subformat=icon |
856 | 4 | _ | |y Restricted |x icon-1440 |u https://juser.fz-juelich.de/record/841394/files/paper_.jpg?subformat=icon-1440 |
856 | 4 | _ | |y Restricted |x icon-180 |u https://juser.fz-juelich.de/record/841394/files/paper_.jpg?subformat=icon-180 |
856 | 4 | _ | |y Restricted |x icon-640 |u https://juser.fz-juelich.de/record/841394/files/paper_.jpg?subformat=icon-640 |
856 | 4 | _ | |y Restricted |x pdfa |u https://juser.fz-juelich.de/record/841394/files/paper_.pdf?subformat=pdfa |
856 | 4 | _ | |y OpenAccess |u https://juser.fz-juelich.de/record/841394/files/Goetz-et-al-supporting-software.pdf |
909 | C | O | |o oai:juser.fz-juelich.de:841394 |p openaire |p open_access |p driver |p VDB |p ec_fundedresources |p dnbdelivery |
910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 0 |6 P:(DE-Juel1)162390 |
910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 2 |6 P:(DE-Juel1)164357 |
910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 3 |6 P:(DE-Juel1)132239 |
913 | 1 | _ | |a DE-HGF |b Key Technologies |1 G:(DE-HGF)POF3-510 |0 G:(DE-HGF)POF3-512 |2 G:(DE-HGF)POF3-500 |v Data-Intensive Science and Federated Computing |x 0 |4 G:(DE-HGF)POF |3 G:(DE-HGF)POF3 |l Supercomputing & Big Data |
914 | 1 | _ | |y 2017 |
915 | _ | _ | |a OpenAccess |0 StatID:(DE-HGF)0510 |2 StatID |
920 | 1 | _ | |0 I:(DE-Juel1)JSC-20090406 |k JSC |l Jülich Supercomputing Center |x 0 |
980 | _ | _ | |a contrib |
980 | _ | _ | |a VDB |
980 | _ | _ | |a UNRESTRICTED |
980 | _ | _ | |a contb |
980 | _ | _ | |a I:(DE-Juel1)JSC-20090406 |
980 | 1 | _ | |a FullTexts |
Library | Collection | CLSMajor | CLSMinor | Language | Author |
---|