Gast ::
| Hauptseite > Publikationsdatenbank > Accelerating massive data processing in Python with Heat > print |
| Hauptseite > Publikationsdatenbank > Accelerating massive data processing in Python with Heat > print |
| 001 | 1019995 | ||
| 005 | 20240105202147.0 | ||
| 037 | _ | _ | |a FZJ-2023-05810 |
| 100 | 1 | _ | |a Comito, Claudia |0 P:(DE-Juel1)174573 |b 0 |e Corresponding author |
| 111 | 2 | _ | |a Artificial Intelligence Symposium on Theory, Application and Research 2023 |g AI STAR#2023 |c ESOC, Darmstadt |d 2023-09-27 - 2023-09-28 |w Germany |
| 245 | _ | _ | |a Accelerating massive data processing in Python with Heat |
| 260 | _ | _ | |c 2023 |
| 336 | 7 | _ | |a Conference Paper |0 33 |2 EndNote |
| 336 | 7 | _ | |a INPROCEEDINGS |2 BibTeX |
| 336 | 7 | _ | |a conferenceObject |2 DRIVER |
| 336 | 7 | _ | |a CONFERENCE_POSTER |2 ORCID |
| 336 | 7 | _ | |a Output Types/Conference Poster |2 DataCite |
| 336 | 7 | _ | |a Poster |b poster |m poster |0 PUB:(DE-HGF)24 |s 1704431512_29017 |2 PUB:(DE-HGF) |x After Call |
| 520 | _ | _ | |a Heat [1, 2] is an open-source Python library designed to address the challenges of working with massive data sets and harnessing the power of machine learning across disciplines. Developed collaboratively by within the Helmholtz Association (FZJ, KIT, and DLR), Heat offers cutting-edge capabilities for high-performance data analytics, machine learning, and deep learning.Heat provides a Numpy-like API that simplifies the development of scalable, GPU-accelerated applications. What sets Heat apart is its underlying data-parallelism, implemented on top of MPI, which significantly enhances efficiency and performance of data processing compared to traditional task-parallel frameworks.By exploring practical use cases in space science (materials engineering, atmospheric modeling, anomaly detection) and its potential as a backend for diverse data processing pipelines, we will illustrate how Heat can accelerate AI research and applications.[1] Götz, M., Debus, C., Coquelin, et al.: "HeAT - a Distributed and GPU-accelerated Tensor Framework for Data Analytics" [2] https://github.com/helmholtz-analytics/heat |
| 536 | _ | _ | |a 5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511) |0 G:(DE-HGF)POF4-5111 |c POF4-511 |f POF IV |x 0 |
| 536 | _ | _ | |a 5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511) |0 G:(DE-HGF)POF4-5112 |c POF4-511 |f POF IV |x 1 |
| 536 | _ | _ | |a SLNS - SimLab Neuroscience (Helmholtz-SLNS) |0 G:(DE-Juel1)Helmholtz-SLNS |c Helmholtz-SLNS |x 2 |
| 700 | 1 | _ | |a Götz, Markus |0 P:(DE-HGF)0 |b 1 |
| 700 | 1 | _ | |a Gutiérrez Hermosillo Muriedas, Juan Pedro |0 P:(DE-HGF)0 |b 2 |
| 700 | 1 | _ | |a Hagemeier, Björn |0 P:(DE-Juel1)132123 |b 3 |
| 700 | 1 | _ | |a Hoppe, Fabian |0 P:(DE-HGF)0 |b 4 |
| 700 | 1 | _ | |a Knechtges, Philipp |0 P:(DE-HGF)0 |b 5 |
| 700 | 1 | _ | |a Krajsek, Kai |0 P:(DE-Juel1)129347 |b 6 |
| 700 | 1 | _ | |a Rüttgers, Alexander |0 P:(DE-HGF)0 |b 7 |
| 700 | 1 | _ | |a Streit, Achim |0 P:(DE-HGF)0 |b 8 |
| 700 | 1 | _ | |a Tarnawa, Michael |0 P:(DE-Juel1)178977 |b 9 |
| 909 | C | O | |o oai:juser.fz-juelich.de:1019995 |p VDB |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 0 |6 P:(DE-Juel1)174573 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 3 |6 P:(DE-Juel1)132123 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 6 |6 P:(DE-Juel1)129347 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 9 |6 P:(DE-Juel1)178977 |
| 913 | 1 | _ | |a DE-HGF |b Key Technologies |l Engineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action |1 G:(DE-HGF)POF4-510 |0 G:(DE-HGF)POF4-511 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-500 |4 G:(DE-HGF)POF |v Enabling Computational- & Data-Intensive Science and Engineering |9 G:(DE-HGF)POF4-5111 |x 0 |
| 913 | 1 | _ | |a DE-HGF |b Key Technologies |l Engineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action |1 G:(DE-HGF)POF4-510 |0 G:(DE-HGF)POF4-511 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-500 |4 G:(DE-HGF)POF |v Enabling Computational- & Data-Intensive Science and Engineering |9 G:(DE-HGF)POF4-5112 |x 1 |
| 914 | 1 | _ | |y 2023 |
| 920 | 1 | _ | |0 I:(DE-Juel1)JSC-20090406 |k JSC |l Jülich Supercomputing Center |x 0 |
| 980 | _ | _ | |a poster |
| 980 | _ | _ | |a VDB |
| 980 | _ | _ | |a I:(DE-Juel1)JSC-20090406 |
| 980 | _ | _ | |a UNRESTRICTED |
| Library | Collection | CLSMajor | CLSMinor | Language | Author |
|---|