001019995 001__ 1019995 001019995 005__ 20240105202147.0 001019995 037__ $$aFZJ-2023-05810 001019995 1001_ $$0P:(DE-Juel1)174573$$aComito, Claudia$$b0$$eCorresponding author 001019995 1112_ $$aArtificial Intelligence Symposium on Theory, Application and Research 2023$$cESOC, Darmstadt$$d2023-09-27 - 2023-09-28$$gAI STAR#2023$$wGermany 001019995 245__ $$aAccelerating massive data processing in Python with Heat 001019995 260__ $$c2023 001019995 3367_ $$033$$2EndNote$$aConference Paper 001019995 3367_ $$2BibTeX$$aINPROCEEDINGS 001019995 3367_ $$2DRIVER$$aconferenceObject 001019995 3367_ $$2ORCID$$aCONFERENCE_POSTER 001019995 3367_ $$2DataCite$$aOutput Types/Conference Poster 001019995 3367_ $$0PUB:(DE-HGF)24$$2PUB:(DE-HGF)$$aPoster$$bposter$$mposter$$s1704431512_29017$$xAfter Call 001019995 520__ $$aHeat [1, 2] is an open-source Python library designed to address the challenges of working with massive data sets and harnessing the power of machine learning across disciplines. Developed collaboratively by within the Helmholtz Association (FZJ, KIT, and DLR), Heat offers cutting-edge capabilities for high-performance data analytics, machine learning, and deep learning.Heat provides a Numpy-like API that simplifies the development of scalable, GPU-accelerated applications. What sets Heat apart is its underlying data-parallelism, implemented on top of MPI, which significantly enhances efficiency and performance of data processing compared to traditional task-parallel frameworks.By exploring practical use cases in space science (materials engineering, atmospheric modeling, anomaly detection) and its potential as a backend for diverse data processing pipelines, we will illustrate how Heat can accelerate AI research and applications.[1] Götz, M., Debus, C., Coquelin, et al.: "HeAT - a Distributed and GPU-accelerated Tensor Framework for Data Analytics" [2] https://github.com/helmholtz-analytics/heat 001019995 536__ $$0G:(DE-HGF)POF4-5111$$a5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511)$$cPOF4-511$$fPOF IV$$x0 001019995 536__ $$0G:(DE-HGF)POF4-5112$$a5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511)$$cPOF4-511$$fPOF IV$$x1 001019995 536__ $$0G:(DE-Juel1)Helmholtz-SLNS$$aSLNS - SimLab Neuroscience (Helmholtz-SLNS)$$cHelmholtz-SLNS$$x2 001019995 7001_ $$0P:(DE-HGF)0$$aGötz, Markus$$b1 001019995 7001_ $$0P:(DE-HGF)0$$aGutiérrez Hermosillo Muriedas, Juan Pedro$$b2 001019995 7001_ $$0P:(DE-Juel1)132123$$aHagemeier, Björn$$b3 001019995 7001_ $$0P:(DE-HGF)0$$aHoppe, Fabian$$b4 001019995 7001_ $$0P:(DE-HGF)0$$aKnechtges, Philipp$$b5 001019995 7001_ $$0P:(DE-Juel1)129347$$aKrajsek, Kai$$b6 001019995 7001_ $$0P:(DE-HGF)0$$aRüttgers, Alexander$$b7 001019995 7001_ $$0P:(DE-HGF)0$$aStreit, Achim$$b8 001019995 7001_ $$0P:(DE-Juel1)178977$$aTarnawa, Michael$$b9 001019995 909CO $$ooai:juser.fz-juelich.de:1019995$$pVDB 001019995 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)174573$$aForschungszentrum Jülich$$b0$$kFZJ 001019995 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)132123$$aForschungszentrum Jülich$$b3$$kFZJ 001019995 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)129347$$aForschungszentrum Jülich$$b6$$kFZJ 001019995 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)178977$$aForschungszentrum Jülich$$b9$$kFZJ 001019995 9131_ $$0G:(DE-HGF)POF4-511$$1G:(DE-HGF)POF4-510$$2G:(DE-HGF)POF4-500$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$9G:(DE-HGF)POF4-5111$$aDE-HGF$$bKey Technologies$$lEngineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action$$vEnabling Computational- & Data-Intensive Science and Engineering$$x0 001019995 9131_ $$0G:(DE-HGF)POF4-511$$1G:(DE-HGF)POF4-510$$2G:(DE-HGF)POF4-500$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$9G:(DE-HGF)POF4-5112$$aDE-HGF$$bKey Technologies$$lEngineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action$$vEnabling Computational- & Data-Intensive Science and Engineering$$x1 001019995 9141_ $$y2023 001019995 9201_ $$0I:(DE-Juel1)JSC-20090406$$kJSC$$lJülich Supercomputing Center$$x0 001019995 980__ $$aposter 001019995 980__ $$aVDB 001019995 980__ $$aI:(DE-Juel1)JSC-20090406 001019995 980__ $$aUNRESTRICTED