Contribution to a conference proceedings/Contribution to a book FZJ-2021-04100

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
HeAT – a Distributed and GPU-accelerated Tensor Framework for Data Analytics

 ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;

2020
IEEE
ISBN: 978-1-7281-6251-5

2020 IEEE International Conference on Big Data (Big Data), AtlantaAtlanta, GA, 10 Dec 2020 - 13 Dec 20202020-12-102020-12-13 IEEE 276-287 () [10.1109/BigData50022.2020.9378050]

This record in other databases:    

Please use a persistent id in citations:   doi:

Abstract: To cope with the rapid growth in available data, the efficiency of data analysis and machine learning libraries has recently received increased attention. Although great advancements have been made in traditional array-based computations, most are limited by the resources available on a single computation node. Consequently, novel approaches must be made to exploit distributed resources, e.g. distributed memory architectures. To this end, we introduce HeAT, an array-based numerical programming framework for large-scale parallel processing with an easy-to-use NumPy-like API. HeAT utilizes PyTorch as a node-local eager execution engine and distributes the workload on arbitrarily large high-performance computing systems via MPI. It provides both low-level array computations, as well as assorted higher-level algorithms. With HeAT, it is possible for a NumPy user to take full advantage of their available resources, significantly lowering the barrier to distributed data analysis. When compared to similar frameworks, HeAT achieves speedups of up to two orders of magnitude.


Contributing Institute(s):
  1. Jülich Supercomputing Center (JSC)
Research Program(s):
  1. 5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511) (POF4-511)
  2. HAF - Helmholtz Analytics Framework (ZT-I-0003) (ZT-I-0003)
  3. SLNS - SimLab Neuroscience (Helmholtz-SLNS) (Helmholtz-SLNS)

Appears in the scientific report 2021
Database coverage:
OpenAccess
Click to display QR Code for this record

The record appears in these collections:
Document types > Events > Contributions to a conference proceedings
Document types > Books > Contribution to a book
Workflow collections > Public records
Institute Collections > JSC
Publications database
Open Access

 Record created 2021-11-04, last modified 2022-09-14


OpenAccess:
Download fulltext PDF
External link:
Download fulltextFulltext by OpenAccess repository
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)