Early Evaluation of the “Infinite Memory Engine” Burst Buffer Solution

Schenck, Wolfram; El Sayed Mohamed, Salem; Pleiter, Dirk; Homberg, Wilhelm; Foszczynski, Maciej

doi:10.1007/978-3-319-46079-6_41

Contribution to a conference proceedings/Contribution to a book

FZJ-2016-06454

Early Evaluation of the “Infinite Memory Engine” Burst Buffer Solution

Schenck, W. (Corresponding author) ; El Sayed Mohamed, S.FZJ* ; Foszczynski, M. ; Homberg, W.FZJ* ; Pleiter, D.FZJ*

2016
Springer International Publishing Cham
ISBN: 978-3-319-46078-9 (print), 978-3-319-46079-6 (electronic)

High Performance Computing / Taufer, Michela (Editor) ; Cham : Springer International Publishing, 2016, Chapter 41 ; ISSN: 0302-9743=1611-3349 ; ISBN: 978-3-319-46078-9=978-3-319-46079-6
Workshop On Performance and Scalability of Storage Systems, WOPSSS 2016, Frankfurt, Germany, 23 Jun 2016 - 23 Jun 2016 Cham : Springer International Publishing, Lecture Notes in Computer Science 9945, 604 - 615 (2016) [10.1007/978-3-319-46079-6_41]

This record in other databases:

Please use a persistent id in citations: doi:10.1007/978-3-319-46079-6_41

Abstract: Hierarchical storage architectures are required to meet both, capacity and bandwidth requirements for future high-end storage architectures. In this paper we present the results of an evaluation of an emerging technology, DataDirect Networks’ (DDN) Infinite Memory Engine (IME). IME allows to realize a fast buffer in front of a large capacity storage system. We collected benchmarking data with IOR and with the HPC application NEST. The IOR bandwidth results show how well network bandwidth towards such fast buffer can be exploited compared to the external storage system. The NEST benchmarks clearly demonstrate that IME can reduce I/O-induced load imbalance between MPI ranks to a minimum while speeding up I/O as a whole by a considerable factor.

Classification: