Talk (non-conference) (Other)

FZJ-2023-02224

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Data Mover: bridging the gap between HPC and Cloud storage

El Sayed Mohamed, S. (Corresponding author)FZJ* ; Lischewski, M.FZJ*

2023

Please use a persistent id in citations: http://hdl.handle.net/2128/34521

Abstract: Over the past years the storage landscape has increased in both size and options of storage systems. Contrary to HPC environments, storage systems are not fully replaced periodically and old systems are routinely operated besides newer technologies. This proves to be challenging for users having their data distributed across these different systems and their various APIs. To facilitate users data movement across the boundaries of old, new and different, the Data Mover was developed as part of the Fenix Data Services. In this talk we describe the Data Mover service, how it is operated and what options it provides the users. We will motivate the development of the Data Mover by introducing the complex infrastructure of the Juelich storage systems and how the Data Mover helps users navigate their data between components.

---

Contributing Institute(s):

1. Jülich Supercomputing Center (JSC)

Research Program(s):

1. 5121 - Supercomputing & Big Data Facilities (POF4-512) (POF4-512)

Appears in the scientific report 2023

---

Database coverage:

---