Sage2
Percipient Storage for Exascale Data Centric Computing2
Coordinator | BULL SAS ; SEAGATE SYSTEMS UK LIMITED ; KITWARE SAS ; ARM LIMITED ; Forschungszentrum Jülich ; United Kingdom Space Agency ; Atomic Energy and Alternative Energies Commission ; Edinburgh Napier University ; Royal Institute of Technology |
Grant period | 2018-09-01 - 2021-11-30 |
Funding body | European Union |
Call number | H2020-FETHPC-2017 |
Grant number | 800999 |
Identifier | G:(EU-Grant)800999 |
Note: The landscape for High Performance Computing is changing with the proliferation of enormous volumes of data created by scientific instruments and sensors, in addition to data from simulations. This data needs to be stored, processed and analysed, and existing storage system technologies in the realm of extreme computing need to be adapted to achieve reasonable efficiency in achieving higher scientific throughput. We started on the journey to address this problem with the SAGE project. The HPC use cases and the technology ecosystem is now further evolving and there are new requirements and innovations that are brought to the forefront. It is extremely critical to address them today without “reinventing the wheel” leveraging existing initiatives and know-how to build the pieces of the Exascale puzzle as quickly and efficiently as we can.
The SAGE paradigm already provides a basic framework to address the extreme scale data aspects of High Performance Computing on the path to Exascale. Sage2 (Percipient StorAGe for Exascale Data Centric Computing 2) intends to validate a next generation storage system building on top of the already existing SAGE platform to address new use case requirements in the areas of extreme scale computing scientific workflows and AI/deep learning leveraging the latest developments in storage infrastructure software and storage technology ecosystem.
Sage2 aims to provide significantly enhanced scientific throughput, improved scalability, and, time & energy to solution for the use cases at scale. Sage2 will also dramatically increase the productivity of developers and users of these systems.
This proposal is aligned to FETHPC-02 - 2017:part (c). Sage2 provides a highly performant and resilient, QoS capable multi tiered storage system, with data layouts across the tiers managed by the Mero Object Store, which is capable of handling in-transit/in-situ processing of data within the storage system, accessible through the Clovis API.
Recent Publications
All known publications ...
Download: BibTeX | EndNote XML, Text | RIS |
http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Contribution to a conference proceedings
Chien, S. W. D. (First author) ; Podobas, A. ; Svedin, M. ; Tkachuk, A. ; El Sayed Mohamed, S.FZJ* ; Herman, P. ; Umanesan, G. ; Narasimhamurthy, S. ; Markidis, S. (Corresponding author)
NoaSci: A Numerical Object Array Library for I/O of Scientific Applications on Object Storage
20222022 30th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP), ValladolidValladolid, Spain, 9 Mar 2022 - 11 Mar 20222022-03-092022-03-11
IEEE 172-176 (2022) [10.1109/PDP55904.2022.00034]2022
Files
Fulltext by OpenAccess repository
BibTeX |
EndNote:
XML,
Text |
RIS
http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Poster (After Call)
Witt, S. d. ; Samaddar, D. ; Narasimhamurthy, S. ; Umanesan, G. ; Pleiter, D.FZJ* ; El Sayed Mohamed, S.FZJ* ; Davis, A. (Corresponding author)
Sage2 - Percipient StorAGe for Exascale Data Centric Computing
201924th International Conference on Computing in High Energy and Nuclear Physics, CHEP 2019, AdelaideAdelaide, Australia, 4 Nov 2019 - 8 Nov 20192019-11-042019-11-08
Files
Fulltext by OpenAccess repository
BibTeX |
EndNote:
XML,
Text |
RIS
http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Conference Presentation (Plenary/Keynote)
Pleiter, D. (Corresponding author)FZJ*
HPC Systems in the Next Decade - What to Expect, When, Where
201924th International Conference on Computing in High Energy and Nuclear Physics, CHEP 2019, AdelaideAdelaide, Australia, 4 Nov 2019 - 8 Nov 20192019-11-042019-11-08
Files
Fulltext by OpenAccess repository
BibTeX |
EndNote:
XML,
Text |
RIS
All known publications ...
Download: BibTeX | EndNote XML, Text | RIS |