Journal Article/Contribution to a conference proceedings FZJ-2025-00800

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Integrating FTS in the Fenix HPC Infrastructure

 ;  ;  ;  ;  ;  ;

2024
EDP Sciences Les Ulis

26th International Conference on Computing in High Energy and Nuclear Physics, CHEP 2023, Norfolk, VANorfolk, VA, USA, 8 May 2023 - 12 May 20232023-05-082023-05-12 The European physical journal / Web of Conferences 295, 01037 () [10.1051/epjconf/202429501037]

This record in other databases:  

Please use a persistent id in citations: doi:  doi:

Abstract: As compute requirements in experimental high-energy physicsare expected to significantly increase, there is a need for leveraging high-performance computing (HPC) resources. However, HPC systems are currentlyorganised and operated in a way that this is not easily possible. Here we willfocus on a specific e-infrastructure that incorporates HPC resources, namelyFenix, which is based on a consortium of 6 leading European supercomput-ing centres. Fenix was initiated through the Human Brain Project (HBP) butalso provides resources to other research communities in Europe. The Fenixsites are integrated into a common AAI and provide a so-called Archival DataRepository that can be accessed through a Swift API.In this paper, we report on our efforts to realise a data transfer service that allowto exchange data with the Fenix e-infrastructure. This has been enabled by im-plementing support of Swift in FTS3 and related software components. We will,in particular, discuss how FTS3 has been integrated into the Fenix AAI, whichlargely follows the architectural principles of the European Open Science Cloud(EOSC). Furthermore, we show how end-users can use this service through aWebFTS service that has been integrated into the science gateway of the HBP,which is also known as the HBP Collaboratory. Finally, we discuss how trans-fer commands can be automatically distributed over several FTS3 instances tooptimise transfer between different Fenix sites.

Classification:

Contributing Institute(s):
  1. Jülich Supercomputing Center (JSC)
Research Program(s):
  1. 5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511) (POF4-511)
  2. 5121 - Supercomputing & Big Data Facilities (POF4-512) (POF4-512)
  3. SLNS - SimLab Neuroscience (Helmholtz-SLNS) (Helmholtz-SLNS)
  4. ICEI - Interactive Computing E-Infrastructure for the Human Brain Project (800858) (800858)
  5. HBP SGA3 - Human Brain Project Specific Grant Agreement 3 (945539) (945539)

Appears in the scientific report 2024
Database coverage:
Medline ; Creative Commons Attribution CC BY 4.0 ; DOAJ ; OpenAccess ; DOAJ Seal ; SCOPUS
Click to display QR Code for this record

The record appears in these collections:
Document types > Events > Contributions to a conference proceedings
Document types > Articles > Journal Article
Workflow collections > Public records
Institute Collections > JSC
Publications database
Open Access

 Record created 2025-01-20, last modified 2025-02-03


OpenAccess:
Download fulltext PDF
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)