Contribution to a conference proceedings/Contribution to a book FZJ-2026-01050

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Unlocking the compute continuum: Scaling out from cloud to HPC and HTC resources

 ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;

2025
EDP Sciences Les Ulis

Conference on Computing in High Energy and Nuclear Physics, CHEP 2024, KrakówKraków, Poland, 19 Oct 2024 - 25 Oct 20242024-10-192024-10-25 Les Ulis : EDP Sciences, The European physical journal / Web of Conferences 337, 01296 pp. () [10.1051/epjconf/202533701296]

This record in other databases:  

Please use a persistent id in citations: doi:  doi:

Abstract: In a geo-distributed computing infrastructure with heterogeneous resources (HPC and HTC and possibly cloud), a key to unlock an efficient and user-friendly access to the resources is being able to offload each specific task to the best suited location. One of the most critical problems involves the logistics of wide-area, multi-stage workflows that move back and forth between multiple resource providers. We envision a model where such a challenge can be addressed enabling a “transparent offloading” of containerized payloads using the Kubernetes API primitives creating a common cloud-native interface to access any number of external hardware machines and type of backends. Thus we created the interLink project, an open source extension to the concept of Virtual-Kubelet with a design that aims for a common abstraction over heterogeneous and distributed backends. interLink is developed by INFN in the context of interTwin, an EU funded project that aims to build a digital-twin platform (Digital Twin Engine) for sciences, and the ICSC National Research Center for High Performance Computing, Big Data and Quantum Computing in Italy. In this talk we first provide a comprehensive overview of the key features and the technical implementation. We showcase our major case studies, such as the scale-out of an analysis facility, and the distribution of ML training processes. We focus on the impacts of being able to seamlessly exploit world-class EuroHPC supercomputers with such a technology.

Classification:

Contributing Institute(s):
  1. Jülich Supercomputing Center (JSC)
Research Program(s):
  1. 5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511) (POF4-511)
  2. interTwin - An interdisciplinary Digital Twin Engine for science (101058386) (101058386)

Appears in the scientific report 2025; 2025
Database coverage:
Medline ; Creative Commons Attribution CC BY 4.0 ; DOAJ ; OpenAccess ; DOAJ Seal
Click to display QR Code for this record

The record appears in these collections:
Dokumenttypen > Ereignisse > Beiträge zu Proceedings
Dokumenttypen > Bücher > Buchbeitrag
Workflowsammlungen > Öffentliche Einträge
Institutssammlungen > JSC
Publikationsdatenbank
Open Access

 Datensatz erzeugt am 2026-01-26, letzte Änderung am 2026-02-20


OpenAccess:
Volltext herunterladen PDF
Dieses Dokument bewerten:

Rate this document:
1
2
3
 
(Bisher nicht rezensiert)