TY  - CHAP
AU  - Manzano, Cristina
AU  - Schwarz, Kilian
AU  - Grange, Yan G.
AU  - Miskolczi, Arpad
AU  - Huynh, Minh T.
AU  - Wicenec, Andreas
AU  - Salgado, Jesús
AU  - Desai, Vandana
TI  - Storage and Long Term Archives
VL  - 472
CY  - Cham
PB  - Springer International Publishing
M1  - FZJ-2024-06183
SN  - 978-3-031-58467-1
T2  - Astrophysics and Space Science Library
SP  - 41 - 66
PY  - 2024
AB  - In this chapter we introduce and describe the storage and long-term archives used for radio astronomy data. Firstly, we give an overview of a storage system and explain what caching is and why it is used. Secondly, we describe in detail current solutions for data from the LOFAR, ASKAP, Apertif and ALMA radio telescopes. We then explain which data transfer protocols are commonly used and describe them. Thirdly, we present federated storage infrastructures in high-energy physics and show how they are designed. Data lakes are discussed and several projects dealing with them are presented and described. We then discuss what data lakes are or how they can be used in radio astronomy and the overlap between the data needs of astronomical archives and those of high-energy physics experiments. Finally, we give an overview of how the SKA data centres are planned.
LB  - PUB:(DE-HGF)7
DO  - DOI:10.1007/978-3-031-58468-8_3
UR  - https://juser.fz-juelich.de/record/1032366
ER  -