%0 Book Section
%A Manzano, Cristina
%A Schwarz, Kilian
%A Grange, Yan G.
%A Miskolczi, Arpad
%A Huynh, Minh T.
%A Wicenec, Andreas
%A Salgado, Jesús
%A Desai, Vandana
%T Storage and Long Term Archives
%V 472
%C Cham
%I Springer International Publishing
%M FZJ-2024-06183
%@ 978-3-031-58467-1
%B Astrophysics and Space Science Library
%P 41 - 66
%D 2024
%< Data-Intensive Radio Astronomy
%X In this chapter we introduce and describe the storage and long-term archives used for radio astronomy data. Firstly, we give an overview of a storage system and explain what caching is and why it is used. Secondly, we describe in detail current solutions for data from the LOFAR, ASKAP, Apertif and ALMA radio telescopes. We then explain which data transfer protocols are commonly used and describe them. Thirdly, we present federated storage infrastructures in high-energy physics and show how they are designed. Data lakes are discussed and several projects dealing with them are presented and described. We then discuss what data lakes are or how they can be used in radio astronomy and the overlap between the data needs of astronomical archives and those of high-energy physics experiments. Finally, we give an overview of how the SKA data centres are planned.
%F PUB:(DE-HGF)7
%9 Contribution to a book
%R 10.1007/978-3-031-58468-8_3
%U https://juser.fz-juelich.de/record/1032366