001027280 001__ 1027280
001027280 005__ 20250204113903.0
001027280 0247_ $$2doi$$a10.1016/j.ascom.2024.100835
001027280 0247_ $$2ISSN$$a2213-1337
001027280 0247_ $$2ISSN$$a2213-1345
001027280 0247_ $$2datacite_doi$$a10.34734/FZJ-2024-03724
001027280 0247_ $$2WOS$$aWOS:001250562200001
001027280 037__ $$aFZJ-2024-03724
001027280 082__ $$a520
001027280 1001_ $$0P:(DE-Juel1)132183$$aManzano, C.$$b0$$eFirst author$$ufzj
001027280 245__ $$aLearning from the present for the future: The Jülich LOFAR Long-term Archive
001027280 260__ $$aAmsterdam [u.a.]$$bElsevier$$c2024
001027280 3367_ $$2DRIVER$$aarticle
001027280 3367_ $$2DataCite$$aOutput Types/Journal article
001027280 3367_ $$0PUB:(DE-HGF)16$$2PUB:(DE-HGF)$$aJournal Article$$bjournal$$mjournal$$s1721139553_10764
001027280 3367_ $$2BibTeX$$aARTICLE
001027280 3367_ $$2ORCID$$aJOURNAL_ARTICLE
001027280 3367_ $$00$$2EndNote$$aJournal Article
001027280 520__ $$aThe Forschungszentrum Jülich has been hosting the German part of the LOFAR archive since 2013. It is Germany’s most extensive radio astronomy archive, currently storing nearly 22 petabytes (PB) of data. Future radio telescopes are expected to require a dramatic increase in long-term data storage. Here, we take stock of the current data management of the Jülich LOFAR Data Archive, describe the ingestion, the storage system, the export to the long-term archive, and the request chain. We analysed the data availability over the last 10 years and searched for the underlying data access pattern and the energy consumption of the process. We determine hardware-related limiting factors, such as network bandwidth and cache pool availability and performance, and software aspects, e.g. workflow adjustment and parameter tuning, as the main data storage bottlenecks. By contrast, the challenge in providing the data from the archive for the users lies in retrieving the data from the tape archive and staging them. Building on this analysis, we suggest how to avoid/mitigate these problems in the future and define the requirements for future even more extensive long-term data archives.
001027280 536__ $$0G:(DE-HGF)POF4-5111$$a5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511)$$cPOF4-511$$fPOF IV$$x0
001027280 536__ $$0G:(DE-HGF)POF4-5121$$a5121 - Supercomputing & Big Data Facilities (POF4-512)$$cPOF4-512$$fPOF IV$$x1
001027280 536__ $$0G:(GEPRIS)460248186$$aDFG project 460248186 - PUNCH4NFDI - Teilchen, Universum, Kerne und Hadronen für die NFDI (460248186)$$c460248186$$x2
001027280 536__ $$0G:(DE-Juel-1)PROFILNRW-2020-038B$$aBig Bang to Big Data - B3D [NRW-Cluster für datenintensive Radioastronomie] (PROFILNRW-2020-038B)$$cPROFILNRW-2020-038B$$x3
001027280 588__ $$aDataset connected to CrossRef, Journals: juser.fz-juelich.de
001027280 7001_ $$0P:(DE-Juel1)185945$$aMiskolczi, A.$$b1$$ufzj
001027280 7001_ $$0P:(DE-Juel1)194141$$aStiele, H.$$b2$$eCorresponding author$$ufzj
001027280 7001_ $$0P:(DE-Juel1)194303$$aVybornov, V.$$b3$$ufzj
001027280 7001_ $$0P:(DE-Juel1)132100$$aFieseler, T.$$b4$$ufzj
001027280 7001_ $$0P:(DE-Juel1)177668$$aPfalzner, S.$$b5$$eLast author$$ufzj
001027280 773__ $$0PERI:(DE-600)2695868-5$$a10.1016/j.ascom.2024.100835$$gVol. 48, p. 100835 -$$p100835 -$$tAstronomy and computing$$v48$$x2213-1337$$y2024
001027280 8564_ $$uhttps://juser.fz-juelich.de/record/1027280/files/1-s2.0-S2213133724000507-main.pdf$$yOpenAccess
001027280 8564_ $$uhttps://juser.fz-juelich.de/record/1027280/files/1-s2.0-S2213133724000507-main.gif?subformat=icon$$xicon$$yOpenAccess
001027280 8564_ $$uhttps://juser.fz-juelich.de/record/1027280/files/1-s2.0-S2213133724000507-main.jpg?subformat=icon-1440$$xicon-1440$$yOpenAccess
001027280 8564_ $$uhttps://juser.fz-juelich.de/record/1027280/files/1-s2.0-S2213133724000507-main.jpg?subformat=icon-180$$xicon-180$$yOpenAccess
001027280 8564_ $$uhttps://juser.fz-juelich.de/record/1027280/files/1-s2.0-S2213133724000507-main.jpg?subformat=icon-640$$xicon-640$$yOpenAccess
001027280 8767_ $$d2024-07-30$$eHybrid-OA$$jDEAL
001027280 909CO $$ooai:juser.fz-juelich.de:1027280$$pdnbdelivery$$popenCost$$pVDB$$pdriver$$pOpenAPC_DEAL$$popen_access$$popenaire
001027280 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)132183$$aForschungszentrum Jülich$$b0$$kFZJ
001027280 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)185945$$aForschungszentrum Jülich$$b1$$kFZJ
001027280 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)194141$$aForschungszentrum Jülich$$b2$$kFZJ
001027280 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)194303$$aForschungszentrum Jülich$$b3$$kFZJ
001027280 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)132100$$aForschungszentrum Jülich$$b4$$kFZJ
001027280 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)177668$$aForschungszentrum Jülich$$b5$$kFZJ
001027280 9131_ $$0G:(DE-HGF)POF4-511$$1G:(DE-HGF)POF4-510$$2G:(DE-HGF)POF4-500$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$9G:(DE-HGF)POF4-5111$$aDE-HGF$$bKey Technologies$$lEngineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action$$vEnabling Computational- & Data-Intensive Science and Engineering$$x0
001027280 9131_ $$0G:(DE-HGF)POF4-512$$1G:(DE-HGF)POF4-510$$2G:(DE-HGF)POF4-500$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$9G:(DE-HGF)POF4-5121$$aDE-HGF$$bKey Technologies$$lEngineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action$$vSupercomputing & Big Data Infrastructures$$x1
001027280 9141_ $$y2024
001027280 915pc $$0PC:(DE-HGF)0000$$2APC$$aAPC keys set
001027280 915pc $$0PC:(DE-HGF)0001$$2APC$$aLocal Funding
001027280 915pc $$0PC:(DE-HGF)0002$$2APC$$aDFG OA Publikationskosten
001027280 915pc $$0PC:(DE-HGF)0125$$2APC$$aDEAL: Elsevier 09/01/2023
001027280 915__ $$0LIC:(DE-HGF)CCBY4$$2HGFVOC$$aCreative Commons Attribution CC BY 4.0
001027280 915__ $$0StatID:(DE-HGF)0113$$2StatID$$aWoS$$bScience Citation Index Expanded$$d2023-10-26
001027280 915__ $$0StatID:(DE-HGF)0510$$2StatID$$aOpenAccess
001027280 915__ $$0StatID:(DE-HGF)0160$$2StatID$$aDBCoverage$$bEssential Science Indicators$$d2023-10-26
001027280 915__ $$0StatID:(DE-HGF)0199$$2StatID$$aDBCoverage$$bClarivate Analytics Master Journal List$$d2024-12-13
001027280 915__ $$0StatID:(DE-HGF)1150$$2StatID$$aDBCoverage$$bCurrent Contents - Physical, Chemical and Earth Sciences$$d2024-12-13
001027280 915__ $$0StatID:(DE-HGF)0150$$2StatID$$aDBCoverage$$bWeb of Science Core Collection$$d2024-12-13
001027280 915__ $$0StatID:(DE-HGF)0100$$2StatID$$aJCR$$bASTRON COMPUT : 2022$$d2024-12-13
001027280 915__ $$0StatID:(DE-HGF)0200$$2StatID$$aDBCoverage$$bSCOPUS$$d2024-12-13
001027280 915__ $$0StatID:(DE-HGF)9900$$2StatID$$aIF < 5$$d2024-12-13
001027280 920__ $$lyes
001027280 9201_ $$0I:(DE-Juel1)JSC-20090406$$kJSC$$lJülich Supercomputing Center$$x0
001027280 9801_ $$aFullTexts
001027280 980__ $$ajournal
001027280 980__ $$aVDB
001027280 980__ $$aUNRESTRICTED
001027280 980__ $$aI:(DE-Juel1)JSC-20090406
001027280 980__ $$aAPC