001025704 001__ 1025704
001025704 005__ 20240506205525.0
001025704 037__ $$aFZJ-2024-03087
001025704 1001_ $$0P:(DE-Juel1)131684$$aHoffstaedter, Felix$$b0$$eCorresponding author
001025704 1112_ $$aDistribits: technologies for distributed data management$$cDüsseldorf$$d2024-04-04 - 2024-04-04$$wGermany
001025704 245__ $$aReproducibility vs. computational efficiency on HPC systems
001025704 260__ $$c2024
001025704 3367_ $$033$$2EndNote$$aConference Paper
001025704 3367_ $$2DataCite$$aOther
001025704 3367_ $$2BibTeX$$aINPROCEEDINGS
001025704 3367_ $$2DRIVER$$aconferenceObject
001025704 3367_ $$2ORCID$$aLECTURE_SPEECH
001025704 3367_ $$0PUB:(DE-HGF)6$$2PUB:(DE-HGF)$$aConference Presentation$$bconf$$mconf$$s1714968480_4419$$xOther
001025704 520__ $$aHPC systems have particular hard- and software configurations that introduce specific challenges for the implementation of reproducible data processing workflows. The DataLad based 'FAIRly big workflow' allows for a separation of the compute environment from the processing pipeline enabling automatic reproducibility over systems. Yet, the sheer size of RAM and CPUs on HPC systems will allow for different ways to optimize compute jobs in contrast to compute clusters and certainly the average workstation/laptop. In this talk, I discuss general differences between HCP and more standard compute environments regarding necessary choices for the setup of processing pipelines to be reproducible. Among the main factors are the availability of RAM, local storage, inodes and wall clock time.
001025704 536__ $$0G:(DE-HGF)POF4-5254$$a5254 - Neuroscientific Data Analytics and AI (POF4-525)$$cPOF4-525$$fPOF IV$$x0
001025704 909CO $$ooai:juser.fz-juelich.de:1025704$$pVDB
001025704 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)131684$$aForschungszentrum Jülich$$b0$$kFZJ
001025704 9131_ $$0G:(DE-HGF)POF4-525$$1G:(DE-HGF)POF4-520$$2G:(DE-HGF)POF4-500$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$9G:(DE-HGF)POF4-5254$$aDE-HGF$$bKey Technologies$$lNatural, Artificial and Cognitive Information Processing$$vDecoding Brain Organization and Dysfunction$$x0
001025704 9141_ $$y2024
001025704 9201_ $$0I:(DE-Juel1)INM-7-20090406$$kINM-7$$lGehirn & Verhalten$$x0
001025704 980__ $$aconf
001025704 980__ $$aVDB
001025704 980__ $$aI:(DE-Juel1)INM-7-20090406
001025704 980__ $$aUNRESTRICTED