DataLad: distributed system for joint management of code, data, and their relationship

Halchenko, Yaroslav; Schneider, Robin; Pustina, Dorian; Gors, Jason; Haxby, James; de la Vega, Alejandro; Skytén, Kusti; Sochat, Vanessa; Markiewicz, Christopher; Häusler, Christian; Waite, Laura; Poline, Jean-Baptiste; Kadelka, Tobias; Kennedy, David; Strauss, Ted; Pflüger, Mika; Eickhoff, Simon; Wagner, Adina; Poldrack, Benjamin; Hayashi, Soichi; Ghosh, Satrajit; Vavra, Peter; Mönch, Christian; Meyer, Kyle; Solanky, Debanjum; MacFarlane, Dave; Hanke, Michael; Ioanas, Horea-Ioan; Jarecka, Dorota; Shlyakhter, Ilya; Cieslak, Matt

doi:10.21105/joss.03262

Journal Article

FZJ-2021-02965

DataLad: distributed system for joint management of code, data, and their relationship

Halchenko, Y.Extern* ; Meyer, K. ; Poldrack, B.FZJ* ; Solanky, D.Extern* ; Wagner, A.FZJ* ; Gors, J. ; MacFarlane, D. ; Pustina, D.Extern* ; Sochat, V.Extern* ; Ghosh, S.Extern* ; Mönch, C.FZJ* ; Markiewicz, C.Extern* ; Waite, L.FZJ* ; Shlyakhter, I.Extern* ; de la Vega, A.Extern* ; Hayashi, S.Extern* ; Häusler, C.FZJ* ; Poline, J.-B.Extern* ; Kadelka, T.FZJ* ; Skytén, K.Extern* ; Jarecka, D.Extern* ; Kennedy, D.Extern* ; Strauss, T.Extern* ; Cieslak, M.Extern* ; Vavra, P. ; Ioanas, H.-I. ; Schneider, R.Extern* ; Pflüger, M.Extern* ; Haxby, J. ; Eickhoff, S.FZJ* ; Hanke, M. (Corresponding author)FZJ*

2021

The journal of open source software 6(63), 3262 - (2021) [10.21105/joss.03262]

This record in other databases:

Please use a persistent id in citations: doi:10.21105/joss.03262

Abstract: DataLad is a Python-based tool for the joint management of code, data, and their relationship,built on top of a versatile system for data logistics (git-annex) and the most popular distributedversion control system (Git). It adapts principles of open-source software development anddistribution to address the technical challenges of data management, data sharing, and digitalprovenance collection across the life cycle of digital objects. DataLad aims to make datamanagement as easy as managing code. It streamlines procedures to consume, publish, andupdate data, for data of any size or type, and to link them as precisely versioned, lightweightdependencies. DataLad helps to make science more reproducible and FAIR (Wilkinson et al.,2016). It can capture complete and actionable process provenance of data transformations toenable automatic re-computation. The DataLad project (datalad.org) delivers a completelyopen, pioneering platform for flexible decentralized research data management (RDM) (Hanke,Pestilli, et al., 2021). It features a Python and a command-line interface, an extensiblearchitecture, and does not depend on any centralized services but facilitates interoperabilitywith a plurality of existing tools and services. In order to maximize its utility and target audience, DataLad is available for all major operating systems, and can be integrated intoestablished workflows and environments with minimal friction.

Classification: