001     875461
005     20230711152439.0
024 7 _ |2 doi
|a 10.1101/843193
024 7 _ |2 doi
|a 10.1038/s41586-020-2314-9
024 7 _ |2 Handle
|a 2128/25728
024 7 _ |2 altmetric
|a altmetric:82417714
024 7 _ |2 pmid
|a pmid:32483374
024 7 _ |2 WOS
|a WOS:000535225300001
037 _ _ |a FZJ-2020-02053
082 _ _ |a 500
100 1 _ |0 0000-0003-2669-1877
|a Botvinik-Nezer, Rotem
|b 0
245 _ _ |a Variability in the analysis of a single neuroimaging dataset by many teams
260 _ _ |a London [u.a.]
|b Nature Publ. Group
|c 2020
336 7 _ |2 DRIVER
|a article
336 7 _ |2 DataCite
|a Output Types/Journal article
336 7 _ |0 PUB:(DE-HGF)16
|2 PUB:(DE-HGF)
|a Journal Article
|b journal
|m journal
|s 1600885198_17522
336 7 _ |2 BibTeX
|a ARTICLE
336 7 _ |2 ORCID
|a JOURNAL_ARTICLE
336 7 _ |0 0
|2 EndNote
|a Journal Article
520 _ _ |a Data analysis workflows in many scientific domains have become increasingly complex and flexible. To assess the impact of this flexibility on functional magnetic resonance imaging (fMRI) results, the same dataset was independently analyzed by 70 teams, testing nine ex-ante hypotheses. The flexibility of analytic approaches is exemplified by the fact that no two teams chose identical workflows to analyze the data. This flexibility resulted in sizeable variation in hypothesis test results, even for teams whose statistical maps were highly correlated at intermediate stages of their analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Importantly, meta-analytic approaches that aggregated information across teams yielded significant consensus in activated regions across teams. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset. Our findings show that analytic flexibility can have substantial effects on scientific conclusions, and demonstrate factors related to variability in fMRI. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for multiple analyses of the same data. Potential approaches to mitigate issues related to analytical variability are discussed.
536 _ _ |0 G:(DE-HGF)POF3-574
|a 574 - Theory, modelling and simulation (POF3-574)
|c POF3-574
|f POF III
|x 0
588 _ _ |a Dataset connected to CrossRef
700 1 _ |0 0000-0001-9606-0427
|a Holzmeister, Felix
|b 1
700 1 _ |a Camerer, Colin F.
|b 2
700 1 _ |a Dreber, Anna
|b 3
700 1 _ |a Huber, Juergen
|b 4
700 1 _ |a Johannesson, Magnus
|b 5
700 1 _ |a Kirchler, Michael
|b 6
700 1 _ |a Iwanir, Roni
|b 7
700 1 _ |a Mumford, Jeanette A.
|b 8
700 1 _ |a Adcock, Alison
|b 9
700 1 _ |a Avesani, Paolo
|b 10
700 1 _ |a Baczkowski, Blazej
|b 11
700 1 _ |a Bajracharya, Aahana
|b 12
700 1 _ |a Bakst, Leah
|b 13
700 1 _ |a Ball, Sheryl
|b 14
700 1 _ |a Barilari, Marco
|b 15
700 1 _ |a Bault, Nadège
|b 16
700 1 _ |a Beaton, Derek
|b 17
700 1 _ |a Beitner, Julia
|b 18
700 1 _ |a Benoit, Roland
|b 19
700 1 _ |a Berkers, Ruud
|b 20
700 1 _ |a Bhanji, Jamil
|b 21
700 1 _ |a Biswal, Bharat
|b 22
700 1 _ |a Bobadilla-Suarez, Sebastian
|b 23
700 1 _ |a Bortolini, Tiago
|b 24
700 1 _ |a Bottenhorn, Katherine
|b 25
700 1 _ |a Bowring, Alexander
|b 26
700 1 _ |a Braem, Senne
|b 27
700 1 _ |a Brooks, Hayley
|b 28
700 1 _ |a Brudner, Emily
|b 29
700 1 _ |a Calderon, Cristian
|b 30
700 1 _ |0 P:(DE-Juel1)172024
|a Camilleri, Julia
|b 31
700 1 _ |a Castrellon, Jaime
|b 32
700 1 _ |a Cecchetti, Luca
|b 33
700 1 _ |0 P:(DE-Juel1)131855
|a Cieslik, Edna
|b 34
700 1 _ |a Cole, Zachary
|b 35
700 1 _ |a Collignon, Olivier
|b 36
700 1 _ |a Cox, Robert
|b 37
700 1 _ |a Cunningham, William
|b 38
700 1 _ |a Czoschke, Stefan
|b 39
700 1 _ |a Dadi, Kamalaker
|b 40
700 1 _ |a Davis, Charles
|b 41
700 1 _ |a De Luca, Alberto
|b 42
700 1 _ |a Delgado, Mauricio
|b 43
700 1 _ |a Demetriou, Lysia
|b 44
700 1 _ |a Dennison, Jeffrey
|b 45
700 1 _ |a Di, Xin
|b 46
700 1 _ |a Dickie, Erin
|b 47
700 1 _ |a Dobryakova, Ekaterina
|b 48
700 1 _ |a Donnat, Claire
|b 49
700 1 _ |0 P:(DE-Juel1)177772
|a Dukart, Juergen
|b 50
700 1 _ |a Duncan, Niall W.
|b 51
700 1 _ |a Durnez, Joke
|b 52
700 1 _ |a Eed, Amr
|b 53
700 1 _ |0 P:(DE-Juel1)131678
|a Eickhoff, Simon
|b 54
700 1 _ |a Erhart, Andrew
|b 55
700 1 _ |a Fontanesi, Laura
|b 56
700 1 _ |a Fricke, G. Matthew
|b 57
700 1 _ |a Galvan, Adriana
|b 58
700 1 _ |a Gau, Remi
|b 59
700 1 _ |0 P:(DE-Juel1)161225
|a Genon, Sarah
|b 60
700 1 _ |a Glatard, Tristan
|b 61
700 1 _ |a Glerean, Enrico
|b 62
700 1 _ |a Goeman, Jelle
|b 63
700 1 _ |a Golowin, Sergej
|b 64
700 1 _ |a González-García, Carlos
|b 65
700 1 _ |a Gorgolewski, Krzysztof
|b 66
700 1 _ |a Grady, Cheryl
|b 67
700 1 _ |a Green, Mikella
|b 68
700 1 _ |a Guassi Moreira, João
|b 69
700 1 _ |a Guest, Olivia
|b 70
700 1 _ |a Hakimi, Shabnam
|b 71
700 1 _ |a Hamilton, J. Paul
|b 72
700 1 _ |a Hancock, Roeland
|b 73
700 1 _ |a Handjaras, Giacomo
|b 74
700 1 _ |a Harry, Bronson
|b 75
700 1 _ |a Hawco, Colin
|b 76
700 1 _ |a Herholz, Peer
|b 77
700 1 _ |a Herman, Gabrielle
|b 78
700 1 _ |a Heunis, Stephan
|b 79
700 1 _ |0 P:(DE-Juel1)131684
|a Hoffstaedter, Felix
|b 80
700 1 _ |a Hogeveen, Jeremy
|b 81
700 1 _ |a Holmes, Susan
|b 82
700 1 _ |a Hu, Chuan-Peng
|b 83
700 1 _ |a Huettel, Scott
|b 84
700 1 _ |a Hughes, Matthew
|b 85
700 1 _ |a Iacovella, Vittorio
|b 86
700 1 _ |a Iordan, Alexandru
|b 87
700 1 _ |a Isager, Peder
|b 88
700 1 _ |a Isik, Ayse Ilkay
|b 89
700 1 _ |a Jahn, Andrew
|b 90
700 1 _ |a Johnson, Matthew
|b 91
700 1 _ |a Johnstone, Tom
|b 92
700 1 _ |a Joseph, Michael
|b 93
700 1 _ |a Juliano, Anthony
|b 94
700 1 _ |a Kable, Joseph
|b 95
700 1 _ |a Kassinopoulos, Michalis
|b 96
700 1 _ |a Koba, Cemal
|b 97
700 1 _ |a Kong, Xiang-Zhen
|b 98
700 1 _ |a Koscik, Timothy
|b 99
700 1 _ |a Kucukboyaci, Nuri Erkut
|b 100
700 1 _ |a Kuhl, Brice
|b 101
700 1 _ |a Kupek, Sebastian
|b 102
700 1 _ |a Laird, Angela
|b 103
700 1 _ |a Lamm, Claus
|b 104
700 1 _ |0 P:(DE-Juel1)131693
|a Langner, Robert
|b 105
700 1 _ |a Lauharatanahirun, Nina
|b 106
700 1 _ |a Lee, Hongmi
|b 107
700 1 _ |a Lee, Sangil
|b 108
700 1 _ |a Leemans, Alexander
|b 109
700 1 _ |a Leo, Andrea
|b 110
700 1 _ |a Lesage, Elise
|b 111
700 1 _ |a Li, Flora
|b 112
700 1 _ |a Li, Monica
|b 113
700 1 _ |a Lim, Phui Cheng
|b 114
700 1 _ |a Lintz, Evan
|b 115
700 1 _ |a Liphardt, Schuyler
|b 116
700 1 _ |a Losecaat Vermeer, Annabel
|b 117
700 1 _ |a Love, Bradley
|b 118
700 1 _ |a Mack, Michael
|b 119
700 1 _ |a Malpica, Norberto
|b 120
700 1 _ |a Marins, Theo
|b 121
700 1 _ |a Maumet, Camille
|b 122
700 1 _ |a McDonald, Kelsey
|b 123
700 1 _ |a McGuire, Joseph
|b 124
700 1 _ |a Melero, Helena
|b 125
700 1 _ |a Méndez Leal, Adriana
|b 126
700 1 _ |a Meyer, Benjamin
|b 127
700 1 _ |a Meyer, Kristin
|b 128
700 1 _ |a Mihai, Paul
|b 129
700 1 _ |a Mitsis, Georgios
|b 130
700 1 _ |a Moll, Jorge
|b 131
700 1 _ |a Nielson, Dylan
|b 132
700 1 _ |a Nilsonne, Gustav
|b 133
700 1 _ |a Notter, Michael
|b 134
700 1 _ |a Olivetti, Emanuele
|b 135
700 1 _ |a Onicas, Adrian
|b 136
700 1 _ |a Papale, Paolo
|b 137
700 1 _ |0 P:(DE-Juel1)172843
|a Patil, Kaustubh
|b 138
700 1 _ |a Peelle, Jonathan E.
|b 139
700 1 _ |a Pérez, Alexandre
|b 140
700 1 _ |a Pischedda, Doris
|b 141
700 1 _ |a Poline, Jean-Baptiste
|b 142
700 1 _ |a Prystauka, Yanina
|b 143
700 1 _ |a Ray, Shruti
|b 144
700 1 _ |a Reuter-Lorenz, Patricia
|b 145
700 1 _ |a Reynolds, Richard
|b 146
700 1 _ |a Ricciardi, Emiliano
|b 147
700 1 _ |a Rieck, Jenny
|b 148
700 1 _ |a Rodriguez-Thompson, Anais
|b 149
700 1 _ |a Romyn, Anthony
|b 150
700 1 _ |a Salo, Taylor
|b 151
700 1 _ |a Samanez-Larkin, Gregory
|b 152
700 1 _ |a Sanz-Morales, Emilio
|b 153
700 1 _ |a Schlichting, Margaret
|b 154
700 1 _ |a Schultz, Douglas
|b 155
700 1 _ |a Shen, Qiang
|b 156
700 1 _ |a Sheridan, Margaret
|b 157
700 1 _ |a Shiguang, Fu
|b 158
700 1 _ |a Silvers, Jennifer
|b 159
700 1 _ |a Skagerlund, Kenny
|b 160
700 1 _ |a Smith, Alec
|b 161
700 1 _ |a Smith, David
|b 162
700 1 _ |a Sokol-Hessner, Peter
|b 163
700 1 _ |0 P:(DE-Juel1)171320
|a Steinkamp, Simon
|b 164
|u fzj
700 1 _ |a Tashjian, Sarah
|b 165
700 1 _ |a Thirion, Bertrand
|b 166
700 1 _ |a Thorp, John
|b 167
700 1 _ |a Tinghög, Gustav
|b 168
700 1 _ |a Tisdall, Loreen
|b 169
700 1 _ |a Tompson, Steven
|b 170
700 1 _ |a Toro-Serey, Claudio
|b 171
700 1 _ |a Torre, Juan
|b 172
700 1 _ |a Tozzi, Leonardo
|b 173
700 1 _ |a Truong, Vuong
|b 174
700 1 _ |a Turella, Luca
|b 175
700 1 _ |a van’t Veer, Anna E.
|b 176
700 1 _ |a Verguts, Tom
|b 177
700 1 _ |a Vettel, Jean
|b 178
700 1 _ |a Vijayarajah, Sagana
|b 179
700 1 _ |a Vo, Khoi
|b 180
700 1 _ |a Wall, Matthew
|b 181
700 1 _ |a Weeda, Wouter D.
|b 182
700 1 _ |0 P:(DE-Juel1)172811
|a Weis, Susanne
|b 183
700 1 _ |a White, David
|b 184
700 1 _ |a Wisniewski, David
|b 185
700 1 _ |a Xifra-Porxas, Alba
|b 186
700 1 _ |a Yearling, Emily
|b 187
700 1 _ |a Yoon, Sangsuk
|b 188
700 1 _ |a Yuan, Rui
|b 189
700 1 _ |a Yuen, Kenneth
|b 190
700 1 _ |a Zhang, Lei
|b 191
700 1 _ |a Zhang, Xu
|b 192
700 1 _ |a Zosky, Joshua
|b 193
700 1 _ |0 0000-0002-4516-5103
|a Nichols, Thomas E.
|b 194
|e Corresponding author
700 1 _ |0 0000-0001-6755-0259
|a Poldrack, Russell A.
|b 195
|e Corresponding author
700 1 _ |0 0000-0002-4485-816X
|a Schonberg, Tom
|b 196
|e Corresponding author
773 _ _ |0 PERI:(DE-600)1413423-8
|a 10.1038/s41586-020-2314-9
|p 84–88
|t Nature
|v 582
|x 0028-0836
|y 2020
856 4 _ |u https://juser.fz-juelich.de/record/875461/files/RotemBotvinik20.pdf
|y Restricted
|z StatID:(DE-HGF)0599
856 4 _ |u https://juser.fz-juelich.de/record/875461/files/author_accepted_manuscript.pdf
|y OpenAccess
|z StatID:(DE-HGF)0510
856 4 _ |u https://juser.fz-juelich.de/record/875461/files/author_accepted_manuscript_supp.pdf
|y Restricted
|z StatID:(DE-HGF)0599
856 4 _ |u https://juser.fz-juelich.de/record/875461/files/RotemBotvinik20.pdf?subformat=pdfa
|x pdfa
|y Restricted
|z StatID:(DE-HGF)0599
856 4 _ |u https://juser.fz-juelich.de/record/875461/files/author_accepted_manuscript_supp.pdf?subformat=pdfa
|x pdfa
|y Restricted
|z StatID:(DE-HGF)0599
909 C O |o oai:juser.fz-juelich.de:875461
|p openaire
|p open_access
|p VDB
|p driver
|p dnbdelivery
910 1 _ |0 I:(DE-588b)5008462-8
|6 P:(DE-Juel1)172024
|a Forschungszentrum Jülich
|b 31
|k FZJ
910 1 _ |0 I:(DE-588b)5008462-8
|6 P:(DE-Juel1)131855
|a Forschungszentrum Jülich
|b 34
|k FZJ
910 1 _ |0 I:(DE-588b)5008462-8
|6 P:(DE-Juel1)131678
|a Forschungszentrum Jülich
|b 54
|k FZJ
910 1 _ |0 I:(DE-588b)5008462-8
|6 P:(DE-Juel1)161225
|a Forschungszentrum Jülich
|b 60
|k FZJ
910 1 _ |0 I:(DE-588b)5008462-8
|6 P:(DE-Juel1)131684
|a Forschungszentrum Jülich
|b 80
|k FZJ
910 1 _ |0 I:(DE-588b)5008462-8
|6 P:(DE-Juel1)131693
|a Forschungszentrum Jülich
|b 105
|k FZJ
910 1 _ |0 I:(DE-588b)5008462-8
|6 P:(DE-Juel1)172843
|a Forschungszentrum Jülich
|b 138
|k FZJ
910 1 _ |0 I:(DE-588b)5008462-8
|6 P:(DE-Juel1)171320
|a Forschungszentrum Jülich
|b 164
|k FZJ
910 1 _ |0 I:(DE-588b)5008462-8
|6 P:(DE-Juel1)172811
|a Forschungszentrum Jülich
|b 183
|k FZJ
913 1 _ |0 G:(DE-HGF)POF3-574
|1 G:(DE-HGF)POF3-570
|2 G:(DE-HGF)POF3-500
|3 G:(DE-HGF)POF3
|4 G:(DE-HGF)POF
|a DE-HGF
|b Key Technologies
|l Decoding the Human Brain
|v Theory, modelling and simulation
|x 0
914 1 _ |y 2020
915 _ _ |0 StatID:(DE-HGF)0150
|2 StatID
|a DBCoverage
|b Web of Science Core Collection
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)0600
|2 StatID
|a DBCoverage
|b Ebsco Academic Search
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)1040
|2 StatID
|a DBCoverage
|b Zoological Record
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)1200
|2 StatID
|a DBCoverage
|b Chemical Reactions
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)1060
|2 StatID
|a DBCoverage
|b Current Contents - Agriculture, Biology and Environmental Sciences
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)1030
|2 StatID
|a DBCoverage
|b Current Contents - Life Sciences
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)0110
|2 StatID
|a WoS
|b Science Citation Index
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)0111
|2 StatID
|a WoS
|b Science Citation Index Expanded
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)0420
|2 StatID
|a Nationallizenz
|d 2020-01-12
|w ger
915 _ _ |0 StatID:(DE-HGF)1150
|2 StatID
|a DBCoverage
|b Current Contents - Physical, Chemical and Earth Sciences
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)0310
|2 StatID
|a DBCoverage
|b NCBI Molecular Biology Database
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)9940
|2 StatID
|a IF >= 40
|b NATURE : 2018
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)0199
|2 StatID
|a DBCoverage
|b Clarivate Analytics Master Journal List
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)0200
|2 StatID
|a DBCoverage
|b SCOPUS
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)1050
|2 StatID
|a DBCoverage
|b BIOSIS Previews
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)0100
|2 StatID
|a JCR
|b NATURE : 2018
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)1210
|2 StatID
|a DBCoverage
|b Index Chemicus
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)0510
|2 StatID
|a OpenAccess
915 _ _ |0 StatID:(DE-HGF)0300
|2 StatID
|a DBCoverage
|b Medline
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)1190
|2 StatID
|a DBCoverage
|b Biological Abstracts
|d 2020-01-12
915 _ _ |0 LIC:(DE-HGF)CCBY4
|2 HGFVOC
|a Creative Commons Attribution CC BY 4.0
915 _ _ |0 StatID:(DE-HGF)0030
|2 StatID
|a Peer Review
|b ASC
|d 2020-01-12
915 _ _ |0 StatID:(DE-HGF)0160
|2 StatID
|a DBCoverage
|b Essential Science Indicators
|d 2020-01-12
920 _ _ |l yes
920 1 _ |0 I:(DE-Juel1)INM-7-20090406
|k INM-7
|l Gehirn & Verhalten
|x 0
920 1 _ |0 I:(DE-Juel1)INM-3-20090406
|k INM-3
|l Kognitive Neurowissenschaften
|x 1
980 _ _ |a journal
980 _ _ |a VDB
980 _ _ |a UNRESTRICTED
980 _ _ |a I:(DE-Juel1)INM-7-20090406
980 _ _ |a I:(DE-Juel1)INM-3-20090406
980 _ _ |a OPENSCIENCE
980 1 _ |a FullTexts


LibraryCollectionCLSMajorCLSMinorLanguageAuthor
Marc 21