guest ::
| Home > Publications database > A too-good-to-be-true prior to reduce shortcut reliance > print |
| 001 | 1024830 | ||
| 005 | 20250203103155.0 | ||
| 024 | 7 | _ | |a 10.1016/j.patrec.2022.12.010 |2 doi |
| 024 | 7 | _ | |a 0167-8655 |2 ISSN |
| 024 | 7 | _ | |a 1872-7344 |2 ISSN |
| 024 | 7 | _ | |a 10.34734/FZJ-2024-02496 |2 datacite_doi |
| 024 | 7 | _ | |a 37915616 |2 pmid |
| 024 | 7 | _ | |a WOS:000935348300001 |2 WOS |
| 037 | _ | _ | |a FZJ-2024-02496 |
| 082 | _ | _ | |a 004 |
| 100 | 1 | _ | |a Dagaev, Nikolay |0 P:(DE-HGF)0 |b 0 |
| 245 | _ | _ | |a A too-good-to-be-true prior to reduce shortcut reliance |
| 260 | _ | _ | |a Amsterdam [u.a.] |c 2023 |b Elsevier |
| 336 | 7 | _ | |a article |2 DRIVER |
| 336 | 7 | _ | |a Output Types/Journal article |2 DataCite |
| 336 | 7 | _ | |a Journal Article |b journal |m journal |0 PUB:(DE-HGF)16 |s 1712669802_18043 |2 PUB:(DE-HGF) |
| 336 | 7 | _ | |a ARTICLE |2 BibTeX |
| 336 | 7 | _ | |a JOURNAL_ARTICLE |2 ORCID |
| 336 | 7 | _ | |a Journal Article |0 0 |2 EndNote |
| 520 | _ | _ | |a Despite their impressive performance in object recognition and other tasks under standard testing conditions, deep networks often fail to generalize to out-of-distribution (o.o.d.) samples. One cause for this shortcoming is that modern architectures tend to rely on ǣshortcutsǥ superficial features that correlate with categories without capturing deeper invariants that hold across contexts. Real-world concepts often possess a complex structure that can vary superficially across contexts, which can make the most intuitive and promising solutions in one context not generalize to others. One potential way to improve o.o.d. generalization is to assume simple solutions are unlikely to be valid across contexts and avoid them, which we refer to as the too-good-to-be-true prior. A low-capacity network (LCN) with a shallow architecture should only be able to learn surface relationships, including shortcuts. We find that LCNs can serve as shortcut detectors. Furthermore, an LCN’s predictions can be used in a two-stage approach to encourage a high-capacity network (HCN) to rely on deeper invariant features that should generalize broadly. In particular, items that the LCN can master are downweighted when training the HCN. Using a modified version of the CIFAR-10 dataset in which we introduced shortcuts, we found that the two-stage LCN-HCN approach reduced reliance on shortcuts and facilitated o.o.d. generalization. |
| 536 | _ | _ | |a 5251 - Multilevel Brain Organization and Variability (POF4-525) |0 G:(DE-HGF)POF4-5251 |c POF4-525 |f POF IV |x 0 |
| 536 | _ | _ | |a 5254 - Neuroscientific Data Analytics and AI (POF4-525) |0 G:(DE-HGF)POF4-5254 |c POF4-525 |f POF IV |x 1 |
| 588 | _ | _ | |a Dataset connected to CrossRef, Journals: juser.fz-juelich.de |
| 700 | 1 | _ | |a Roads, Brett D. |0 P:(DE-HGF)0 |b 1 |
| 700 | 1 | _ | |a Luo, Xiaoliang |0 P:(DE-HGF)0 |b 2 |
| 700 | 1 | _ | |a Barry, Daniel N. |0 P:(DE-HGF)0 |b 3 |
| 700 | 1 | _ | |a Patil, Kaustubh R. |0 P:(DE-Juel1)172843 |b 4 |
| 700 | 1 | _ | |a Love, Bradley C. |0 P:(DE-HGF)0 |b 5 |e Corresponding author |
| 773 | _ | _ | |a 10.1016/j.patrec.2022.12.010 |g Vol. 166, p. 164 - 171 |0 PERI:(DE-600)1466342-9 |p 164 - 171 |t Pattern recognition letters |v 166 |y 2023 |x 0167-8655 |
| 856 | 4 | _ | |u https://www.sciencedirect.com/science/article/pii/S0167865522003841?via%3Dihub |
| 856 | 4 | _ | |u https://juser.fz-juelich.de/record/1024830/files/1-s2.0-S0167865522003841-main-1.pdf |y OpenAccess |
| 856 | 4 | _ | |u https://juser.fz-juelich.de/record/1024830/files/1-s2.0-S0167865522003841-main-1.gif?subformat=icon |x icon |y OpenAccess |
| 856 | 4 | _ | |u https://juser.fz-juelich.de/record/1024830/files/1-s2.0-S0167865522003841-main-1.jpg?subformat=icon-1440 |x icon-1440 |y OpenAccess |
| 856 | 4 | _ | |u https://juser.fz-juelich.de/record/1024830/files/1-s2.0-S0167865522003841-main-1.jpg?subformat=icon-180 |x icon-180 |y OpenAccess |
| 856 | 4 | _ | |u https://juser.fz-juelich.de/record/1024830/files/1-s2.0-S0167865522003841-main-1.jpg?subformat=icon-640 |x icon-640 |y OpenAccess |
| 909 | C | O | |o oai:juser.fz-juelich.de:1024830 |p openaire |p open_access |p VDB |p driver |p dnbdelivery |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 4 |6 P:(DE-Juel1)172843 |
| 910 | 1 | _ | |a HHU Düsseldorf |0 I:(DE-HGF)0 |b 4 |6 P:(DE-Juel1)172843 |
| 910 | 1 | _ | |a Department of Experimental Psychology, University College London, London, United Kingdom |0 I:(DE-HGF)0 |b 5 |6 P:(DE-HGF)0 |
| 913 | 1 | _ | |a DE-HGF |b Key Technologies |l Natural, Artificial and Cognitive Information Processing |1 G:(DE-HGF)POF4-520 |0 G:(DE-HGF)POF4-525 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-500 |4 G:(DE-HGF)POF |v Decoding Brain Organization and Dysfunction |9 G:(DE-HGF)POF4-5251 |x 0 |
| 913 | 1 | _ | |a DE-HGF |b Key Technologies |l Natural, Artificial and Cognitive Information Processing |1 G:(DE-HGF)POF4-520 |0 G:(DE-HGF)POF4-525 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-500 |4 G:(DE-HGF)POF |v Decoding Brain Organization and Dysfunction |9 G:(DE-HGF)POF4-5254 |x 1 |
| 914 | 1 | _ | |y 2024 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0200 |2 StatID |b SCOPUS |d 2023-08-22 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0160 |2 StatID |b Essential Science Indicators |d 2023-08-22 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)1160 |2 StatID |b Current Contents - Engineering, Computing and Technology |d 2023-08-22 |
| 915 | _ | _ | |a Creative Commons Attribution CC BY 4.0 |0 LIC:(DE-HGF)CCBY4 |2 HGFVOC |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0600 |2 StatID |b Ebsco Academic Search |d 2023-08-22 |
| 915 | _ | _ | |a JCR |0 StatID:(DE-HGF)0100 |2 StatID |b PATTERN RECOGN LETT : 2022 |d 2023-08-22 |
| 915 | _ | _ | |a WoS |0 StatID:(DE-HGF)0113 |2 StatID |b Science Citation Index Expanded |d 2023-08-22 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0150 |2 StatID |b Web of Science Core Collection |d 2023-08-22 |
| 915 | _ | _ | |a OpenAccess |0 StatID:(DE-HGF)0510 |2 StatID |
| 915 | _ | _ | |a Peer Review |0 StatID:(DE-HGF)0030 |2 StatID |b ASC |d 2023-08-22 |
| 915 | _ | _ | |a IF >= 5 |0 StatID:(DE-HGF)9905 |2 StatID |b PATTERN RECOGN LETT : 2022 |d 2023-08-22 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0300 |2 StatID |b Medline |d 2023-08-22 |
| 915 | _ | _ | |a Nationallizenz |0 StatID:(DE-HGF)0420 |2 StatID |d 2023-08-22 |w ger |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0199 |2 StatID |b Clarivate Analytics Master Journal List |d 2023-08-22 |
| 920 | 1 | _ | |0 I:(DE-Juel1)INM-7-20090406 |k INM-7 |l Gehirn & Verhalten |x 0 |
| 980 | _ | _ | |a journal |
| 980 | _ | _ | |a VDB |
| 980 | _ | _ | |a UNRESTRICTED |
| 980 | _ | _ | |a I:(DE-Juel1)INM-7-20090406 |
| 980 | 1 | _ | |a FullTexts |
| Library | Collection | CLSMajor | CLSMinor | Language | Author |
|---|