Contribution to a conference proceedings FZJ-2024-06751

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Self-Supervised Learning with Generative Adversarial Networks for Electron Microscopy

 ;  ;

2024
IEEE

2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), SeattleSeattle, WA, 17 Jun 2024 - 18 Jun 20242024-06-172024-06-18 IEEE 71-81 () [10.1109/CVPRW63382.2024.00012]

This record in other databases:  

Please use a persistent id in citations: doi:  doi:

Abstract: In this work, we explore the potential of self-supervised learning with Generative Adversarial Networks (GANs) for electron microscopy datasets. We show how self-supervised pretraining facilitates efficient fine-tuning for a spectrum of downstream tasks, including semantic segmentation, denoising, noise & background removal, and super-resolution. Experimentation with varying model complexities and receptive field sizes reveals the remarkable phenomenon that fine-tuned models of lower complexity consistently outperform more complex models with random weight initialization. We demonstrate the versatility of self-supervised pretraining across various downstream tasks in the context of electron microscopy, allowing faster convergence and better performance. We conclude that self-supervised pretraining serves as a powerful catalyst, being especially advantageous when limited annotated data are available and efficient scaling of computational cost is important.


Contributing Institute(s):
  1. Materials Data Science and Informatics (IAS-9)
Research Program(s):
  1. 5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511) (POF4-511)

Appears in the scientific report 2024
Database coverage:
OpenAccess
Click to display QR Code for this record

The record appears in these collections:
Document types > Events > Contributions to a conference proceedings
Institute Collections > IAS > IAS-9
Workflow collections > Public records
Publications database
Open Access

 Record created 2024-12-05, last modified 2025-03-10


OpenAccess:
Download fulltext PDF
External link:
Download fulltextFulltext
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)