Preprint FZJ-2024-01952

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Denoising Diffusion Probabilistic Models for Image Inpainting of Cell Distributions in the Human Brain

 ;  ;  ;

2023
arXiv

arXiv () [10.48550/arXiv.2311.16821]

This record in other databases:

Please use a persistent id in citations: doi:  doi:  doi:

Abstract: Recent advances in imaging and high-performance computing have made it possible to image the entire human brain at the cellular level. This is the basis to study the multi-scale architecture of the brain regarding its subdivision into brain areas and nuclei, cortical layers, columns, and cell clusters down to single cell morphology Methods for brain mapping and cell segmentation exploit such images to enable rapid and automated analysis of cytoarchitecture and cell distribution in complete series of histological sections. However, the presence of inevitable processing artifacts in the image data caused by missing sections, tears in the tissue, or staining variations remains the primary reason for gaps in the resulting image data. To this end we aim to provide a model that can fill in missing information in a reliable way, following the true cell distribution at different scales. Inspired by the recent success in image generation, we propose a denoising diffusion probabilistic model (DDPM), trained on light-microscopic scans of cell-body stained sections. We extend this model with the RePaint method to impute missing or replace corrupted image data. We show that our trained DDPM is able to generate highly realistic image information for this purpose, generating plausible cell statistics and cytoarchitectonic patterns. We validate its outputs using two established downstream task models trained on the same data.

Keyword(s): Image and Video Processing (eess.IV) ; Computer Vision and Pattern Recognition (cs.CV) ; FOS: Electrical engineering, electronic engineering, information engineering ; FOS: Computer and information sciences


Contributing Institute(s):
  1. Strukturelle und funktionelle Organisation des Gehirns (INM-1)
Research Program(s):
  1. 5254 - Neuroscientific Data Analytics and AI (POF4-525) (POF4-525)
  2. HIBALL - Helmholtz International BigBrain Analytics and Learning Laboratory (HIBALL) (InterLabs-0015) (InterLabs-0015)
  3. Helmholtz AI - Helmholtz Artificial Intelligence Coordination Unit – Local Unit FZJ (E.40401.62) (E.40401.62)
  4. DFG project 313856816 - SPP 2041: Computational Connectomics (313856816) (313856816)

Appears in the scientific report 2024
Database coverage:
OpenAccess
Click to display QR Code for this record

The record appears in these collections:
Institute Collections > INM > INM-1
Document types > Reports > Preprints
Workflow collections > Public records
Publications database
Open Access

 Record created 2024-03-15, last modified 2025-02-03


OpenAccess:
Download fulltext PDF
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)