Poster (After Call) FZJ-2026-03284

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
muBRAND: Multi-Branch Diffusion for Flexible Generation and Inpainting of Image Series

 ;  ;  ;

2026

Helmholtz AI Conference 2026, HAICON26, MünchenMünchen, Germany, 8 Jun 2026 - 11 Jun 20262026-06-082026-06-11

Abstract: We introduce a unified diffusion model framework, muBRAND, for performing slice interpolation, cross-domain style transfer and damage repair in ordered image sequences such as serial sections, z-slices and temporal frames.The proposed architecture connects multiple generator branches to a shared contextual encoder. A multi-neighbor cross attention mechanism conditions each prediction on a predefined context of adjacent and distal slices of the same sequence.The framework provides a unified approach to address various restoration and translation tasks without per-task pretraining while handling arbitrary inter-slice spacings.We evaluate the framework on serial stacks of whole human brain sections imaged with a brightfield microscope; which are characterized by complex artifacts, missing sections, and interleaved stainings inducing strong style shifts between consecutive slices.Compared to task-specific baselines on image inpainting and style transfer, muBRAND improves reconstruction quality and plausibly imputes fully missing slices using context from both nearby and farther slices.To assess stack coherence beyond pixel fidelity, we introduce structure and biology oriented metrics that quantify continuity and morphological consistency of biological objects alongside standard generative metrics.


Contributing Institute(s):
  1. Strukturelle und funktionelle Organisation des Gehirns (INM-1)
Research Program(s):
  1. 5254 - Neuroscientific Data Analytics and AI (POF4-525) (POF4-525)
  2. Helmholtz AI - Helmholtz Artificial Intelligence Coordination Unit – Local Unit FZJ (E.40401.62) (E.40401.62)
  3. EBRAINS 2.0 - EBRAINS 2.0: A Research Infrastructure to Advance Neuroscience and Brain Health (101147319) (101147319)
  4. HIBALL - Helmholtz International BigBrain Analytics and Learning Laboratory (HIBALL) (InterLabs-0015) (InterLabs-0015)
  5. X-BRAIN (ZT-I-PF-4-061) (ZT-I-PF-4-061)
  6. JL SMHB - Joint Lab Supercomputing and Modeling for the Human Brain (JL SMHB-2021-2027) (JL SMHB-2021-2027)

Appears in the scientific report 2026
Click to display QR Code for this record

The record appears in these collections:
Document types > Presentations > Poster
Institute Collections > INM > INM-1
Workflow collections > Public records
Workflow collections > In process
Online First

 Record created 2026-07-02, last modified 2026-07-08


External link:
Download fulltext
Fulltext
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)