Poster (After Call) FZJ-2024-06480

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Towards Decoding Fiber Architecture in the Human Brain Using Deep Learning

 ;  ;  ;

2024

INM Retreat 2024, JülichJülich, Germany, 19 Nov 2024 - 20 Nov 20242024-11-192024-11-20

Abstract: Analyzing the structural organization of the human brain involves the study of nerve fibers that connect neurons or whole brain regions. Characterizing the arrangement of these anatomical connections, also known as fiber architecture, contributes to a better understanding of how the brain processes information. Three-dimensional Polarized Light Imaging (3D-PLI) allows the visualization of these short- and long-range single nerve fibers and fiber bundles, providing detailed images of fiber organization at the microscopic level. However, analyzing and interpreting the large amounts of complex data is a time-consuming task that requires expert knowledge and a lot of computational power, making manual engineering difficult and leading us to use a data-driven approach to automatically learn descriptive features of nerve fibers.<br><br>Previous work has demonstrated the ability of deep learning methods in identifying characteristics of nerve fibers in the vervet monkey brain, such as boundaries between gray and white matter and specific U-fibers. Building upon these promising results, our present study extends this research to focus on the adult human brain.<br><br>We train a deep neural network to map high-resolution image patches extracted from 3D-PLI sections to feature vectors that encode the fiber architectonic properties encoded in the patch. Exploiting the fact that spatially close locations in the brain tend to share architectonic properties, we train the neural network using a contrastive learning objective that promotes the mapping of spatially close image patches to similar feature representations. The model is trained on 30.000 patches (size 2048x2048 px at 2.66 px/m) from 26 3D-PLI sections. Learned features are then analyzed by visualizing their corresponding U-MAP embeddings in 2D.<br><br>Our analysis shows that features from patches sampled from different sections tend to cluster based on section number rather than architectural similarity. In particular, features of patches from distant sections are also distant in feature space, suggesting that the network captures section-specific features rather than the underlying brain architecture. We hypothesize that this effect is due to the uneven distribution of the available PLI-scanned sections in certain parts of the brain (non-isotropic), which affects the spatial consistency of the data. As we do not observe clustering that reflects anatomical features, suggesting that the current model fails to capture these structural properties, future work will address this challenge by exploring data augmentation techniques to introduce variability and counteract differences between sections and sampling strategies. These approaches aim to encourage the network to focus on architectural features of the brain rather than section-specific features.


Contributing Institute(s):
  1. Strukturelle und funktionelle Organisation des Gehirns (INM-1)
Research Program(s):
  1. 5251 - Multilevel Brain Organization and Variability (POF4-525) (POF4-525)
  2. 5254 - Neuroscientific Data Analytics and AI (POF4-525) (POF4-525)
  3. X-BRAIN (ZT-I-PF-4-061) (ZT-I-PF-4-061)
  4. HIBALL - Helmholtz International BigBrain Analytics and Learning Laboratory (HIBALL) (InterLabs-0015) (InterLabs-0015)
  5. Helmholtz AI - Helmholtz Artificial Intelligence Coordination Unit – Local Unit FZJ (E.40401.62) (E.40401.62)

Appears in the scientific report 2024
Click to display QR Code for this record

The record appears in these collections:
Document types > Presentations > Poster
Institute Collections > INM > INM-1
Workflow collections > Public records
Publications database

 Record created 2024-11-26, last modified 2024-12-13



Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)