Contribution to a conference proceedings FZJ-2025-03672

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Leveraging Vision Transformers with Hyperparameter Optimization for the Classification of Acute Respiratory Distress Syndrome

 ;  ;  ;  ;  ;  ;

2025
IEEE

2025 MIPRO 48th ICT and Electronics Convention, MIPRO2025, OpatijaOpatija, Croatia, 2 Jun 2025 - 6 Jun 20252025-06-022025-06-06 IEEE 1293-1298 () [10.1109/MIPRO65660.2025.11131920]

This record in other databases:  

Please use a persistent id in citations: doi:

Abstract: Acute respiratory distress syndrome (ARDS) is a serious lung condition associated with a high mortality rate. The classification of this condition poses a challenge in intensive care medicine and diagnostic imaging. Artificial intelligence methods, particularly deep learning, can assist the diagnostic process. Recent advances have demonstrated the potential of vision transformers to improve image analysis through their ability to extract relevant features and complex patterns in images. In this study, a vision transformer is implemented for classifying ARDS in chest X-Rays using a two-step transfer learning approach. For this purpose, publicly available databases of X-rays are used, some of which have been annotated by a radiologist for the use case ARDS. Furthermore, in order to uncover the optimal combination of model parameters to streamline the training process, we implement a two-tier hyperparameter optimization using the Ray Tune framework on high-performance computing infrastructure. The retrained vision transformer was able to classify ARDS data with 95% accuracy, outperforming previous approaches employing residual networks. Our results highlight the improvement that can be achieved through a two-step transfer learning approach leveraging vision transformers and taking advantage of powerful supercomputing architecture. Ultimately, our work facilitates timely and accurate classification of ARDS thereby enabling improved outcomes for patients receiving critical care.


Contributing Institute(s):
  1. Jülich Supercomputing Center (JSC)
Research Program(s):
  1. 5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511) (POF4-511)
  2. 5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511) (POF4-511)
  3. SDI-S - SDI-S: Smart Data Innovation Services - Experimentelle Erprobung und Entwicklung von KI-Dienstverbünden für Innovationen auf industriellen Daten (01IS22095D) (01IS22095D)

Appears in the scientific report 2025
Click to display QR Code for this record

The record appears in these collections:
Dokumenttypen > Ereignisse > Beiträge zu Proceedings
Workflowsammlungen > Öffentliche Einträge
Institutssammlungen > JSC
Publikationsdatenbank

 Datensatz erzeugt am 2025-09-08, letzte Änderung am 2025-11-27


Restricted:
Volltext herunterladen PDF
Dieses Dokument bewerten:

Rate this document:
1
2
3
 
(Bisher nicht rezensiert)