| Hauptseite > Publikationsdatenbank > Data Fusion for Scene Graph Generation: Bridging Simulated and Real-World Datasets > print |
| 001 | 1046025 | ||
| 005 | 20251124202414.0 | ||
| 024 | 7 | _ | |a 10.34734/FZJ-2025-03665 |2 datacite_doi |
| 037 | _ | _ | |a FZJ-2025-03665 |
| 041 | _ | _ | |a English |
| 100 | 1 | _ | |a Kromm, Edward |0 P:(DE-Juel1)208654 |b 0 |e Corresponding author |
| 245 | _ | _ | |a Data Fusion for Scene Graph Generation: Bridging Simulated and Real-World Datasets |f 2025-03-11 - 2025-10-11 |
| 260 | _ | _ | |a Jülich |c 2025 |
| 300 | _ | _ | |a 102 pages: Figures, Tables |
| 336 | 7 | _ | |a Output Types/Supervised Student Publication |2 DataCite |
| 336 | 7 | _ | |a Thesis |0 2 |2 EndNote |
| 336 | 7 | _ | |a MASTERSTHESIS |2 BibTeX |
| 336 | 7 | _ | |a masterThesis |2 DRIVER |
| 336 | 7 | _ | |a Master Thesis |b master |m master |0 PUB:(DE-HGF)19 |s 1763984777_15509 |2 PUB:(DE-HGF) |
| 336 | 7 | _ | |a SUPERVISED_STUDENT_PUBLICATION |2 ORCID |
| 502 | _ | _ | |a Masterarbeit, Hochschule Coburg, 2025 |c Hochschule Coburg |b Masterarbeit |d 2025 |o 2025-10-11 |
| 520 | _ | _ | |a Scene graph generation has emerged as a powerful tool for AI-driven visual understandingof images by not only detecting objects in an image but also predicting the relationshipsbetween them, such as car–stops at–traffic light or pedestrian–crosses–street. This capabilityis particularly important for autonomous driving, where relational context between roadusers and infrastructure plays a critical role. However, the application of scene graphgeneration in this domain is hindered by the scarcity of annotated datasets. Drivingsimulators such as CARLA provide a scalable alternative, enabling efficient data generationcompared to manual annotation. Yet models trained exclusively on simulated data oftenfail to generalize to real-world data due to the substantial domain gap between the two.This thesis addresses this challenge by proposing a novel data fusion framework thatcombines simulated and real datasets to construct autonomous driving–specific relationshipannotations and subsequently bridge the domain gap for real-world prediction. The workpresents the complete pipeline, including dataset generation in simulation, adaptationof publicly available resources, and augmentation strategies. The Relation Transformermodel is analyzed in depth, and particular attention is given to interpreting its internalmechanisms by visualizing the learned attention maps as heatmaps. This analysis providesinsights into whether the model focuses on semantically meaningful regions when predictingrelationships. Building on this understanding, two new approaches are introduced to enableinference on real data while transferring relational knowledge acquired in simulation. Anablation study further quantifies the impact of the domain gap on model performance andhighlights the strengths and limitations of the proposed methods. Results demonstratethat one of the developed approaches effectively mitigates the simulation-to-reality gapand concrete suggestions for advancing this technique toward further uses for AI-drivenvisual understanding of images in the automotive context are provided. |
| 536 | _ | _ | |a 5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511) |0 G:(DE-HGF)POF4-5112 |c POF4-511 |f POF IV |x 0 |
| 536 | _ | _ | |a nxtAIM - nxtAIM – NXT GEN AI Methods (19A23014l) |0 G:(BMWK)19A23014l |c 19A23014l |x 1 |
| 700 | 1 | _ | |a Benassou, Sabrina |0 P:(DE-Juel1)192312 |b 1 |e Thesis advisor |
| 700 | 1 | _ | |a Kesselheim, Stefan |0 P:(DE-Juel1)185654 |b 2 |e Thesis advisor |
| 856 | 4 | _ | |u https://juser.fz-juelich.de/record/1046025/files/Master%20Thesis.pdf |y OpenAccess |
| 909 | C | O | |o oai:juser.fz-juelich.de:1046025 |p openaire |p open_access |p VDB |p driver |p dnbdelivery |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 0 |6 P:(DE-Juel1)208654 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 1 |6 P:(DE-Juel1)192312 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 2 |6 P:(DE-Juel1)185654 |
| 913 | 1 | _ | |a DE-HGF |b Key Technologies |l Engineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action |1 G:(DE-HGF)POF4-510 |0 G:(DE-HGF)POF4-511 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-500 |4 G:(DE-HGF)POF |v Enabling Computational- & Data-Intensive Science and Engineering |9 G:(DE-HGF)POF4-5112 |x 0 |
| 914 | 1 | _ | |y 2025 |
| 915 | _ | _ | |a OpenAccess |0 StatID:(DE-HGF)0510 |2 StatID |
| 920 | _ | _ | |l yes |
| 920 | 1 | _ | |0 I:(DE-Juel1)JSC-20090406 |k JSC |l Jülich Supercomputing Center |x 0 |
| 980 | _ | _ | |a master |
| 980 | _ | _ | |a VDB |
| 980 | _ | _ | |a UNRESTRICTED |
| 980 | _ | _ | |a I:(DE-Juel1)JSC-20090406 |
| 980 | 1 | _ | |a FullTexts |
| Library | Collection | CLSMajor | CLSMinor | Language | Author |
|---|