guest ::
| Home > Publications database > Equivariant Representation Learning for Augmentation-based Self-Supervised Learning via Image Reconstruction |
| Home > Publications database > Equivariant Representation Learning for Augmentation-based Self-Supervised Learning via Image Reconstruction |
| Preprint | FZJ-2025-00072 |
; ;
2024
arXiv
This record in other databases:
Please use a persistent id in citations: doi:10.48550/arXiv.2412.03314 doi:10.34734/FZJ-2025-00072
Abstract: Augmentation-based self-supervised learning methods have shown remarkable success in self-supervised visual representation learning, excelling in learning invariant features but often neglecting equivariant ones. This limitation reduces the generalizability of foundation models, particularly for downstream tasks requiring equivariance. We propose integrating an image reconstruction task as an auxiliary component in augmentation-based self-supervised learning algorithms to facilitate equivariant feature learning without additional parameters. Our method implements a cross-attention mechanism to blend features learned from two augmented views, subsequently reconstructing one of them. This approach is adaptable to various datasets and augmented-pair based learning methods. We evaluate its effectiveness on learning equivariant features through multiple linear regression tasks and downstream applications on both artificial (3DIEBench) and natural (ImageNet) datasets. Results consistently demonstrate significant improvements over standard augmentation-based self-supervised learning methods and state-of-the-art approaches, particularly excelling in scenarios involving combined augmentations. Our method enhances the learning of both invariant and equivariant features, leading to more robust and generalizable visual representations for computer vision tasks.
Keyword(s): Computer Vision and Pattern Recognition (cs.CV) ; FOS: Computer and information sciences
|
The record appears in these collections: |
PDF