arXiv Computer Vision
Dataset-Level Regularization for Joint-Embedding Self-Supervised Learning
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
Hugging Face Trending Papers
Oct 14
Dataset-Level Regularization for Joint-Embedding Self-Supervised Learning
Self-supervised joint embedding learning aligns representations of augmented views while regularizing their distribution to prevent collapse. Regularization aims to shape the overall representation di...
arXiv Machine Learning
Jul 23
IConE: Batch Independent Collapse Prevention for Self-Supervised Representation Learning
arXiv:2603. 15263v2 Announce Type: replace-cross Abstract: Self-supervised learning (SSL) has revolutionized representation learning, with Joint-Embedding Architectures (JEAs) emerging as an effective approach for capturing semantic features.
arXiv AI
Oct 9
Discovering Global False Negatives On the Fly for Self-supervised Contrastive Learning
The paper introduces GloFND, an optimization-based method that learns a threshold for each anchor image during training to automatically detect false negative pairs in self-supervised contrastive learning. Unlike prior approaches that only consider false negatives within a mini-batch, GloFND globally identifies them across the entire dataset while keeping per-iteration computation independent of dataset size. Experiments on image and image-text data show the method’s effectiveness, and the implementation is publicly available.
arXiv AI
Aug 20
Learning-State-Aware Dynamic Generative Data Augmentation on Small-Scale Datasets
Learning-State-Aware Dynamic Generative Data Augmentation on Small-Scale Datasets proposes LSADA, a method that constructs a learning state for each sample based on its loss and loss‑decrease rate to determine a sample‑specific augmentation strength. LSADA also introduces a decoupled data augmentation and diffusion fusion strategy that applies strength‑controlled transformations to class‑relevant regions while generating diverse class‑irrelevant regions, progressively fusing them to enhance image diversity while preserving class semantics. Experiments on nine public datasets demonstrate that LSADA outperforms the current state‑of‑the‑art dynamic GDA method by an average of 4.5% on six natural image datasets and 2.5% on three medical image datasets.
arXiv AI
Aug 11
Three Necessary Principles for Self-Supervised Visual Representation Learning
arXiv:2608. 08309v1 Announce Type: cross Abstract: We argue that learning visual representations without labels requires a training signal jointly complete across three non-overlapping objectives: semantic invariance across augmented views, patch-level spatial prediction, and representational non-degeneracy.
arXiv AI
Oct 9
From Pixels, Without Pre-training: Joint Generative and Self-Supervised Representation Learning in One Model
The paper introduces SCION, a single-model framework that jointly learns generative and self‑supervised representation tasks without relying on labels or pretrained encoders. SCION uses a pixel‑space encoder conditioned on a flow timestep and a shared embedding, training contrastive and flow‑matching objectives simultaneously with gradient‑norm balancing and stop‑gradient techniques. On ImageNet 256×256, SCION achieves state‑of‑the‑art FID scores (8.92 with JiT‑B and 5.89/3.47 with JiT‑L) surpassing prior class‑unconditional and pretrained‑conditioned methods.