arXiv:2610.07903v1 Announce Type: new
Abstract: Adapting vision-language models to downstream tasks has achieved remarkable success by leveraging pseudo-labels generated from unlabeled data. Existing...
By Keliang Chen, Yaxin Hou, Hui Liu, Yuheng Jia
Self-supervision is a powerful technique for learning visual representations from unlabeled data. Existing techniques primarily adopt a two-stage approach for self-supervised learning (SSL): a pretraining stage on unlabeled data followed by a finetuning stage on labeled data.
The paper investigates whether pretrained language models can act as lightweight auxiliary supervision for supervised vision training, without requiring paired image-text data or complex objectives. Two forms of language guidance—Explicit Language Guidance (ExLG) and Implicit Language Guidance (ImLG)—are evaluated across six generalization regimes, including in‑distribution, out‑of‑distribution, shortcut resistance, texture/shape bias, adversarial robustness, and continual learning. Results show that ExLG improves in‑distribution, low‑data performance, and continual learning retention, while ImLG is more effective in shortcut‑sensitive and adversarial settings, and both add minimal parameters and training overhead.
By Shruthi Gowda, Nikita Jain, Elahe Arani, Bahram Zonooz
arXiv:2606. 31603v1 Announce Type: cross Abstract: Semantic segmentation models struggle with data sparsity and rare or visually diverse regions, e.
By Nikolai R\"ohrich, Julian Glei{\ss}ner, Ahmed H. A. Ibrahim, Silvan Mertes, Tobias Huber
arXiv:2505.07675v3 Announce Type: replace-cross
Abstract: Semi-supervised learning (SSL) has emerged as a practical solution for addressing data scarcity challenges by leveraging unlabeled data. Rece...
By Seongjae Kang, Dong Bok Lee, Hyungjoon Jang, Sung Ju Hwang
arXiv:2507.22075v2 Announce Type: replace
Abstract: In unsupervised adaptation for vision-language models such as CLIP, pseudo-labels derived from zero-shot predictions often exhibit significant nois...
By Eman Ali, Chetan Arora, Muhammad Haris Khan
arXiv:2601. 22108v2 Announce Type: replace-cross Abstract: Continued pretraining is optimized with fixed self-supervised tasks but selected by downstream performance, creating a coarse feedback loop in which practitioners evaluate checkpoints, change data mixtures or objectives, and restart runs, while individual updates remain blind to target capabilities.
By Shuqi Ke, Giulia Fanti
arXiv:2407.03463v2 Announce Type: replace-cross
Abstract: In the realm of self-supervised learning (SSL), conventional wisdom has gravitated towards the utility of massive, general domain datasets fo...
By Jes\'us M Rodr\'iguez-de-Vera, Imanol G Estepa, Ignacio Saras\'ua, Bhalaji Nagarajan, Petia Radeva
arXiv:2508.21424v3 Announce Type: replace
Abstract: Deep learning models have achieved state-of-the-art performance in many computer vision tasks. However, in real-world scenarios, novel classes that...
By Lucas Rakotoarivony
arXiv:2610.07008v1 Announce Type: new
Abstract: Few-shot class-incremental learning (FSCIL) aims to learn novel classes from limited annotations while preserving prior knowledge. Existing methods typ...
By Junhui Yin, Yuchen Yang, Yilin Yin, Shuai Na, Haoran Xi, Jianhua Yang, Muyi Sun, Man Zhang, Shengfeng He
JEPAMatch introduces a new semi‑supervised learning framework that replaces traditional output‑thresholding with explicit geometric shaping of latent representations. By combining the FlexMatch loss with a latent‑space regularization inspired by LeJEPA, the method encourages isotropic Gaussian structure in the embedding space, mitigating class imbalance and noisy pseudo‑labels. Experiments on CIFAR‑100, STL‑10, and Tiny‑ImageNet show consistent performance gains and faster convergence compared to existing FixMatch‑based baselines.
By Ali Aghababaei-Harandi, Aude Sportisse, Massih-Reza Amini
arXiv:2607. 28967v1 Announce Type: cross Abstract: Prompt tuning adapts vision--language models with few trainable parameters, but existing approaches trade off efficiency and adaptation: static textual prompts can overfit source classes, image-conditioned prompts add per-instance computation, and multimodal tuning modifies the visual branch.
By Pouya Parsa, Raoof Zare Moayedi, Seongjin Choi