Computer vision

Detection, segmentation, depth and recognition research, plus the vision backbones that keep displacing the last generation.

3,429 stories · RSS feed

arXiv AI
Sep 2

ViTAMINS: An Empirical Study of Training Self-Supervised Vision Transformers with Synthetic Hard Negatives

ViTAMINS is a method that incorporates synthetic hard negatives into unsupervised vision transformer pretraining to enhance representation quality. The approach is evaluated on ImageNet and a range of downstream tasks—including transfer learning, image retrieval, copy detection, and image/video segmentation—showing significant performance gains. The synthetic negatives also lead to emergent properties, such as representations that encode explicit semantic information and act as strong classifiers, improving over baselines by up to 11.3%.

By Nikos Giakoumoglou, Andreas Floros, Kleanthis-Marios Papadopoulos, Tania Stathaki
arXiv AI
Sep 2

Taming Modality Entanglement in Continual Audio-Visual Segmentation

The paper introduces a new Continual Audio‑Visual Segmentation (CAVS) task that enables continuous segmentation of new classes guided by audio. It identifies two key challenges—multi‑modal semantic drift and co‑occurrence confusion—and proposes a Collision‑based Multi‑modal Rehearsal (CMR) framework with Multi‑modal Sample Selection (MSS) and Collision‑based Sample Rehearsal (CSR) strategies to address them. Experiments on three audio‑visual incremental scenarios show that CMR outperforms single‑modal continual learning methods.

By Yuyang Hong, Qi Yang, Tao Zhang, Zili Wang, Zhaojin Fu, Kun Ding, Bin Fan, Shiming Xiang
arXiv AI
Sep 2

Vision-Language-Guided Pseudo-Labels for Unsupervised Domain Adaptation in Semantic Segmentation for Waste Sorting

The paper introduces a cross‑modal pseudo‑labeling pipeline for unsupervised domain adaptation in semantic segmentation, particularly for waste sorting. It combines SAM for class‑agnostic region proposals with EVA‑CLIP to assign semantic labels via region‑text similarity, applying confidence filtering to ensure reliable pseudo‑labels for self‑training. An optional BLIP‑based language‑grounded verification further refines ambiguous regions, and the method shows consistent improvements over source‑only baselines on synthetic‑to‑real driving and lab‑to‑factory waste sorting shifts.

By Udo Schlegel, Shubhangi, Gabriel Dax, Sai Rahul Kaminwar, Florian Karl, Thomas Seidl
arXiv Computer Vision
Sep 2

Online camera-pose-free stereo endoscopic tissue deformation recovery with tissue-invariant vision-biomechanics consistency

The paper presents a camera‑pose‑free stereo endoscopic method for recovering tissue deformation by modeling geometry as a 3D point‑derivative map and deformation as a 3D displacement‑local deformation map. It optimizes inter‑frame deformation in a camera‑centric setting, eliminating the need for camera pose estimation, and introduces a canonical map for online geometry and deformation optimization. Experiments on in‑vivo and ex‑vivo laparoscopic data show accurate 3D reconstruction (≈0.37–0.39 mm surface distance) even under occlusion, and the method can estimate surface strain distributions during manipulation.

By Jiahe Chen, Naoki Tomii, Ichiro Sakuma, Etsuko Kobayashi
arXiv Computer Vision
Sep 2

Pix2Rep-v2: Data-Efficient Representation Learning for Dense Medical Imaging Applications

Pix2Rep-v2 is a self‑supervised learning framework that learns pixel‑ and voxel‑level representations for dense medical imaging tasks, using a redundancy‑reduction objective and equivariance principles to scale to 3D and wide field‑of‑view data. The method is evaluated on four datasets across multiple modalities, tasks, and backbones, demonstrating higher data‑efficiency in few‑shot scenarios and competitive performance, such as a +9.3 Dice point improvement in one‑shot segmentation on the M&Ms‑2 dataset. An in‑context dense prototype approach is also proposed, eliminating the need for downstream training.

By S. Sifaoui, E. Angelini, S. Toupin, T. Pezel, L. Le Folgoc
arXiv AI
Sep 2

FLaG: Frequency-Domain Latent-attention Gated Pooling for Token Aggregation

FLaG (Frequency‑Domain Latent‑attention Gated Pooling) is a plug‑in token‑aggregation module that transforms encoder outputs into the Fourier domain, summarizes spectral tokens with learnable latent queries, applies a sample‑conditioned channel gate, and reconstructs modulated token representations for downstream pooling. The method is evaluated on antimicrobial peptide activity prediction, CIFAR‑10/100 image classification, and several RoBERTa language tasks, achieving state‑of‑the‑art performance on most metrics. Analyses show that FLaG emphasizes low‑frequency components while selectively amplifying high‑frequency signals in later layers, providing a transferable frequency‑domain bias across protein, visual, and textual representations.

By Kewei Li, Rongying Zhang, Xueli Wang, Xiwen Gong, Zhongjian Wang, Qiuchen Zhao, Lan Huang, Ruochi Zhang, Fengfeng Zhou
arXiv Computer Vision
Sep 2

Instance-Guided Report Anchoring for Text-Free 3D Abnormality Segmentation in Chest CT

Instance-Guided Report Anchoring (IGRA) is a model-agnostic module that links each abnormality instance in a chest CT to the corresponding finding in a radiology report during training, while discarding text components at inference. By reformulating free-text grounding as multi-label volumetric segmentation, IGRA allows all abnormality categories to be predicted in a single image-only forward pass. The method improves Dice scores by 22.5% over the strongest image-only baseline and matches state‑of‑the‑art performance on single-finding subsets, with consistent gains across multiple 3D segmentation backbones and datasets.

By Zhenyu Bu, Haoyan Ding, Chushu Shen, Xinyuan Zheng, Peiyu Duan, Xueqi Guo, Sepehr Farhand, Yoshihisa Shinagawa, Gerardo Hermosillo, Chaowei Wu
arXiv Computer Vision
Sep 2

Scale-based Approach for Active Wildfire Segmentation on Satellite Imagery

The paper proposes a data-driven protocol that uses multispectral Landsat‑8 imagery and connected‑component analysis to characterize fire‑region size distributions for active wildfire segmentation. Three segmentation architectures—U‑Net, DeepLabV3+, and SegFormer—are evaluated under different SWIR‑based spectral configurations, with U‑Net showing the strongest robustness and SWIR2 consistently delivering the best results. The study highlights the importance of both spectral band selection and architectural design for robust satellite‑based active wildfire mapping, especially when training on low fire‑pixel density images.

By Matheus F. Kovaleski, Cristiano Premebida, Jo\~ao Ruivo Paulo
arXiv Computer Vision
Sep 2

Expert-like Bone Ultrasound Segmentation through Expert-in-the-loop Mask-conditioned Progressive Learning

The paper introduces ExiL, a mask‑conditioned progressive learning framework for bone ultrasound segmentation that models annotation as a structured refinement trajectory. ExiL uses a synthetic expert‑like brush simulator and a lightweight U‑Net to learn from imperfect masks, and it can be updated in real time from expert refinements. In experiments on UltraBones100k and a prospective volunteer dataset, ExiL cut average annotation time from 60 to 20 seconds per frame and improved mean Dice by about 0.045, achieving 0.87 Dice and 2.7 px boundary error with 10–50 ms inference.

By Arash Tavangar, Larissa K. Chiu, Hamidreza Khodashenas, Gregory K. Berry, Amir Hooshiar
arXiv AI
Sep 2

GazeRefine: Expert Gaze as a Test-Time Prompt for Training-Free Medical Image Segmentation

GazeRefine is a training‑free framework that uses eye‑gaze data as an inference‑time prompt for zero‑shot medical image segmentation. It converts sparse, duration‑weighted fixations into foreground and background priors that initialize semantic prototypes in a frozen DINOv3 feature space, then iteratively refines these prototypes through discrimination, affinity propagation, and anchoring to the gaze guidance. The method achieves strong results on colonoscopy polyp segmentation and competitive performance on prostate MRI, demonstrating that gaze‑guided prototype refinement can enable segmentation without dense expert annotations or model fine‑tuning.

By Mohammed Oussama Benyahia, Marouane Tliba, Mohamed Amine Kerkouri, Taifour Yousra, Bin Wang, Max Bengtsson, Gorkem Durak, Elif Keles, Zuheng Ming, Marek Penhaker, Azeddine Beghdadi, Ulas Bagci, Aladine Chetouani
arXiv Computer Vision
Sep 2

RingMoClaw: An Experience-Inspired Multi-Agent Framework for Self-Evolving Research in Remote Sensing

arXiv:2609.00814v1 Announce Type: new Abstract: Remote sensing visual models have continuously advanced various interpretation tasks. However, the research process behind model improvement still heav...

By Kaiyue Kang, Qixuan He, Peijin Wang, Yingchao Feng, Chao Ren, Kangxin Wang, Wenhui Diao, Yixiao Wang, Liangjin Zhao, Kaiwen Wei, Nayu Liu, Xian Sun