Computer vision

Detection, segmentation, depth and recognition research, plus the vision backbones that keep displacing the last generation.

3,429 stories · RSS feed

arXiv Computer Vision
Aug 25

Three-Phase Scribble-Adaptive Curriculum Learning for autoPETV Grand Challenge

The paper presents Libo Zhang’s algorithmic solution for the autoPETV Grand Challenge, focusing on interactive lesion segmentation in whole-body PET/CT scans. The method encodes user scribbles as two additional input channels and trains a large residual‑encoder U‑Net (≈140 M parameters) through a three‑phase curriculum over 4000 epochs, progressively moving from fully automatic segmentation to handling user‑provided scribbles and finally correcting its own mistakes via simulated error‑driven steps. Using 1811 studies for training and an ensemble of five‑fold checkpoints, the approach achieves a mean AUC‑Dice of 3.836 and a mean AUC‑DMM of 3.869 in interactive five‑fold cross‑validation, with significant gains from the first corrective scribble.

By Libo Zhang
arXiv Computer Vision
Aug 25

Topology of a Smile: Persistent Homology in Dental Imaging

The article presents a method that uses persistent homology and a support vector machine to automatically classify teeth and diagnose pathologies in CBCT scans. It reports high accuracy, achieving 97.67% for tooth labeling and 96.77% for diagnostics, surpassing a CNN baseline. The approach aims to reduce the labor-intensive analysis of detailed 3‑D dental images.

By Leon Dahlmeier, Sara Kali\v{s}nik, Albert Mehl, Bastian Rieck
arXiv Computer Vision
Aug 25

Where Not to Learn: Prior-Aligned Training with Subset-based Attribution Constraints

arXiv:2602.07008v5 Announce Type: replace Abstract: Reliable models should not only predict correctly, but also base their decisions on acceptable evidence. However, conventional supervised learning...

By Ruoyu Chen, Shangquan Sun, Xiaoqing Guo, Kangwei Liu, Sanyi Zhang, Zhangcheng Wang, Shiming Liu, Qunli Zhang, Wei Wang, Hua Zhang, Xiaochun Cao
arXiv AI
Aug 25

Hyperbolic Hierarchical Clustering for Visual Representation Learning

The paper introduces ClusterMixer, a token mixer based on hierarchical clustering in hyperbolic space, designed to be transparent and interpretable. It forms the core of a new vision backbone called HCFormer, which incorporates multiple clustering strategies to maintain strong performance. Experiments show HCFormer surpasses existing backbones on tasks such as image classification, object detection, instance segmentation, and semantic segmentation.

By Jianan Wei, Guikun Chen, Zhiyuan Weng, Chunchao Guo, Yujia Wang, Wenguan Wang
arXiv AI
Aug 25

SAS: Segment Anything Small for Ultrasound -- A Non-Generative Data Augmentation Technique for Robust Deep Learning in Ultrasound Imaging

The paper introduces Segment Anything Small (SAS), a data‑augmentation method that improves deep‑learning segmentation of small anatomical structures in ultrasound images. SAS uses two transformations: resizing and embedding organ thumbnails into a black background to vary organ scale, and adding noise to regions of interest to mimic tissue texture variability. Experiments on one internal and five external datasets show Dice score gains up to 0.35, with an average improvement of 0.16, and demonstrate that SAS enhances model robustness and generalizability without adding hallucinations or artifacts.

By Danielle L. Ferreira, Ahana Gangopadhyay, Hsi-Ming Chang, Ravi Soni, Gopal Avinash
arXiv AI
Aug 25

Vision-Language Models for Occupational Physical Exposure Assessment: Estimating External Hand Forces in Manual Material Handling Tasks from RGB Video

The study presents a vision‑language model pipeline that estimates dynamic, triaxial, bilateral external hand forces during manual material handling tasks using only RGB video and known box mass. By combining text‑guided ROI localization, pretrained vision‑transformer features, and transformer‑based temporal regression, the model achieved root mean square errors of about 4.7–5.6 N for horizontal and mediolateral forces and 10.6–11.0 N for vertical forces across various camera setups. The approach demonstrated that including the handled object as a second ROI and using multi‑camera capture improved peak‑force estimation, showing the feasibility of sensor‑free force estimation for occupational exposure assessment.

By Mohammad Sadra Rajabi, Aanuoluwapo Ojelade, Sunwook Kim, Maury A. Nussbaum
arXiv Computer Vision
Aug 25

VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding

arXiv:2607.14935v2 Announce Type: replace Abstract: Recent advances in video understanding have spanned motion, long video, and streaming interaction, driving this field toward real-world application...

By Xinhao Li, Yuhan Zhu, Xiangyu Zeng, Yuhao Dong, Haoning Wu, Zhiqiu Zhang, Yuandong Yang, Changlian Ma, Qingyu Zhang, Yansong Shi, Xinyu Chen, Haoran Chen, Zizheng Huang, Jun Zhang, Kun Ouyang, Lin Sui, Ziang Yan, Yicheng Xu, Chenting Wang, Yinan He, Hongjie Zhang, Yi Wang, Yu Qiao, Yali Wang, Ziwei Liu, Kai Chen, Limin Wang
arXiv Computer Vision
Aug 25

Retrieval-Augmented Visual Prompting: Guiding Foundation Models in Two-Photon Imaging

arXiv:2608.21970v1 Announce Type: new Abstract: Two-photon calcium imaging presents a challenging setting for foundation models: image appearance varies substantially across recordings and experiment...

By Salvatore Calcagno, Marco Finocchiaro, Giovanni Bellitto, Daniela Giordano, Concetto Spampinato, Federica Proietto Salanitri
arXiv Computer Vision
Aug 25

AnaDiffusion: Anatomically CompositionalLatent Diffusion for Controllable 3D Brain MRI Generation

arXiv:2608.23014v1 Announce Type: new Abstract: 3D brain MRI generation has made significant advances in medical imaging, simulation, and controllable anatomical analysis. However, existing generativ...

By Huiwen Han, Lulin Liu, Bangya Liu, Yuanhao Cai, Nuo Chen, Xiaoqing Wang, Ziqian Xie, Chenyu You, Shuiwang Ji, Degui Zhi, Zhiwen Fan