Computer vision

Detection, segmentation, depth and recognition research, plus the vision backbones that keep displacing the last generation.

3,429 stories · RSS feed

arXiv Computer Vision
Aug 26

Comparative Assessment of Deep Learning Architectures for Underwater Subsurface Kelp Forest Segmentation with The Kelp-o-Tron

arXiv:2608.24594v1 Announce Type: new Abstract: Submerged kelp forests are vital coastal ecosystems that support marine biodiversity and ecosystem dynamics, yet accurate underwater kelp segmentation...

By Sundarabalan Balasubramanian, C\'esar Borja, Ana C. Murillo, Lexi N. Wilkes, Meredith L. McPherson, Kira A. Krumhansl, Jennifer A. Dijkstra, Jarrett E. K. Byrnes
arXiv Computer Vision
Aug 26

TLNM: Externally Validated Tooth Detection, Numbering and Segmentation from Smartphone Photographs Using Mask R-CNN

The paper presents TLNM, a Mask R‑CNN based system that detects, numbers, and segments teeth in smartphone photographs. It incorporates a masked gray‑world white‑balancing step and an anatomically constrained detection layer to handle patient‑generated variability. Evaluated on internal and external datasets, the model achieved high AP50, PQ, and F1 scores, demonstrating robust performance across diverse populations and imaging conditions.

By Arash Nedaei, Henna Tiensuu, Elina V\"ayrynen, Saujanya Karki, Jaakko Suutala
arXiv Computer Vision
Aug 26

Model Effect or Label Effect? Refined Annotations and a Human-Referenced Benchmark for Pulmonary Embolism Segmentation

The study investigates how refined annotations versus model training changes affect pulmonary embolism segmentation performance. By re‑annotating 149 CT pulmonary angiography cases and evaluating two pretrained nnU-Net models, the authors find that improving annotation quality increases the Dice similarity coefficient (DSC) by 0.143–0.188, far exceeding the 0.028 DSC change from altering training datasets. A new human‑referenced benchmark model (nnPE) was trained and publicly released, though it performed below all annotators in paired comparisons.

By Qihang Sun, Zhongxiao Liu, Bailiang Jian, Shenman Qiu, Jingyuan Wang, Lei Zhang, Lixiang Xie, Jiazhen Pan, Christian Wachinger
arXiv Computer Vision
Aug 26

Representation Learning in Diffusion and Flow-based Model: An Application Aspect

The article surveys how diffusion and flow-based generative models learn rich visual representations and how these representations can be used to improve generation and other perception tasks. It introduces a three-tier framework that categorizes work into improving generative quality via representation learning, extracting representations for perception, and developing unified applications. The survey covers downstream tasks such as image classification, dense prediction, instance-level perception, and annotation-scarce scenarios, offering a taxonomy and highlighting future research directions.

By Yanchen Xu, Sida Huang, Zhenyu Gu, Ruishu Zhu, Yilan Gao, Hongyuan Zhang
arXiv Computer Vision
Aug 26

Primate vision reveals a missing principle for robust dynamic AI

The study investigates how intelligent visual systems integrate object appearance with motion while maintaining robustness to appearance changes. By comparing human perception, macaque inferior temporal cortex activity, and various neural network models, the authors find that temporal integration enhances object representations, yet most video models fail to generalize when appearance varies. Predictive world models show the best cross‑appearance generalization and neural fidelity, though none fully replicate the cortical shift from appearance‑dominated to motion‑invariant coding.

By Matteo Dunnhofer, Christian Micheloni, Kohitij Kar
arXiv AI
Aug 26

LUCAID: Agentic Multimodal AI for Lung Cancer Precision Pathology

LUCAID is an agentic multimodal AI system designed for precision lung cancer pathology, integrating nine modules that cover the entire routine workflow—from quality control and tumor detection to histological subtyping, microenvironment profiling, cellularity quantification, and biomarker scoring (PD‑L1, MET, TROP‑2). The system generates automated structured reports and allows interactive querying of module outputs. In prospective clinical validation, LUCAID achieved 93.0% concordance with an expert‑panel reference standard for clinically actionable decisions, outperforming five experienced thoracic pathologists who ranged from 68.3% to 81.1% concordance.

By Marie-Lisa Eich, Kai Standvoss, Timo Milbich, Alexander M\"ollers, Miriam H\"agele, Philipp Anders, Lars Tharun, Hanna Kontradiuk, Sebastian Kons, Nader Aldoj, Recepcan Adig\"uzel, Adam Narai, Lukas H\"onig, Jonathan Striebel, Binru Yang, Mihnea P. Dragomir, Marvin Sextro, Philipp Keyl, Philipp Jurmeister, Rosemarie Krupar, Evelyn Ramberger, James Wells, Julika Ribbat-Idel, Andreas Kunft, Hussam Shuaib, Christian Groh\'e, Reinhard B\"uttner, David Horst, Klaus-Robert M\"uller, Lukas Ruff, Maximilian Alber, Frederick Klauschen, Simon Schallenberg