Computer vision

Detection, segmentation, depth and recognition research, plus the vision backbones that keep displacing the last generation.

3,429 stories · RSS feed

arXiv AI
Aug 26

CytoNet: A Foundation Model for the Human Cerebral Cortex at Cellular Resolution

CytoNet is a foundation model trained on 1 million unlabeled microscopic image patches from over 4,000 histological sections of nine postmortem brains, and evaluated on 2,000 sections from five additional brains. By using co‑localization in the cortical sheet for self‑supervision, it learns expressive, anatomically meaningful feature representations that enable downstream tasks such as area classification, laminar segmentation, microarchitectural quantification, and exploratory mapping of cortical subdivisions. Functional parcellation analyses demonstrate links between cytoarchitecture and macroscale functional organization, establishing CytoNet as a unified framework for scalable analysis of cortical microarchitecture and its relationship to structure‑function organization in the human cerebral cortex.

By Christian Schiffer, Zeynep Boztoprak, Jan-Oliver Kropp, Julia Th\"onni{\ss}en, Katia Berr, Hannah Spitzer, Mathis Bode, Thomas Lippert, Katrin Amunts, Timo Dickscheid
arXiv AI
Aug 26

Screening Autism Spectrum Disorder in children using Deep Learning Approach : Evaluating the classification model of YOLOv26s by comparing with other models

arXiv:2306.14300v2 Announce Type: replace-cross Abstract: Autism spectrum disorder (ASD) is a developmental condition that presents significant challenges in social interac- tion, communication, and...

By Subash Gautam, Sagar Pathak, Prabin Sharma, Bidhya Shrestha, Kisan Thapa, Shubham Joshi, Mala Deep Upadhaya, Dikshya Thapa, Chandiprasad Chintalapati, Sagar Duwal, Angela Upreti, Salik Ram Khanal
arXiv AI
Aug 26

Fuzzy Segmentations of a String

The article addresses a specific data clustering problem: identifying groups of adjacent text segments of a suitable length that match a fuzzy pattern defined by a sequence of fuzzy properties. It proposes a heuristic algorithm that uses a prefix structure to efficiently map text segments to fuzzy properties, and proves that for the special case of unit-length segments (fuzzy string matching), the algorithm finds all matching segments. Additionally, it presents a dynamic programming approach to determine the best segmentation of an entire text based on a fuzzy pattern.

By Armen Kostanyan, Arevik Harmandayan
arXiv AI
Aug 26

Rethinking Pre-Training and Augmentation for Zero-Shot Cross-City Object Detection

The paper proposes a modular training pipeline for zero‑shot cross‑city object detection that combines a multi‑dataset pre‑training strategy with class‑agnostic objectness distillation and a domain‑resilient augmentation stream featuring a Grayworld transformation. Applied to the RF‑DETR detector, the approach reduces cross‑city distribution gaps while using only 16 GB GPU memory, achieving a 24.29‑point mAP improvement and 1st place on the AI City Challenge Track 6 leaderboard. The authors provide code and data at the referenced GitHub repository.

By Long Hoang Pham, Quoc Pham-Nam Ho, Huy-Hung Nguyen, Duong Nguyen-Ngoc Tran, Ngoc Doan-Minh Huynh, Cu Quoc Le, Hoang-Khang Nguyen, Hyung-Min Jeon, Chi Dai Tran, Son Hong Phan, Duong Khac Vu, Trinh Le Ba Khanh, Jae Wook Jeon
arXiv AI
Aug 26

What Guides the Agent? Adjudicating Unauthorized Behavior via Localizing Behavior-Guiding Instructions

The paper introduces Attnlocate, a runtime framework that localizes behavior‑guiding instructions within the attention matrix of large language model agents. By treating this localization as an object detection task, Attnlocate uses a multi‑head, multi‑layer attention aggregation scheme and a 1‑D U‑Net to identify spans that influence tool‑calling decisions. The system then adjudicates potential malicious invocations based on the authority of the source, achieving high detection metrics across diverse LLM families and demonstrating transferability to unseen models.

By Yichao Gao, Yumo Zhang, Yunhao Yao, Haohua Du, Puhan Luo, Ruiqi Li, Zhiqiang Wang
arXiv AI
Aug 26

PhysMLLMs: Spatial Priors for Unified Referring Segmentation and Grounded Reasoning of Images and Videos

PhysMLLMs introduces physics-inspired spatial continuity priors into video multimodal large language models to address spatio‑temporal inconsistencies such as jitter, drift, and identity switches. The method, called Global Representation Prior Alignment (REPA‑Global), distills global visual representations from a frozen DINOv2 teacher during training, aligning student representations without affecting inference speed. Experiments on multiple video benchmarks show improved segmentation mask quality and cross‑frame consistency, especially for challenging scenarios involving small targets, fast motion, occlusion, and distractors, while maintaining comparable performance on single‑frame image segmentation and general VLM tasks.

By Siyao Yan, Bo Han, Jisheng Dang, Bimei Wang, Shude Wang, Hong Peng, Yulan Guo, Jianhuang Lai, Bin Hu, Tat-SengChua
arXiv AI
Aug 26

A survey detection channel overrides the pixels in an astronomical foundation model, and biases tomographic mean redshifts

The study audits the AION-1 foundation model, a 39‑modality transformer trained on over 200 million astronomical objects, and finds that its reliance on a survey detection channel—specifically the segmentation map—introduces a severe systematic bias. By keeping image tokens unchanged and editing only the segmentation map, all model outputs (flux, size, ellipticity, redshift) shift by factors of 110–4400 compared to a placebo, revealing that the model’s predictions are driven more by detection gating than by the actual light distribution. This bias propagates into cosmological analyses, shifting tomographic mean redshifts by a median 0.71 × the LSST DESC requirement and exceeding it in multiple assignments, while removing the detection channel eliminates the effect without measurable cost. whyItMatters":"The bias in the detection channel directly inflates errors in key astronomical measurements, potentially compromising the precision of cosmological studies that rely on accurate redshift estimates."

By Ihor Kendiukhov
arXiv Computer Vision
Aug 26

Segmentation-Guided Homography Estimation for Long-Term Planar Tracking

The paper introduces SAM‑H, a planar object tracker that estimates 8‑degree‑of‑freedom homographies directly from segmentation mask contours using a training‑free pipeline. When applied to masks from SAM 2, SAM‑H achieves a new state‑of‑the‑art performance on the PlanarTrack benchmark, improving the p@5 metric by 18.4 percentage points. The authors also demonstrate that combining segmentation‑based and correspondence‑based homography estimation yields WOFTSAM, which surpasses all previous methods on both PlanarTrack and POT‑210, and provide precise re‑annotations of PlanarTrack initial poses for more accurate benchmarking.

By Jonas Serych, Jiri Matas
arXiv Computer Vision
Aug 26

The Geometric Observability Index: Influence, Fisher Information, and Weak Observability in SE(3) Pose Estimation

The paper introduces the Geometric Observability Index (GOI), a per-feature sensitivity metric for SE(3) pose estimation that quantifies the pose perturbation induced by a single measurement via the Gauss‑Newton curvature restricted to the observable subspace. GOI is shown to equal the norm of the M‑estimator influence function, to coincide with the Fisher information operator, and its smallest observable eigenvalue determines both worst‑case measurement amplification and a finite‑sample stability radius. Experiments on synthetic data and real RGB‑D/KITTI sequences validate that GOI accurately predicts leave‑one‑out pose shifts and explains the robustness of residual gating while highlighting the pitfalls of raw‑influence gating in weakly observable geometries.

By Joe-Mei Feng, Hsin-Hsiung Kao, Sheng-Wei Yu
arXiv Computer Vision
Aug 26

ConsensusTAS: Self-Supervised Temporal Action Segmentation for Long-Horizon Construction Videos

ConsensusTAS is a self‑supervised, label‑free method for temporal action segmentation in long construction videos. It segments continuous video streams into distinct activity phases by leveraging internal consensus among candidate segmentations, and it has been evaluated on three public datasets, outperforming state‑of‑the‑art methods. In real‑world construction footage, the model successfully identified fine‑grained actions within bricklaying, and it can run on a CPU, making it suitable for mobile robotic platforms.

By Xiaoshan Zhou, Yafei Sun
arXiv Computer Vision
Aug 26

crossMoDA Challenge: Evolution of Cross-Modality Domain Adaptation Techniques for Vestibular Schwannoma and Cochlea Segmentation from 2021 to 2023

arXiv:2506.12006v4 Announce Type: replace-cross Abstract: The cross-Modality Domain Adaptation (crossMoDA) challenge series, initiated in 2021 in conjunction with the International Conference on Medi...

By Navodini Wijethilake, Reuben Dorent, Marina Ivory, Aaron Kujawa, Stefan Cornelissen, Patrick Langenhuizen, Mohamed Okasha, Anna Oviedova, Hexin Dong, Bogyeong Kang, Guillaume Sall\'e, Luyi Han, Ziyuan Zhao, Han Liu, Yubo Fan, Tao Yang, Shahad Hardan, Hussain Alasmawi, Santosh Sanjeev, Yuzhou Zhuang, Satoshi Kondo, Maria Baldeon Calisto, Shaikh Muhammad Uzair Noman, Cancan Chen, Ipek Oguz, Rongguo Zhang, Mina Rezaei, Susana K. Lai-Yuen, Satoshi Kasai, Yunzhi Huang, Chih-Cheng Hung, Mohammad Yaqub, Lisheng Wang, Benoit M. Dawant, Cuntai Guan, Ritse Mann, Vincent Jaouen, Tae-Eui Kam, Li Zhang, Jonathan Shapey, Tom Vercauteren