Computer vision

Detection, segmentation, depth and recognition research, plus the vision backbones that keep displacing the last generation.

3,379 stories · RSS feed

arXiv Machine Learning
Sep 21

Purification and Regulation: Comorbidity-Aware Multi-Label Few-Shot Learning for Medical Image Classification

The paper introduces Prototype Purification and Regulation (PPR), a multi‑label few‑shot learning framework for medical image classification that addresses two key limitations of existing metric‑based meta‑learning methods. PPR first purifies prototypes by using sample‑level comorbidity scores to highlight disease‑specific features, then regulates inter‑class prototype distances with disease‑level comorbidity statistics to create a comorbidity‑aware embedding space. Experiments on four chest X‑ray datasets, including cross‑domain tests, show that PPR outperforms state‑of‑the‑art methods, improving disease detection and demonstrating robust generalization and clinical applicability.

By Ying-Chih Lin, Po-Chih Kuo, Yong-Sheng Chen
arXiv Computer Vision
Sep 21

Catena: A Comprehensive Software Suite for Large-Scale Connectomics

Catena is an open‑source, developer‑centric software suite designed to streamline large‑scale connectomics from electron microscopy data. It integrates modules for 3D neuron and organelle segmentation, synapse detection, microtubule tracking, and neurotransmitter inference into composable, chunk‑wise pipelines that are fully documented and extensible. The suite includes pretrained machine learning models, containerized runtimes, and shareable components to reduce compute and ground‑truth data needs while ensuring reproducible, scalable processing across workstations and clusters.

By Samia Mohinta, Pedro G\'omez-G\'alvez, Shi Yan Lee, Daniel Franco-Barranco, Michael Clayton, Stephan Preibisch, Jan Funke, Albert Cardona
arXiv Computer Vision
Sep 21

PointLAM: Local Attentive Mamba for Efficient Point-based 3D Object Detection

PointLAM introduces a new point-based 3D object detection architecture that addresses efficiency and fidelity trade-offs inherent in LiDAR point cloud processing. It employs a Laplacian Point Sampler (LPS) to accelerate downsampling while preserving foreground structure, and a Local Hadamard Aggregator (LHA) that replaces costly continuous interactions with a topology‑aware gating mechanism. Combined with Bi‑Directional Mamba layers, the resulting Local Attentive Mamba (LAM) block delivers competitive performance on nuScenes and Waymo datasets, outperforming voxel‑based competitors in detecting small objects and handling extreme sparsity with a smaller computational footprint.

By Xuanming Shang, Weijia Zhang, Chao Ma
arXiv Computer Vision
Sep 21

SFVO: Decoupled Confidence-Guided Stereo-Flow Visual Odometry with Bidirectional PnP

SFVO is a stereo visual‑odometry framework that leverages pretrained stereo‑matching and optical‑flow models to obtain dense stereo and temporal correspondences. Rather than learning pose directly from images, it maps these correspondences into geometric constraints and predicts trustworthy points using decoupled confidence maps for rotation and translation. Experiments on both outdoor and indoor datasets show that SFVO delivers robust, accurate pose estimation with strong generalization, and the authors plan to release the code.

By Kai Zhang, Guoyang Zhao, Jun Ma
arXiv Computer Vision
Sep 21

Combining Object Detection with Geometry-Aware Clustering to Distinguish Overlapping Plants in UAV Imagery

The paper introduces a geometry‑aware post‑detection framework that resolves overlapping plant instances in RGB UAV imagery by combining object detection with geometric clustering of plant components. It uses component centroids and radial intersection points (RIPs) to determine whether a detected region contains one or two plants, applying K‑means or Gaussian mixture models and density filtering to improve clustering accuracy. Evaluated on eggplant and tomato crops, the method achieved high F1‑scores (0.89 for eggplant, 0.75 for tomato) and demonstrated that geometric reasoning can enhance plant‑level interpretation without requiring additional sensors or retraining.

By Ik Jae Lee, Hieu D. Nguyen, Mahbubur Meenar, Carlos Morrison Martinez, Cameron Connelly
arXiv Computer Vision
Sep 21

Multi-viewpoint Geo-localization with Event Cameras

The paper presents MegaEvent, an event‑based visual place recognition system that remains robust to viewpoint changes. By converting five large‑scale geo‑tagged datasets into synthetic event streams and fine‑tuning a vision transformer with a multi‑loss function, MegaEvent achieves an average Recall@1 of 82% on three event‑based localization datasets, outperforming existing methods by 20 recall points. The authors also introduce the Springfield‑Event‑VPR dataset, a 3.7 km walking route recorded in three camera orientations, where MegaEvent surpasses the strongest baseline by 9 recall points.

By Adam D. Hines, Michael Milford, Tobias Fischer
arXiv Computer Vision
Sep 21

XCalib Depth-Guided Geometric Optimization for Dense Thermal-Visible Video Registration

XCalib is an unsupervised dense registration framework that aligns thermal and visible video streams by optimizing virtual pinhole camera parameters and predicted monocular depth, thereby restricting spatial displacements to physically valid projection geometries. It introduces a novel registration paradigm using camera parameterization as an implicit regularizer, a robust Normalized Edges Correlation (NEC) metric for cross‑spectral alignment, and demonstrates superior temporal stability and alignment accuracy on public ADAS datasets compared to unconstrained dense flow baselines.

By Aurelien Godet, Gabriel Jobert, Mauro Dalla Mura
arXiv Computer Vision
Sep 21

From Retrieval to Recognition:How Vision--Language Models Become OCR Specialists

The paper investigates how general vision‑language models (VLMs) develop specialized optical character recognition (OCR) capabilities. By applying a causal intervention protocol, the authors identify sparse, stable OCR‑head sets in several VLMs and show that these heads largely overlap with textual retrieval/copy heads found in general VLMs. The study concludes that full‑sequence OCR functions as a dense multimodal copy‑and‑paste mechanism, and that when a VLM is fine‑tuned for OCR, it largely preserves the same head identities while redistributing their functional and causal strengths.

By Yuanxiang Huangfu, Hanmeng Zhong, Linqing Chen, Jeffrey Tiong Jee Hui
arXiv Computer Vision
Sep 21

Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Rendering

The paper introduces Adaptive World Memory 3D Foundation Model (AWM-3DFM), a memory‑centric 3D foundation model that scales to large‑scale robotic localization, reconstruction, and Gaussian rendering. It employs transformer‑based gated updates, test‑time temporal‑spatial regulation, and local submap organization to maintain persistent memory, accuracy, and consistency across long image sequences. A Gaussian reconstruction head unifies pose estimation, dense point‑cloud reconstruction, and photorealistic rendering, achieving superior trajectory accuracy, reconstruction completeness, and rendering quality on public benchmarks and diverse robotic datasets.

By Tianchen Deng, Guole Shen, Yilin Shen, Wenhua Wu, Yilin Fang, Ziqi Ma, Tianjun Zhang, Shenghai Yuan, Wolfram Burgard, Hesheng Wang
arXiv Computer Vision
Sep 21

Extending Decoupled Attention to Dense Prediction and Masked Training for Multi-Channel Images

The paper introduces an extension of the Decoupled Vision Transformer (DC‑ViT) to handle multi‑channel imaging (MCI) data, where each channel carries a distinct semantic signal. By tokenizing each channel separately and then decoupling intra‑channel from inter‑channel updates, the model preserves channel‑specific features. The authors further enable independent per‑channel masking by solving a linear assignment between retained patches, allowing masked training without restricting visible tokens. Experiments on fluorescence microscopy, imaging mass cytometry, and satellite imaging datasets demonstrate that this approach outperforms the strongest Multi‑Channel Vision Transformer baselines on both classification and dense‑prediction tasks.

By Umar Marikkar, Sameed Husain, Muhammad Awais, Sara Atito
arXiv Computer Vision
Sep 21

Traffic Sign Recognition for Autonomous Driving Using Branched YOLOv2 and Geometric Features

The paper presents a traffic sign recognition system that extends YOLOv2 with a branched architecture and geometric feature integration. By adding intermediate prediction layers, the model can terminate inference early for easy cases, reducing computation time, while unsupervised Bayesian segmentation supplies geometric templates to improve classification of visually similar signs. Experiments on a combined GTSDB/GTSRB dataset show that the branched model achieves 0.680 mAP in 0.647 s, and adding geometric verification during inference raises mAP to 0.713.

By Arefeh Rezaei
arXiv Machine Learning
Sep 21

PRIVET: PRoximIty leakage detection Via Extreme value Theory

arXiv:2510.24233v2 Announce Type: replace Abstract: Deep generative models are often trained on sensitive data, such as genetic sequences, health data, or more broadly, any copyrighted, licensed or p...

By Antoine Szatkownik (TAU, BioInfo), Aur\'elien Decelle (TAU), Beatriz Seoane (TAU), Nicolas B\'ereux (TAU), L\'eo Planche (BioInfo), Guillaume Charpiat (TAU), Burak Yelmen (BioInfo, TAU), Flora Jay (BioInfo, TAU), Cyril Furtlehner (TAU)
arXiv Machine Learning
Sep 21

Signal-Centric Remote Sensing via Alternative Preprocessing and Acoustic Processing for ML-Driven Applications

The paper proposes a new approach to processing sonar data for remote sensing by using CSV-format data instead of traditional image-based representations. Experiments demonstrate a 91.18% reduction in processing time, improved accuracy of machine‑learning object detection, and higher signal‑to‑noise and peak‑signal‑to‑noise ratios.

By Logan Luna, Sirio Jansen-S\'anchez, Ilteris Demirkiran, Leo Ghelarducci
arXiv AI
Sep 21

Chinese Competitive Debating Dataset and Benchmark

The paper introduces a Chinese competitive debating dataset and benchmark, comprising 148 fully adjudicated matches with 2,698 stages and 20,542 exchange units, all annotated by 120 professional judges using a shared rubric. It offers manually verified transcripts, segmentation, and preserved scores, votes, and rationales, enabling evaluation of large language models on winner-tendency prediction, stage-score prediction, and best-debater prediction. Zero‑shot experiments show the best models achieve 66.2% winner‑prediction accuracy, a 0.250 Pearson correlation for stage scores, and 56.8% best‑debater accuracy.

By Zongrui Yang, Haoyuan Li, Zhongsheng Wang, Zhirui Zeng, Pengqian Han, Yi Zhou, Yuting Wang, Jiamou Liu
arXiv Machine Learning
Sep 21

Detection is solved, delineation is not: what governs tooth segmentation on panoramic radiographs

The study evaluates automatic tooth segmentation on panoramic radiographs using a large annotated corpus of 1,422 images and 42,142 tooth polygons. It finds that increasing input resolution improves boundary precision (mask mAP50‑95 rises from 0.656 to 0.717) while detection performance remains unchanged, and that architectural changes have minimal impact on in‑domain accuracy. Targeted interventions such as LoRA adaptation, promptable foundation models, and anatomical label assignment provide negligible gains, indicating that resolution and acquisition diversity should be prioritized over model novelty.

By Muhammad Rehan, Moaz Amjad, Syed Danial Ahmed, Mariam Adnan, Haider Ali