Computer vision

Detection, segmentation, depth and recognition research, plus the vision backbones that keep displacing the last generation.

3,379 stories · RSS feed

arXiv Computer Vision
Sep 17

PDA++: Field-Aligned Planning and Scene-Adaptive Insertion in Remote Sensing

PDA++ is a unified, environment‑aware object insertion framework for remote sensing imagery that improves few‑shot and long‑tail recognition. It operates in three stages: Planning, which selects scene‑compatible poses using an affordance field; Decoupling, which conditions the background on pose to preserve object identity while adapting to the scene; and Assimilation, which aligns multi‑scale texture distributions via optimal transport to enhance local coherence. The method achieves a whole‑image FID of 6.28 and boosts average few‑shot recognition mAP50 by 17.69 points on optical data, while also improving ship detection on SAR imagery and maintaining performance under cross‑dataset transfer and amorphous‑target insertion.

By Xianchi Dong, Yingyan Hou, Chao Ren, Wanxuan Lu, Zihan Wei, Hongfeng Yu, Yixiao Wang, Chubo Deng, Xian Sun
arXiv AI
Sep 17

QiT: Quantum-Inspired Transformer for Visual Recognition Task

QiT is a Quantum‑Inspired Transformer designed for visual recognition tasks. It replaces quantum neural network concepts with scalable classical operations: angle‑inspired encoding of image tokens, self‑attention over periodic features approximating quantum fidelity kernels, and gated multiplicative emulation of variational circuit interactions. The model achieves competitive performance on image‑classification benchmarks, matching a classical Transformer while avoiding the high runtime costs of simulated quantum models.

By Badri N. Patro, Vijay Agneeswaran
arXiv Computation and Language
Sep 17

PANORAMA: Panoptic Grounded Captioning via Mask Proposal Selection

PANORAMA introduces a new panoptic grounded captioning framework that jointly generates detailed image captions and associates each phrase with precise pixel-level masks. The authors create PanoCaps, a human‑annotated benchmark with dense captions and near‑complete pixel coverage, and propose a phrase‑mask matching protocol with a generalized Panoptic Quality metric. PANORAMA conditions a pretrained segmenter on contextualized phrase representations, learns to select appropriate masks, and achieves state‑of‑the‑art grounding performance on PanoCaps and other pixel‑level tasks.

By Sara Pieri, Evangelos Kazakos, Shizhe Chen, Josef Sivic, Cordelia Schmid
arXiv Machine Learning
Sep 16

A Sentinel-2 benchmark dataset for deep-learning active-fire segmentation across 25 California wildfires

The article introduces an open image dataset for active‑fire segmentation in satellite imagery, comprising 2,148 image‑mask pairs from 25 California wildfires captured between July 2020 and August 2026. Each 512×512 pixel, three‑channel image is a Sentinel‑2 Level‑2A composite of bands B12, B11, and B8A, with a fixed linear rendering applied uniformly. Masks distinguish background, short‑wave‑infrared rule‑based active fire, and invalid observations, and the dataset includes chip‑level metadata, an incident‑disjoint split, and a mask‑blind analyst review of 233 test chips.

By Shreyan Mitra, Mohammadreza Narimani, Parastoo Farajpoor
arXiv Computer Vision
Sep 16

TEDi: Temporal Memory-Enhanced and Denoising Transformer for Surgical Instrument Segmentation

TEDi is a Temporal memory-Enhanced and Denoising Transformer designed for surgical instrument segmentation. It introduces a query-level memory bank with a memory search enhancement encoder to incorporate discriminative representations from past frames, and a temporal consistency denoising module that builds a cross‑frame semantic anchor to stabilize predictions. Experiments on EndoVis 2017 and EndoVis 2018 show that TEDi outperforms existing state‑of‑the‑art methods, indicating its effectiveness for computer‑assisted surgery.

By Jiahong Yuan, Weiming Mi, Tao Zhang, Haoyin Zhou
arXiv Computer Vision
Sep 16

EventEgoHands++: Event-based Egocentric 3D Hand Mesh Reconstruction with Real Dataset

EventEgoHands++ is a new framework for reconstructing 3D hand meshes from egocentric event-based cameras. It introduces a Hand Detector that provides instance-level bounding boxes and masks for left and right hands, and an Adaptive Attention module that uses these detections to model spatial relationships and interactions. The authors extend the synthetic N-HOT3D dataset and create EEH‑R, a large real-world event-based egocentric hand dataset with about 1 million annotated frames, and show that their method outperforms existing baselines on both synthetic and real data.

By Ryosei Hara, Wataru Ikeda, Masashi Hatano, Mariko Isogawa
arXiv Computer Vision
Sep 16

Automated Distinction of Intimal and Medial Intracranial Arterial Calcification from CT Head

The study evaluates three automated methods for distinguishing intimal from medial intracranial arterial calcifications (IACs) on non‑contrast head CT scans. Using segmentation masks, the methods—an adapted visual score, a sphericity metric, and shape embeddings from a medical foundation model—achieved comparable performance, with the embedding approach achieving the highest weighted F1 scores (71.5% for single arteries, 59.8% for joint classification). The approach remains robust when using automated versus manual segmentation masks, demonstrating feasibility for fully automated IAC subtype quantification.

By Benjamin Jin, Maria del C. Vald\'es Hern\'andez, Richard Bortsov, Joanna M. Wardlaw, Daniel Bos, Grant Mair
arXiv Computer Vision
Sep 16

Bi-FlowGS: Bridging Generative View Completion and Gaussian Geometry through Bidirectional Flow Co-Refinement

Bi-FlowGS introduces a bidirectional co-refinement framework that links generative view completion with 3D Gaussian Splatting geometry. It employs Video-to-Geometry Flow Distillation (V2G) to transfer temporal correspondence from restored videos into Gaussian geometry, mitigating the Geometry Cheating problem. Simultaneously, Geometry-to-Video Flow-Guided Restoration (G2V) uses the current 3DGS geometry to guide temporally consistent video restoration, creating a loop where restored videos and optimized geometry iteratively improve each other, leading to better rendering quality and geometric consistency on wide-baseline and 360° benchmarks.

By Yuetong Wang, Jinsheng Quan, Yi Yang, Yawei Luo