arXiv Computer Vision

Queryable Gaussian View Index: Text Retrieval and Selective Camera Localization

Hugging Face Trending Papers
Jul 22

RIM: A Retrieval-In-Matching Framework for Cross-Domain Global Visual Localization of UAVs

Global visual localization of unmanned aerial vehicles (UAVs) using remote-sensing reference maps has attracted increasing attention. However, acquisition-time and imaging-platform differences between UAV and reference imagery induce substantial cross-domain appearance and viewpoint shifts, challenging robust six-degree-of-freedom (6-DoF) pose estimation.

arXiv Computer Vision
Sep 3

GeoStore: Finding Small Storefronts in Large Scenes -- A Fine-Grained POI Localization Benchmark with Global-to-Local Asymmetric Matching

GeoStore is a new benchmark for fine‑grained point‑of‑interest (POI) localization that matches close‑up storefront photos against large geo‑tagged street‑view images, a task distinct from traditional visual place recognition. The paper shows that global‑descriptor methods designed for symmetric matching perform poorly on this asymmetric problem, and introduces GLAM, a Global‑to‑Local Asymmetric Matching approach that combines a global retrieval anchor with a lightweight local re‑ranking using pooled region tokens. GLAM achieves higher Recall@1/5/10 and mAP than strong baselines while using far fewer re‑ranking features and significantly lower per‑pair matching cost.

By Lu Han, Xiting Sun, Hao Wang, Zhiqiang Cao, Ruihuan Du, Ziquan Zeng, Chunlong Lv
arXiv Computer Vision
6d ago

SplatScout: Query-Driven Part-Level Referring Segmentation in Gaussian Scenes

SplatScout is a new query‑driven, closed‑loop approach for part‑level referring segmentation in Gaussian scenes, placing perception under vision‑language model control. It actively selects views, directs segmentation, and refines predictions by inspecting rendered 3D results. On the newly introduced PartRef‑ScanNet++ benchmark, SplatScout achieves 0.538 mIoU, outperforming existing methods and demonstrating the benefits of iterative refinement and effective tool‑feedback utilization.

By Yihan Zang, Da Li, Shinkyu Park, Ivan Viola, Dominik Engel
arXiv Computer Vision
Oct 23

SpatialMem: Metric-Aligned Long-Horizon Video Memory for Language Grounding and QA

SpatialMem is a memory-based system that fuses 3D geometry, semantics, and language into a single queryable representation. Starting from casually recorded egocentric RGB video, it reconstructs metrically scaled interior scenes, identifies structural 3D anchors (walls, doors, windows), and links open‑vocabulary object nodes to evidence patches, visual embeddings, and two‑layer descriptions at 3D coordinates, enabling spatial‑relation reasoning, language‑directed retrieval, and QA without special sensors. The system is evaluated at scale on public benchmarks, achieving competitive scores on VSI‑Bench, OpenEQA, and ScanNet, while maintaining a compact index of about 14 KB per scene.

By Xinyi Zheng, Yunze Liu, Chi-Hao Wu, Fan Zhang, Hao Zheng, Wenqi Zhou, Walterio W. Mayol-Cuevas, Junxiao Shen
Hugging Face Trending Papers
6d ago

SplatScout: Query-Driven Part-Level Referring Segmentation in Gaussian Scenes

SplatScout is a query‑driven, closed‑loop approach for part‑level referring segmentation in Gaussian scenes, placing perception under vision‑language model control. It actively selects views, directs segmentation, and refines predictions by inspecting rendered 3D results. On the newly introduced PartRef‑ScanNet++ benchmark, SplatScout achieves 0.538 mIoU, outperforming existing methods and demonstrating the benefits of iterative refinement and effective tool‑feedback utilization.

arXiv AI
Sep 25

GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoning

GeoRefer-Bench is a new benchmark for verifiable geospatial referring segmentation that evaluates whether models correctly resolve spatial relations in overhead imagery. Each query is expressed as an executable logical form over a metric scene graph, and predictions are scored with Exact Query Success (EQS), requiring an exact match to the query’s referent set. The dataset contains 700 UAV scenes, 26,217 instances, 142,796 spatial relations, 20,916 executable queries across five reasoning levels, and additional paraphrases, unanswerable queries, counterfactual pairs, and leakage‑controlled splits.

By Shuaishuai Cao, Min Huang, Meng Tang, Xuan Liu, Youjin Wang, Hui Lin
arXiv Computer Vision
Oct 12

GLIMPSE: Global-Local Indexing with Multi-Precision Spectral Encoding for Explorable Video World Models

GLIMPSE is a global‑local memory interface for camera‑controlled video world models that uses band‑wise multi‑precision coordinates and geometry‑conditioned spectral attenuation to reduce errors from inaccurate projected addresses. It combines local patch memory for view‑specific appearance with recurrent global memory for scene context, and employs footprint‑guided retrieval to select historical patches within a fixed local read budget. Compared with deterministic positional transport, GLIMPSE improves geometric correspondence and photometric consistency under matched retrieval and read budgets.

By Zhufeng Xu, Henglei Lv, Bailin Deng, Yikang Ding, Xiaoqiang Liu, Guoxin Zhang, Hongbo Fu, Lin Gao