Computer vision

Detection, segmentation, depth and recognition research, plus the vision backbones that keep displacing the last generation.

3,426 stories · RSS feed

arXiv Computer Vision
Sep 10

The Living Library: Transforming Archival Collections into Conversational Knowledge Systems -- Lessons from the Theodore Roosevelt Presidential Library

The Living Library is an end‑to‑end framework that converts fragmented digital archives into governed, conversational exhibit experiences. Developed at the Theodore Roosevelt Presidential Library, it digitizes a 300,000‑record collection, enriches it with OCR and metadata, and publishes it to a hybrid dense/semantic index. The system supports curator review via the Archivist App, powers a researcher interface, and runs Talk to TR—a museum exhibit where a digital human embodiment of Theodore Roosevelt answers visitors’ questions using Cross‑Era Analogical Grounding and dual‑path retrieval to keep responses grounded and responsive.

By Pengce Wang, Lucia Ronchi Darre, Matt Briney, Michaell Bakalars, Dan Rutkowski, Ursula Hardy, David Wolf, Laura Hoffman, Allen Kim, Shawn Wright, Juan Lavista Ferres
arXiv Machine Learning
Sep 10

Hyperspectral Trajectory Image for Multi-Month Trajectory Anomaly Detection

The paper introduces TITAnD, a Trajectory Image Transformer that converts dense and sparse GPS trajectories into a Hyperspectral Trajectory Image (HTI) and applies vision-based classification and segmentation for anomaly detection. It employs a Cyclic Factorized Transformer (CFT) that splits attention along within-day and across-day axes, drastically reducing computational cost and enabling multi-month analysis. Empirical results show TITAnD outperforms existing sparse and dense benchmarks, achieving higher AUC-PR and faster inference than comparable Transformers.

By Md Awsafur Rahman, Chandrakanth Gudavalli, Hardik Prajapati, B. S. Manjunath
Hugging Face Trending Papers
Sep 8

SeGDeP: Semantic- and Geometric-Aware Decoupled Prompts for Reasoning Segmentation

SeGDeP introduces a decoupled prompt system that separates semantic identification from spatial grounding in reasoning segmentation. It uses a semantic prompt branch and an independent geometric projection path to produce semantic features and a DETR‑predicted box, which jointly condition a SAM mask decoder. The model achieves high cIoU and gIoU scores while adapting only a small fraction of Qwen3‑VL parameters via LoRA.

Hugging Face Trending Papers
Sep 8

TriCCOT: Tri-part Convolutional Conformal Transformer for Onboard Space Object Detection

TriCCOT is a tri-part architecture designed for onboard space object detection that balances computational efficiency with robust performance. It combines a convolutional region proposal network, a conformal prediction stage that enlarges bounding boxes with distribution‑free probabilistic coverage, and Aper‑GATES, a hardware‑friendly attention‑based classifier that replaces standard transformer operations with convolutional projections and gating. Experiments on DIOR and VDVRaw datasets show competitive detection accuracy and improved robustness to spatial blur and noise, and the model was fully deployed on a Xilinx Versal VCK190 FPGA without altering the underlying DPU architecture.

Hugging Face Trending Papers
Sep 8

MARS-CLIP: Multi-Resolution and Attention Refined Zero-Shot Image Segmentation

MARS-CLIP is a zero‑shot semantic segmentation framework that builds on CLIP by adding a multi‑resolution feature extraction module and an attention refinement mechanism. The multi‑resolution module fuses fine‑grained local features with global context to mitigate low spatial resolution, while the attention refinement injects spatial and color biases from intermediate layers into the final self‑attention block to better recover object boundaries. Experiments on six public datasets show that MARS‑CLIP outperforms state‑of‑the‑art methods.

arXiv Computer Vision
Sep 7

Semi-Supervised Hyperspectral Image Classification with Edge-Aware Superpixel Label Propagation and Adaptive Pseudo-Labeling

The paper introduces a semi‑supervised hyperspectral image classification framework that combines spatial prior information with a dynamic learning mechanism. It proposes an Edge‑Aware Superpixel Label Propagation module to reduce boundary label diffusion and a Dynamic History‑Fused Prediction method to stabilize pseudo‑labels over time. Additionally, an Adaptive Tripartite Sample Categorization strategy is used to hierarchically exploit easy, ambiguous, and hard samples, resulting in improved pseudo‑label quality and learning efficiency. The combined Dynamic Reliability‑Enhanced Pseudo‑Label Framework achieves spatio‑temporal consistency optimization and demonstrates superior performance on four benchmark datasets.

By Yunfei Qiu, Qiqiong Ma, Tianhua Lv, Li Fang, Shudong Zhou, Wei Yao
arXiv Computer Vision
Sep 7

Object Concepts Emerge from Motion

The paper introduces a biologically inspired framework that learns object‑centric visual representations from raw videos without human annotations or camera calibration. By using motion boundaries detected via optical flow and clustering to create pseudo‑instance masks, the method supervises a single‑image encoder with pixel‑level pairwise metric learning. Training on 195 million pseudo‑labeled frames and expanding to 421 million frames through Motion‑Verified Self‑Training, the approach yields Swin‑based encoders that outperform or match supervised and self‑supervised baselines on tasks such as monocular depth estimation, 3D object detection, 3D occupancy prediction, and end‑to‑end planning.

By Boshi Li, Xiaohui Wang, Xiaoyang Wu, Zhichao Li, Ya Yang, Naiyan Wang
arXiv AI
Sep 7

Predicting Spatiotemporal Mobile Sensing-Based PM2.5 Concentrations Using Low-Rank Adapted Spatially Attentive Graph Neural Network

This study presents a new mobile‑sensing dataset from Surat, India, capturing PM2.5 concentrations along with meteorological and land‑use variables. The authors model the data as a graph using two node‑definition strategies—uniform segmentation and DBSCAN clustering—and introduce a Spatially Attentive Graph Neural Network (SA‑GNN) that combines cluster‑specific GRUs with a Graph Attention Network to forecast fine‑grained, short‑term PM2.5 levels. SA‑GNN outperforms traditional LSTM, RNN, GRU, and ANN baselines, achieving an R² of 0.95, RMSE of 6.8, and MAE of 4.2 µg/m³ on the dataset.

By Om Chiddarwar, Priyanka Mandal, Praveen Kumar Chandaliya, Shriniwas Arkatkar
arXiv AI
Sep 7

AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories

AnchorWeave is a memory‑augmented video generation framework that replaces a single misaligned global memory with multiple clean local geometric memories. It retrieves local memories based on coverage of the target trajectory and integrates them through a multi‑anchor weaving controller during generation. Experiments show that this approach improves long‑term scene consistency while preserving visual quality, with ablation studies confirming the benefits of local conditioning, multi‑anchor control, and coverage‑driven retrieval.

By Zun Wang, Han Lin, Jaehong Yoon, Jaemin Cho, Yue Zhang, Mohit Bansal