arXiv Computer Vision

Efficient Semantic Understanding from Digital Foveation

The paper proposes a lightweight active‑vision pipeline that mimics biological foveation to perform semantic segmentation more efficiently. By selecting salient fixations, observing high‑resolution foveal patches, and using low‑resolution context, the method achieves 95.9% of baseline Top‑1 accuracy with only 4.7% of the computational cost, and recovers 90.6% of baseline object recall using 58.6% of the computation. The results demonstrate that sparse, selectively allocated observations can yield substantial semantic understanding, suggesting active vision as a viable alternative to uniform dense processing.

Hugging Face Trending Papers
Sep 3

Efficient Semantic Understanding from Digital Foveation

The paper proposes a lightweight active‑vision pipeline that mimics biological foveation to perform dense semantic segmentation more efficiently. By selecting salient fixations, it uses high‑resolution foveal views, low‑resolution context, and adaptive computation to accumulate semantic information. On ADE20K‑Object, a single foveated observation attains 95.9% of baseline Top‑1 accuracy with only 4.7% of the computational cost, and semantic accumulation recovers 90.6% of baseline recall using 58.6% of the computation.

arXiv AI
Jun 16

ActiveSAM: Image-Conditional Class Pruning for Fast and Accurate Open-Vocabulary Segmentation

arXiv:2606. 16996v1 Announce Type: cross Abstract: Segment Anything Model 3 (SAM 3) provides a strong frozen backbone for concept-prompted segmentation, but applying it directly to open-vocabulary semantic segmentation (OVSS) is inefficient: full-resolution decoding is typically run over the entire dataset vocabulary, whereas each image contains only a small active subset of classes.

By Tran Dinh Tien, Zhiqiang Shen
arXiv AI
Jun 9

ACTIVE-o3: Empowering MLLMs with Active Perception via Pure Reinforcement Learning

arXiv:2505. 21457v2 Announce Type: replace-cross Abstract: Active vision, also known as active perception, refers to actively selecting where and how to look in order to gather task-relevant information.

By Muzhi Zhu, Hao Zhong, Canyu Zhao, Zongze Du, Mingyu Liu, Zheng Huang, Anzhou Li, Hao Chen, Cheng Zou, Jingdong Chen, Ming Yang, Chunhua Shen
arXiv Computer Vision
Sep 4

FoRIS: Progressive Foreground Refinement for Training-Free In-Context Segmentation

FoRIS is a training‑free in‑context segmentation framework that refines foreground masks through a coarse‑to‑fine process. It operates in three stages—Foreground Purification, Localization, and Consolidation—to suppress background noise, pinpoint target regions, and reconstruct complete foreground structures. The method achieves state‑of‑the‑art performance, improving mIoU by 4.5 and 4.8 points in 1‑shot and 5‑shot settings respectively.

By Ming Hu, Jianfu Yin, Mingyu Dou, Miaomiao Zhang, Yao Wang, Cong Hu, Bingliang Hu, Quan Wang
arXiv AI
Aug 28

PACE: A Unified Condense-and-Extract Paradigm for Fast VLM Inference

PACE introduces a training‑free Condense‑and‑Extract framework that speeds up Vision‑Language Model inference by first adaptively downsampling visual inputs before encoding and then selectively retaining essential tokens during decoding. The Adaptive Pixel Compressor (APC) reduces encoder workload while preserving global context, and the Dynamic Dual‑Attention Extractor (DDAE) keeps task‑critical details by fusing visual and language signals. Applied to Qwen2.5‑VL‑7B, PACE maintains 93.8% of performance using only 10% of visual tokens, achieving a 3.1× speedup in time to first token.

By Junjie Liu, Shengyuan Ye, Xu Chen
arXiv AI
Aug 18

FloodReasonBench: Benchmarking VLM Reasoning Segmentation for Embodied Flood Response at the Edge

arXiv:2608. 15410v1 Announce Type: cross Abstract: Reasoning segmentation enables vision-language models (VLMs) to translate mission-relevant language requests into pixel-level visual grounding, offering a natural perception interface for embodied agents.

By Rajat Bhattacharjya, Yoomee Jung, Minwoo Kim, Sing-Yao Wu, Eli Bozorgzadeh, Nalini Venkatasubramanian, Nikil Dutt