← Back to all news
arXiv Computer Vision By Koya Sakamoto, Daichi Azuma, Shuhei Kurita, Naoya Chiba, Yusuke Iwasawa, Yutaka Matsuo, Taiki Miyanishi

Rendering-Free Lookahead for Question-Guided Active Vision

Read the original on arXiv Computer Vision →

The paper introduces Rendering-Free Lookahead (RFL), a method for active robot vision that selects camera motions to reveal information needed for viewpoint-dependent question answering. RFL predicts future answerability—how well a view can answer a question—using a student model trained via distillation from a privileged teacher that renders future views with 3D Gaussian Splatting. In deployment, RFL chooses camera motions without rendering, achieving a 43% improvement in mean judge score over a baseline on 377 unseen test episodes.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Related stories

arXiv Computer Vision
2d ago

TerraAgent: Demonstration-Grounded Multi-Agent Reasoning for Long-Context Remote Sensing Visual Question Answering

The paper introduces TerraAgent, a training‑free framework that enhances remote sensing visual question answering by integrating three modules: GDR for demonstration retrieval, MACE for evidence‑typed sub‑question decomposition, and CVA for counterfactual evidence auditing. It demonstrates significant improvements on multiple benchmarks, raising accuracy, visual‑dependency scores, and reducing prior‑only answers and hallucinations without fine‑tuning.

By Jingwen Huang, Yiming Fang, Hanxiao Wu, Boyuan He, Keyi Luo
llmsagentsnlpfine-tuningmultimodalbenchmarkssafety
More like this →
arXiv Computer Vision
Sep 7

Where to Look Matters: Learning Influential Views for VLM-based 3D Visual Grounding

IVSGround introduces a lightweight view selector that learns to choose the most informative camera views for vision‑language model (VLM) based 3D visual grounding, replacing heuristic view selection. The selector is trained via a two‑stage rejection sampling process that uses feedback from a reasoning VLM to generate supervision signals. Experiments on ScanRefer and NR3D demonstrate that IVSGround consistently improves grounding accuracy over existing zero‑shot pipelines, underscoring the importance of selecting where to look for effective 3D visual grounding.

By Tsung-Chih Chiang, Hsuan-Kung Yang, Jou-Min Liu, Ting-Ru Liu, Chun-Wei Huang, Quan Kong, Chun-Yi Lee
llmsmultimodal
More like this →
arXiv AI
Jun 16

ScoutVLA: UAV-Centric Active Perception via a Dual-Expert VLA Model for Open-World Embodied Question Answering

arXiv:2606. 14772v1 Announce Type: cross Abstract: Aerial Embodied Question Answering (EQA) requires Unmanned Aerial Vehicles (UAVs) to actively perceive the environment and answer natural language questions.

By Wenhao Lu, Zhengqiu Zhu, Xiaofeng Wang, Xiaoran Zhang, Yatai Ji, Yong Zhao, Yue Hu, Yingzhen Nie, Jinlong Zhu, Zheng Zhu
diffusionnlproboticsmultimodalbenchmarks
More like this →