arXiv Computer Vision
Can Learning to Answer Spatial Questions Improve Novel-View Generation?
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
Hugging Face Trending Papers
5d ago
Can Learning to Answer Spatial Questions Improve Novel-View Generation?
Generating novel views from limited observations requires preserving both the appearance and spatial structure of a scene. Although recent approaches exploit fine-grained geometric cues, they do not e...
arXiv Machine Learning
Jun 3
Zero-Shot 3D Question Answering via Hierarchical View-to-Token Transportation
arXiv:2606. 03100v1 Announce Type: cross Abstract: Recently, zero-shot 3D scene understanding via 2D Vision-Language Models (VLMs) has gained increasing research interest due to their promising spatial reasoning capabilities.
arXiv AI
Jun 26
Semantic Generative Tuning for Unified Multimodal Models
arXiv:2605. 18714v2 Announce Type: replace-cross Abstract: Unified multimodal models (UMMs) strive to consolidate visual understanding and visual generation within a single architecture.
arXiv Computation and Language
Sep 30
Imagine3D-LLM: Teaching MLLMs to Imagine 3D Scenes Before Answering
arXiv:2609.38177v1 Announce Type: cross Abstract: Reasoning about the 3D world from multi-view images remains a fundamental challenge for Multimodal Large Language Models (MLLMs). While modern MLLMs...
arXiv Computer Vision
4d ago
DK-VLM: Geometry as Position for Spatial Reasoning in Vision-Language Models
DK‑VLM introduces Dual‑Kernel Attention, where a visual token’s attention is computed from both its input position and its geometric position derived from 3D points and camera poses. A semantic kernel preserves pretrained attention while a geometric kernel modulates attention via point displacements and relative view transformations, with a learned gate fusing the two. The model also employs Reference‑Frame Composition supervision to update its reference frame across successive judgments, achieving top scores on six spatial benchmarks and strong performance on VSI‑Bench and ReVSI‑32.
arXiv AI
Aug 17
SPARGen: Unifying Spatial Perception and Reasoning through Native Multimodal Generation
arXiv:2608. 14138v1 Announce Type: cross Abstract: Spatial perception and reasoning from visual observations require recovering geometric structure, establishing correspondences, and understanding spatial relations.