arXiv AI
Jun 16
Thinking with Visual Grounding
arXiv:2606. 16122v1 Announce Type: new Abstract: Visual thinking should not only sound right; it should show its evidence.
H-GRPO: Permutation-Invariant Reinforcement Learning for Improving Spatial Grounded Reasoning
Related stories
arXiv AI
Jul 7
SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
arXiv:2511. 07403v2 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) have achieved remarkable progress in vision-language tasks, but continue to struggle with spatial reasoning.
arXiv AI
Oct 1
SpatialCORE: Confidence-Aware Grounded Spatial Reasoning in Large Vision--Language Models
arXiv:2609.38716v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) have made remarkable progress across visual perception tasks, yet spatial reasoning remains a persistent weaknes...
arXiv AI
Sep 7
MultihopSpatial: Multi-hop Compositional Spatial Reasoning Benchmark for Vision-Language Model
MultihopSpatial is a new benchmark for Vision‑Language Models that focuses on multi‑hop, compositional spatial reasoning with queries ranging from 1 to 3 hops across varied spatial perspectives. It introduces the Acc@50IoU metric, which jointly evaluates answer selection and precise bounding‑box prediction, and provides a large‑scale training corpus, MultihopSpatial‑Train, to improve spatial intelligence. Evaluation of 37 state‑of‑the‑art VLMs shows that compositional spatial reasoning remains a significant challenge, and reinforcement learning fine‑tuning on the corpus boosts both intrinsic spatial reasoning and downstream embodied manipulation performance.
arXiv AI
Jun 11
SVoT: State-aware Visualization-of-Thought for Spatial Reasoning via Reinforcement Learning
arXiv:2606. 11770v1 Announce Type: new Abstract: Spatial reasoning remains a challenge for Multimodal Large Language Models (MLLMs), as it requires reliable multi-hop inference over both intermediate states and state transitions.
arXiv AI
Jun 11
The Art of Interrogation: Consistency Amplifies Factuality in Spatial Reasoning
arXiv:2606. 11918v1 Announce Type: new Abstract: Current Large Reasoning Models (LRMs) exhibit remarkable general capabilities but significantly underperform in spatial reasoning tasks.
arXiv AI
Jun 30
Be Faithful When Response: Returning Fluent and Grounded Answers for Vision-Language Models Reinforcement Learning
arXiv:2606. 29984v1 Announce Type: new Abstract: Reinforcement Learning (RL) is an important paradigm for improving the reasoning capabilities of Vision-Language Models (VLMs).
arXiv AI
Aug 25
Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understanding
arXiv:2608.22429v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) capable of thinking with images often rely on external tools for fine-grained perception. However, this relian...
arXiv AI
Jun 17
Reinforcing Dual-Path Reasoning in Spatial Vision Language Models
arXiv:2606. 17539v1 Announce Type: cross Abstract: Spatial VLMs have made substantial progress in geometric perception, yet complex spatial reasoning requiring multi-step inference over depth, distance, and scene relations remains challenging.
arXiv Computer Vision
Sep 23
SATURN: Symbolic Spatial Reasoning for Multi-Perspective Grounding
arXiv:2606.22694v2 Announce Type: replace Abstract: Vision-Language Models (VLMs) remain unreliable when spatial reasoning requires composing relations whose meanings depend on frames of reference. E...
arXiv Computation and Language
21h ago
GRIT: Gradient Masking for Visually Misgrounded Tokens in Text-Rich Reasoning
The paper introduces GRIT, a training framework that adds visual grounding to reinforcement learning with verifiable rewards (RLVR) for vision-language models, addressing the issue of Correct-but-Visually-Misgrounded Reasoning (CVMR). CVMR occurs when models produce correct final answers while misperceiving visual information during intermediate reasoning steps, a problem that standard RLVR rewards cannot detect. By analyzing token-level attention patterns, the authors show that CVMR tokens differ from well-grounded tokens and use this insight to guide GRIT, which improves both reasoning accuracy and grounding fidelity. Additionally, the authors present GRIT-Bench, a new benchmark for evaluating text-rich reasoning across varying text lengths and reasoning depths.
arXiv AI
Aug 24
Is Visual Prompting All You Need? Studying VLM Spatial Reasoning under Progressive Visual Scaffolds
The paper investigates how visual presentation affects vision‑language models (VLMs) on the SPaRC spatial planning benchmark. By adding lightweight input‑side scaffolds that keep the visual modality but make spatial structure clearer, the authors achieve up to a 34.0‑percentage‑point accuracy boost across multiple VLMs, and an additional 4.6 points when combined with GRPO training. Analyses reveal that these improvements stem mainly from reduced grounding errors, while rule‑based reasoning remains difficult, highlighting visual presentation as a key determinant of whether VLM benchmarks test grounded perception, downstream reasoning, or both.