arXiv Computer Vision

Relational Abstractions for Spatial Reasoning with Diffusion Models

arXiv Machine Learning
6d ago

VisualSphinx: Large-Scale Synthetic Vision Logic Puzzles for RL

VisualSphinx is a large-scale synthetic dataset designed to train vision language models (VLMs) on visual logical reasoning tasks. The dataset is generated through a rule-to-image synthesis pipeline that expands puzzle rules from seed questions and produces executable rendering programs for puzzle assembly. Experiments using standard GRPO with binary correctness rewards show that VLMs trained on VisualSphinx achieve improved logical coherence and performance on logical reasoning, as well as on related tasks such as algebraic, arithmetic, and geometry reasoning.

By Yichen Feng, Zhangchen Xu, Fengqing Jiang, Yuetai Li, Bhaskar Ramasubramanian, Luyao Niu, Bill Yuchen Lin, Radha Poovendran
arXiv AI
Sep 10

MV-STRIDE: Enabling MLLMs to Master Multi-View Spatial Reasoning via Hierarchical Capability Modeling

MV-STRIDE is a Multi‑View hierarchical Spatial Reasoning dataset that models dependencies among perception, scene understanding, and contextual reasoning to support 3D spatial cognition. It introduces a QA generation pipeline that enforces cross‑view constraints, producing multi‑level reasoning tasks with chain‑of‑thought supervision. Experiments show that training on MV‑STRIDE yields state‑of‑the‑art performance on multi‑view spatial benchmarks, enabling MLLMs to reason robustly across diverse viewpoints.

By Jin Xu, Xiaojian Huang, Zhuodong Luo, Zhihong Zhang, Xin Liu, Jiansheng Wei, Xinzhi Wang, Jie Zhao, Xuejin Chen
arXiv AI
Sep 10

A Progressive Training Strategy for Embodied Vision-Language Models to Mitigate Spatio-Temporal Hallucinations

The paper introduces a progressive training strategy for embodied vision‑language models aimed at reducing spatio‑temporal hallucinations. It first creates a Chain‑of‑Thought dataset that breaks complex reasoning into detailed spatiotemporal steps, then uses supervised pre‑training on this dataset followed by fine‑tuning with weakly‑labeled data. Experiments show the method improves backbone accuracy and narrows the forward‑backward performance gap from over 70% to 6.53%, indicating stronger dynamic reasoning and fewer temporal biases.

By Xiaoda Yang, Shuai Yang, Can Wang, Jingyang Xue, Menglan Tang, Checheng Yu, Xunzhe Zhou, Sashuai Zhou, Tao Jin, Lixin Yang, Xiangyu Yue, Zhou Zhao
arXiv Computer Vision
Sep 16

Reasoning with Image Generation

The paper introduces ReImaGin, a method that uses image generation models as a flexible visual reasoning tool for multimodal large language models. Unlike traditional fixed-function vision tools, ReImaGin accepts natural language commands and can perform open-ended visual operations such as removing occlusions or creating floorplans from multiple views. Experiments on six diverse visual reasoning tasks show that ReImaGin outperforms both text-only reasoning and specialist vision-tool baselines, achieving up to a 25% improvement.

By Nishad Singhi, Hector Garcia Rodriguez, Aditya Arora, Marcus Rohrbach, Anna Rohrbach
arXiv Computer Vision
6d ago

GenDSR: Transferring Representations from Video Generation Models for Dynamic Spatial Reasoning

GenDSR is a framework that transfers intermediate representations from video generation models (VGMs) into vision‑language models (VLMs) to improve dynamic spatial reasoning. It uses two complementary branches—a raw branch that preserves holistic generative context and a delta branch that emphasizes temporal variation—and fuses them with task‑conditioned token‑wise gates before injecting the result into the native visual representation. On the DSR‑Bench benchmark, GenDSR achieves a 67.2% score, surpassing previous methods and setting a new state‑of‑the‑art.

By Ke Yang, Zhenyu Zhang, Jun Li
Hugging Face Trending Papers
Aug 5

Disentangling 3D Modeling from Spatial Reasoning

In this work, we explore an alternative paradigm for spatial reasoning by explicitly disentangling 3D perception from reasoning, rather than jointly acquiring implicit 3D perception and reasoning through large-scale training. Our key observation is that modern perception models excel at estimating continuous 3D geometry, whereas large language models (LLMs) are particularly effective at compositional and symbolic reasoning.