arXiv:2605. 07066v3 Announce Type: replace Abstract: Autonomous systems that build structures from natural-language instructions need reliable spatial reasoning, yet large language models (LLMs) make systematic coordinate errors when generating three-dimensional block placements.
By Paul Whitten, Li-Jen Chen, Sharath Baddam
SpaceAct is a new benchmark that tests multimodal large language models on 3D spatial and temporal reasoning through closed‑loop physical action and active perception. It uses interlocking bricks and mechanical puzzles to create 108 verified instances across 36 task families, requiring models to reconstruct 3D geometry, anticipate dynamics, and execute precise 6‑DoF poses while avoiding collisions. The accompanying SAPA framework provides diagnostic modes and active‑perception capabilities, revealing that even with a valid plan, current models struggle with 3D visual grounding and action refinement.
By Chenglong Shi, Zekai Yuan, Yue Song, Jon Pu, Will Wu
VETR (Verified Execution Trajectories for Refinement) is a framework that enables visual agents to recursively improve symbolic graphics reasoning by extracting actionable evidence from execution traces. It retains aligned program/render records and uses an execution refiner to compile observed writes and state changes into constrained alternative programs, which are then validated against captured runtime state. Evaluations on BlenderGym and BlenderBench with GPT‑5.6‑luna and Qwen3.8‑27B demonstrate that VETR consistently outperforms existing refinement strategies such as BlenderAlchemy and VIGA.
By Yingbo Ma, Kuangshi Ai, Gordon Dai, Chenglong Yu, Chaoli Wang, Hua Shen
arXiv:2609.33399v2 Announce Type: replace
Abstract: In realistic education, a solution is often expressed not only in words but in a drawing--a circuit, a geometric construction, a function plot--and...
By Jiali Chen, Zhengteng Lin, Zuqi Wang, Shirong Lin, Xi Yu, Xusen Hei, DingBa Fu, Jiayuan Xie, Yi Cai
The paper introduces PEPS, a training‑free framework that improves spatial reasoning in Vision‑Language Models by parsing queries into a compact set of executable requirements before execution. PEPS uses a typed FESM schema (Frame, Entity, State, Metric) to commit queries, then selectively grounds primitives via fixed geometric APIs and verifies sufficiency, allowing early termination or targeted repair. Experiments on spatial reasoning benchmarks show that PEPS boosts accuracy while reducing refinement rounds, API cost, and latency compared to existing tool‑integrated baselines.
By Xiwei Liu, Yulong Li, Xinling Zhuang, Xuhui Li, Yichen Li, Haolin Yang, Zhixiang Lu, Yutong Xie
arXiv:2609.16251v1 Announce Type: new
Abstract: Computer-use agents are increasingly evaluated in realistic desktop environments, but existing benchmarks provide limited coverage of professional engi...
By Zihan Dong, Yuanzhe Liu, Zhiyuan Ma, Qishi Zhan, Dehan Kong, Guohao Li, Kaixin Li