SpaceAct is a new benchmark that tests multimodal large language models on 3D spatial and temporal reasoning through closed‑loop physical action and active perception. It uses interlocking bricks and mechanical puzzles to create 108 verified instances across 36 task families, requiring models to reconstruct 3D geometry, anticipate dynamics, and execute precise 6‑DoF poses while avoiding collisions. The accompanying SAPA framework provides diagnostic modes and active‑perception capabilities, revealing that even with a valid plan, current models struggle with 3D visual grounding and action refinement.
By Chenglong Shi, Zekai Yuan, Yue Song, Jon Pu, Will Wu
EgoP$^{2}$C is a new framework that internalizes a plan‑perceive‑compose workflow within a single vision‑language model for spatial reasoning in egocentric video. It trains specialized Planner and Perception teachers via Dual‑LoRA adapters, then fine‑tunes a mixture‑of‑experts student under their supervision, using a segment‑level multi‑teacher on‑policy distillation to guide evidence‑seeking, stopping, and answer composition. The resulting student models, built on Qwen3‑VL‑8B and SenseNova‑SI‑1.3‑8B, outperform their base models by 9.2 and 7.5 percentage points on three benchmarks, while cutting inference FLOPs by about 66% and speeding up inference 1.29–1.49×.
By Chaoyu Li, Arka Sadhu, Yuliang Li, Hyo Jin Kim, Yuning Chai, Pooyan Fazli
Kepler is an open‑source harness that represents hypotheses as executable world models and validates them through retrospective transition checks and conditional prediction checks. In the ARC‑AGI‑3 benchmark, a frozen Claude Opus 5 configuration achieved a perfect 100.00 RHAE on all 25 public games without per‑game model selection or score‑conditioned reruns, and matched or outperformed median‑human action counts on 181 of 183 levels. The study also identified three evaluation failures and highlighted that public‑set score alone has limited discriminative value, advocating for first‑attempt, cost‑conditioned, and verification‑aware reporting.
whyItMatters":"The results demonstrate that a purely score‑based evaluation can be misleading, underscoring the need for more rigorous, cost‑aware, and verification‑aware metrics in AI benchmark assessments."
By Wensen Wu
arXiv:2610.02563v1 Announce Type: cross
Abstract: We present OpenGameEval, a benchmark and evaluation framework for agentic game development inside Roblox Studio. It runs language models as agents in...
By Eray Turkel, Mengsha Sun, Kartik Ayyar, Sean Dunigan, Jack Lu, Vlad Shcherban, Hsiang-Shun Shih, Xin Wang, Tiantian Zhang
arXiv:2607. 22732v1 Announce Type: new Abstract: LLM-based game agents often perform poorly on more complex tasks.
By Mohit Jiwatode, Ronja Fuchs, Robin Schm\"ocker, Bodo Rosenhahn, Alexander Dockhorn
Gym-Anything-RT is a new benchmark that creates 100 real‑time visual minigames to test vision‑language AI agents’ ability to perceive and act while the environment evolves. The framework automatically generates these environments from a taxonomy of six real‑time interaction capabilities and allows controlled experiments by pausing or slowing the game. Evaluation shows a stark gap: GPT‑6 Astra passes only 9 % of the real‑time games, but 75 % when the environment is paused, revealing significant limitations in current agents’ real‑time performance.
By Pranjal Aggarwal, Sean Welleck