GameHorizon Suite: Multi-Horizon Data and Evaluation in Gameplay
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
PlaySuite is a large-scale benchmark that evaluates interactive visual intelligence by using over 5,000 open-source video games from platforms like PyWeek and itch.io. The benchmark covers diverse game engines (Pygame, HTML5, Godot, Unity) and introduces a unified closed-loop interaction framework and a Video-LLM-as-a-judge protocol to standardize progress measurement. Evaluation of fourteen recent models shows a perception-action gap, with strong reasoning but poor sustained progress, spatial grounding, action execution, and self-correction.
GameVerse is a new minute‑scale gameplay video dataset designed to support long‑horizon interactive world modeling. It contains 69.7K clips totaling 1,655 hours and 349.6 million frames, including 1,358 hours of continuous two‑minute sequences—an order of magnitude longer than prior datasets. Each clip is processed through a unified pipeline that provides scene‑consistent segmentation, quality filtering, camera pose estimation, and event‑based caption annotation, with temporally stable camera trajectories and captions that distinguish static context from dynamic events.
arXiv:2608.21833v1 Announce Type: new Abstract: Recent large language models (LLMs) can operate as coding agents that build complete games from natural language requests. Game development is especial...
GameGo is a framework that converts short game ideas into detailed Product Requirements Documents using industry practices, enabling coding agents to generate complete games from sparse user queries. It employs dynamic compression to keep essential gameplay constraints while allowing design flexibility. The authors built GameGoData with over 55,000 development trajectories and GameGoBench with 124 game queries, training GameGoCoder to outperform baselines and match leading models on gamedev benchmarks.
arXiv:2609.16679v1 Announce Type: new Abstract: Foundation models, alongside advances in learned game-world models, are reshaping AI across the game lifecycle. Beyond playing games, recent systems mo...
The paper introduces Kuration SDK, a toolkit for curating raw gameplay data to address the Virtual2Real gap in action‑conditioned world models. It demonstrates that conventional metrics like FVD, LPIPS, and JEDi do not reliably predict playability, using CounterStrike data to show divergent model performance despite similar scores. By providing curation strategies and diagnostic tools, the SDK helps uncover root causes of the gap and accelerate the creation of sample‑efficient training datasets.