← Back to all news
arXiv Computer Vision By Ruicong Liu, Liangyang Ouyang, Fengbo Lan, Zhixiang Wang, Kaipeng Zhang

AnyGameRenderer: Entity-Consistent Generative Rendering Across Games and an Entity-Level Benchmark

Read the original on arXiv Computer Vision →

AnyGameRenderer is a video‑to‑video generative renderer that transforms low‑quality, AI‑generated game footage—such as gray blockouts and colored primitives—into high‑quality visuals with detailed characters, motion, and effects while preserving layout, camera, and entity positions. It works across diverse game genres (tower defense, auto‑battlers, top‑down survivors, turn‑based battles, kart racing, crowd runners) and accepts plain video inputs without requiring complex engine data. Trained on ~10k paired clips from agent‑made games, Unreal Engine simulations, and real gameplay, it improves entity correspondence, raising temporal match from 50.9% to 62.9% and reducing missed count changes from 34.7% to 21.3%.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Related stories

arXiv Computer Vision
Oct 28

GTASA: Ground Truth Annotations for Spatiotemporal Analysis, Evaluation and Training of Video Models

GTASA: Ground Truth Annotations for Spatiotemporal Analysis, Evaluation and Training of Video Models presents GEST-Engine, an open‑source system that deterministically renders multi‑actor video scenarios while recording exhaustive ground truth—including 3D entity and camera states, pairwise spatial relations, event‑to‑frame mappings, instance segmentation, and long descriptions—at no extra annotation cost. The authors release a 938‑video dataset, GTASA, which offers the densest spatial‑relation coverage of any video dataset, with an entity‑pair relation graph at every frame that is roughly 84× denser than current state‑of‑the‑art collections. They demonstrate the dataset’s value by showing that pretraining on GTASA improves VideoLLaMA3 captioning, and by using it to probe frozen video encoders on 11 spatio‑temporal tasks, revealing that relational understanding remains near chance. whyItMatters":"The dataset provides a uniquely dense, exact 3D ground truth for spatio‑temporal video analysis, enabling measurable progress in training and evaluating video models on relational reasoning tasks."

By Nicolae Cudlenco, Mihai Masala, Marius Leordeanu
computer-visionbenchmarkssafety
More like this →
arXiv Computer Vision
Oct 21

Matrix-Game 4.0: Harnessing Video Models for Real-Time Playable Game Worlds

arXiv:2610.27999v1 Announce Type: new Abstract: Moving from controllable videos to genuinely playable worlds requires persistent world state, executable game rules, and low-latency interaction. We ou...

By Jihai Zhang, Runjia Qian, Kaiqin Kong, Biao Jiang, Puyi Wang, Siru Chen, Tianle Li, Guanjie Chen, Junyi Wu, Chubin Chen, Yuanhang Li, Kaichen Huang, Haobo Zhang, Yangguang Li, Wei Yu, Guibin Chen, Yu Cheng, Yahui Zhou
agentsefficiencymultimodal
More like this →
arXiv Computer Vision
Oct 28

BoxWorld: Let World Engines Control and Video Generators Render

BoxWorld introduces a novel approach to real‑time interactive video worlds by decoupling interaction reasoning from generative rendering. A coding agent builds a Box World Engine that applies user‑defined rules to determine interaction outcomes and exposes object states via a lightweight interface of layout boxes, persistent attributes, and dynamic status variables. A separate Box‑State Generative Renderer then autoregressively renders these evolving states into video, enabling online control over object motion, state switches, and conditional events. The system employs a three‑stage training strategy—learning object grounding from open‑domain videos, state transitions from gameplay videos, and rollout distillation on self‑generated histories—to handle real‑time state updates while maintaining visual coherence. BoxWorld outperforms end‑to‑end world models and remains competitive across multiple public benchmarks, with a new PairedStateBench benchmark for fine‑grained interaction control.

By Zike Wu, Ahmed Hatem, Chintan Trivedi, Wallace Michel Pinto Lira, Xuebin Qin, Lele Wang, Renjie Liao
agentsefficiencybenchmarks
More like this →