arXiv AI By Yukuan Lu, Zaishuo Xia, Weyl Lu, Yubei Chen

Concept-Guided Spatial Regularization for World Models in Atari Pong

Read the original on arXiv AI →

arXiv:2607. 15142v1 Announce Type: new Abstract: World models are usually evaluated as components of model-based reinforcement learning (MBRL) systems, while the world models themselves are rarely studied in isolation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 7

Improving Weak World Models Behind Strong Agents in Atari Pong

The paper investigates the discrepancy between strong agents and their underlying weak world models in Atari Pong by reproducing five visual world-model agents and evaluating their frozen models. Closed‑loop rollouts reveal visual and dynamical failures such as ball disappearance and incorrect motion, while zero‑shot model‑based RL policies trained entirely within the frozen models perform poorly compared to the original agents. To address these issues, the authors introduce Concept‑Guided Spatial Regularization (CGSReg), an auxiliary loss focused on task‑critical ball regions, which improves both pixel‑space zero‑shot MBRL performance and closed‑loop rollouts for several agents.

By Yukuan Lu, Zaishuo Xia, Weyl Lu, Yubei Chen
arXiv AI
Jun 30

WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL

arXiv:2602. 13977v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) promises to unlock capabilities beyond imitation learning for Vision--Language--Action (VLA) models, but its requirement for massive real-world interaction prevents direct deployment on physical robots.

By Zhennan Jiang, Shangqing Zhou, Yutong Jiang, Zefang Huang, Mingjie Wei, Yuhui Chen, Tianxing Zhou, Zhen Guo, Hao Lin, Quanlu Zhang, Yu Wang, Haoran Li, Chao Yu, Dongbin Zhao