OnlineWM: Causality-Aware Active Online Learning for Effective World Modeling
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The paper introduces an action‑conditioned world‑modeling framework that turns Earth‑system simulator trajectories into training data for controllable state‑transition learning. By pretraining on naturally observed state changes as implicit action supervision and using masked response learning, the model can infer unobserved variables and learn coupled system dependencies. Experiments on ecosystem dynamics across six global regions demonstrate that the model maintains long‑horizon emulation accuracy while enabling structural interventions and coherent responses in coupled ecosystem‑cycle variables.
arXiv:2610.42096v1 Announce Type: cross Abstract: World action models (WAMs) learn latent variables from observations and use these to both predict the evolution of the scene and to generate actions....
The paper formalizes controllable user simulation as a causal inference problem, showing that standard supervised fine‑tuning on post‑hoc trajectory labels introduces a look‑ahead bias that breaks causal consistency. This bias leads to a phenomenon called controllability collapse, where evaluation metric variance explodes under policy shift. The authors propose theoretical conditions for accurate simulation and practical training mitigations—such as a priori controls, step‑wise dynamic controls, and direct policy‑conditioned learning—to eliminate look‑ahead bias, preserve natural variance, and achieve robust zero‑shot generalization to unseen agent behaviors.
TabCausal is a causal discovery foundation model that learns to map datasets directly to causal graphs by pretraining across diverse causal environments. It uses a dynamic task construction strategy to expose the model to varied graph priors, mechanisms, noise models, dimensions, sample sizes, and intervention regimes, improving transferability from observational and mixed‑interventional data. On large synthetic benchmarks and a new protocol‑guided semantic benchmark, TabCausal outperforms many classical baselines and shows robust structure recovery, especially when interventional evidence is available.
arXiv:2607. 27973v1 Announce Type: new Abstract: Recently, Reinforcement Learning (RL) has emerged as a crucial paradigm for the post-training of Large Language Model (LLM) agents.
The paper introduces AnyGoal, a benchmark that tests world models on goal‑shifted task variants where state and action factors are recombined beyond the combinations seen in expert rollouts. It evaluates how well different world‑model families generalize to these unseen recombinations across multiple environments, revealing consistent failures. The study analyzes dynamics and representation shortcomings to identify where current models succeed and where they struggle in goal‑shifted prediction and planning.