arXiv Machine Learning By Pardis Taghavi, Tingyu Guo, Jonas Lossner, Gaurav Pandey, Reza Langari

ActionSplice: In-Flight Action Editing for Interactive World Models

Read the original on arXiv Machine Learning →

ActionSplice is an inference framework for chunk‑autoregressive video world models that allows in‑flight action editing without re‑sampling completed evaluations. It formulates the problem as Counterfactual State Transport (CST), using a lightweight corrector to move the backbone representation toward the state induced by a revised action at the same solver step. Two variants, CST*R and CST*T, update either the entire active chunk or only its suffix, achieving significant reductions in rollback‑relative LPIPS and providing speedups over waiting.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Hugging Face Trending Papers
Sep 8

Hi-FLoop: Hierarchical State-Feedback Loops for Multi-Timescale World Modeling

Hi-FLoop introduces a hierarchical state‑feedback framework for multi‑agent traffic simulation that reconciles decision time scales over an 8‑second rollout. The model uses eight scene‑level Worlds to maintain joint hypotheses, with an 8‑second Goal, 2‑second Preview, and 1‑second Control hierarchy, and commits only executed prefixes every 0.5 seconds to preserve factual consistency. A joint preview interaction graph and a prefix‑frozen A‑to‑B cascade enable sparse interaction refinement and accurate state recovery, achieving an overall score of 0.689987 on the H‑D public‑validation split and strong oracle‑minADE performance. whyItMatters":"The paper presents a novel multi‑timescale approach that improves consistency and realism in long‑horizon traffic simulations, as evidenced by its competitive evaluation metrics."

arXiv Computer Vision
Oct 28

How Much Can Best-of-N Help a World Action Model? Measuring Selectable Headroom and Realizing It in Closed Loop

The paper introduces a denoised counterfactual protocol to accurately measure the selectable headroom of world action models (WAMs) and uses these measurements to build a fail‑gated selector. Across four WAMs and two benchmarks, the study shows that the standard estimate overstates selectable headroom, that structured action perturbations can add up to 16 points of headroom, and that imagined futures retain candidate‑outcome information without loss. The selector improves closed‑loop task success from 76.9 % to 81.6 % on held‑out training episodes and from 62.6 % to 69.8 % on unseen tasks.

By Haojia Gao, Yue Cao, Yumin Liu, Haohua Que, Mingkai Liu, Guanqiu Guo, Zhuo Zou, Bokui Chen, Xueqian Wang
arXiv Computer Vision
Sep 4

Do Video Generators Track the World Across Segments? A Benchmark and Method for World-State Reasoning in Video Continuation

The paper introduces Statebench, a benchmark for evaluating how well video generators track world states across segments, focusing on past-visible, occluded-process, and complex-transition states. It also proposes Stateagent, a method that maintains an explicit entity-state representation, updates it with new prompts, and uses the resulting state to guide video continuation. Experiments show Stateagent raises the overall state score from 45.2 to 69.3 and improves one‑minute story generation.

By Yingmao Miao, Pengfei Zhang, Chaoran Xu, Meng Yu, Jing Tang, Xiangxiang Chu, Chao Shen, Chenhao Lin