Rollback: Experience Backtracking in World Models for Policy Improvement
Read the original on arXiv AI →The paper introduces Rollback, a method that uses action‑conditioned world models to backtrack to critical decision points, branch into alternative actions, and compare outcomes to attribute success to individual decisions. By turning world models into counterfactual engines, Rollback provides fine‑grained, action‑level supervision without a separate value model and integrates distributed world‑model search with asynchronous real‑robot execution. Experiments on block extraction, ball tossing, and tabletop curling show that Rollback improves success rates by over 10% compared to the strongest baseline and surpasses human performance on two tasks within eight hours of training.
Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.