Right Screen, Wrong Transition: World Models as Verifiers for GUI Agents

The paper introduces LGWM, a decoder‑free, action‑conditioned world model that predicts the representation of the next GUI screen directly, enabling efficient verification of transitions without semantic annotation. By comparing predicted and observed representations, the model achieves high AUC scores on the RSWT‑BENCH diagnostic, outperforming existing generative world models and matching closed‑source VLMs while operating at much lower latency. The study demonstrates that world models can serve a third role—verification—by predicting in representation space rather than generating text, code, or images.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

• agents
• safety