ChainWorld: Composing Long-Horizon Desktop Workloads from Atomic OSWorld Tasks

ChainWorld is a new benchmark that composes atomic OSWorld tasks into long‑horizon desktop workloads, creating 347 chains of length two to four that compare two renderings of the same task sequence. In single‑turn evaluation all tasks are presented together in one prompt, while in multi‑turn evaluation tasks are revealed one at a time. Across four current computer‑use agents, maximum chain completion is 31 %, with multi‑turn evaluation improving completion for three models but both protocols remaining challenging and exposing different failure profiles.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

• agents