Holo1: New family of GUI automation VLMs powering GUI agent Surfer-H
Related stories
Smol2Operator: Post-Training GUI Agents for Computer Use
ScreenSuite - The most comprehensive evaluation suite for GUI Agents!
Terminal Agents Suffice for Enterprise Automation
arXiv:2604. 00073v3 Announce Type: replace-cross Abstract: There has been growing interest in building agents that can interact with digital platforms to execute meaningful enterprise tasks autonomously.
VLAA-GUI: Knowing When to Stop, Recover, and Search, A Modular Framework for GUI Automation
VLAA-GUI is a modular framework for autonomous GUI agents that addresses early stopping and repetitive loops by integrating three core components: a Completeness Verifier, a Loop Breaker, and an on-demand Search Agent. The framework also includes optional Coding and Grounding Agents for specialized tasks. Evaluations on five backbones across Linux and Windows benchmarks show strong performance, with some models surpassing human results and the Loop Breaker significantly reducing wasted steps.
Software Engineering for and with GUI Agent
arXiv:2608. 09278v1 Announce Type: cross Abstract: GUI agents have advanced rapidly, producing a growing body of frameworks, benchmarks, and applications.
OmegaUse-SOP: SOP Engineering for Professional Computer Use from Human Demonstrations
OmegaUse‑SOP is a human‑in‑the‑loop system that transforms expert demonstrations of professional computer use into reusable skills for graphical user interface (GUI) agents. It refines demonstrations through four modules—Observe, Reason, Configure, and Execute—to record multimodal traces, abstract them into semantic steps, incorporate domain rules, and execute the resulting skills with verification. In a collaboration with a power‑sector client, OmegaUse‑SOP was tested on photovoltaic simulation workflows in PVsyst 7.2, showing improved reliability for GUI agents on professional SOP tasks.
Holo3.1: Fast & Local Computer Use Agents
AgentGUI: An Interface for Observing and Steering Long-Running AI Agents
arXiv:2607. 26300v1 Announce Type: cross Abstract: AI agents are increasingly adept at tackling complex, long-running tasks.
ScaleWoB: Guiding GUI Agents with Coding Agents via Large-Scale Environmental Synthesis
arXiv:2605. 25160v2 Announce Type: replace Abstract: GUI agents powered by large language models are advancing rapidly, creating urgent needs for evaluation and training based on realistic environments.
Orchestrating Power Grid Studies with Multi-Agent AI and MCP Servers
arXiv:2607. 14158v1 Announce Type: new Abstract: This position paper explores how Agentic AI and Model Context Protocol (MCP) can support power-grid studies in a Transmission System Operator (TSO) context.
Syll: Open-Source Personal Automation with Cross-Surface Execution
arXiv:2606. 07594v1 Announce Type: new Abstract: Personal AI agents must increasingly operate across APIs, shells, web surfaces, and desktop GUIs, yet many systems remain tuned to a single interface and offer limited support for user teaching and auditability.