VIA: Visual Interface Agent for Robot Control
arXiv:2607. 11119v1 Announce Type: cross Abstract: Robot manipulation is a complex task that requires visual understanding, physical reasoning, planning, and closed-loop control.
World Action Agent (WAA) is a multi‑agent framework that lets vision‑language models (VLMs) directly pilot robots by operating within a visual action workspace. The workspace provides automatically selected contact views, editable action rehearsals, and in‑view correction to refine decisions before low‑level execution. WAA learns procedural skills from expert videos and human teaching, and its interaction traces can train smaller VLMs, achieving state‑of‑the‑art success on LIBERO‑Pro and improving out‑of‑domain performance on robosuite and Qwen3.5‑9B.
arXiv:2607. 11119v1 Announce Type: cross Abstract: Robot manipulation is a complex task that requires visual understanding, physical reasoning, planning, and closed-loop control.
The paper introduces Agentic Manipulation Policies (AMPs), where a generalist AI model directly controls a robot manipulator without task‑specific training or demonstrations. AMP1, a reference harness, achieves state‑of‑the‑art zero‑shot success rates on RoboLab‑120 and CaP‑Gym, outperforming specialist vision‑language‑action and world‑action models. The agent autonomously develops strategies such as searching for hidden objects and using tools, and adding a persistent memory further reduces failure rates on bimanual tasks.
arXiv:2601. 20334v2 Announce Type: replace-cross Abstract: Robotic manipulation has increasingly adopted vision-language-action (VLA) models, which achieve strong performance but typically require task-specific demonstrations and fine-tuning, and often generalize poorly under domain shift.
arXiv:2605.13119v2 Announce Type: replace-cross Abstract: Vision-language-action (VLA) models are effective robot action executors, but they remain limited on long-horizon tasks due to the dual burde...
The report evaluates the GPT-6-Astra multimodal large language model (MLLM) on the EBench platform, comparing two agent configurations: direct control, where the agent generates waypoint commands, and harness with policy, where it can invoke post‑trained vision‑language‑action (VLA) or world action model (WAM) policies. Direct control performs competitively overall, excelling on short‑horizon tasks and showing stable generalization, but falls behind on long‑horizon, tabletop, and high‑precision contact‑rich tasks. The harness with policy approach combines the strengths of both components, achieving success rates comparable to the best post‑trained policies while reducing token cost, yet still lags behind the standalone upper bounds due to suboptimal policy invocation and execution issues.
arXiv:2609.37810v1 Announce Type: cross Abstract: Vision-language-action and world-action models have demonstrated impressive capabilities in robotics, yet generalization to unseen tasks remains chal...
arXiv:2608. 14047v1 Announce Type: cross Abstract: This paper integrates end-to-end Visual-Language-Action (VLA) models with agentic tool-use to propose Agentic Robot with Tool-use (ART).
RoboSPA is a large-scale robotic manipulation dataset and benchmark designed to evaluate Vision‑Language‑Action models on fine‑grained spatial reasoning and long‑horizon procedural planning. It contains 10 task categories, 56 base tasks, and 280 variants across five difficulty levels, with 527K trajectories collected from multiple embodiments and scenes. The benchmark introduces diagnostic metrics beyond binary success, revealing that current VLA models struggle with complex spatial relations, precise execution, and memory‑intensive planning.
arXiv:2508.13073v3 Announce Type: replace-cross Abstract: Robotic manipulation, a key frontier in robotics and embodied AI, requires precise motor control and multimodal understanding, yet traditiona...
arXiv:2607. 05377v1 Announce Type: cross Abstract: While recent Vision-Language-Action (VLA) models show promise toward generalist manipulation policies, they struggle with long-horizon tasks due to their Markovian nature-relying solely on current observations.
The paper introduces GTA‑VLA, an interactive Vision‑Language‑Action framework that lets users guide robot policies with explicit visual cues such as affordance points, boxes, and traces. Unlike traditional direct sense‑to‑act models, GTA‑VLA incorporates a spatial‑visual Chain‑of‑Thought that blends human guidance with internal task planning, and couples this reasoning module with a lightweight reactive action head for efficient execution. Experiments on the SimplerEnv WidowX benchmark show a state‑of‑the‑art 81.2 % success rate, and the framework significantly improves task success under out‑of‑domain visual shifts and spatial ambiguities, demonstrating the benefit of interactive reasoning for failure recovery in embodied control.
EmbodiedSkills is a skill-based agent framework that enhances frozen vision‑language‑action (VLA) policies with world action models for consequence‑aware action selection. It defines reusable skills for observation, context encoding, candidate generation, consequence prediction, outcome evaluation, candidate comparison, and action execution, organized into five stages that support both continuous action chunks and pick‑and‑place primitives. The framework improves success rates on MetaWorld MT50, CLIPort, and CALVIN benchmarks by incorporating outcome predictions and lightweight comparators while keeping the core policy and observation encoders frozen.