VIA: Visual Interface Agent for Robot Control
arXiv:2607. 11119v1 Announce Type: cross Abstract: Robot manipulation is a complex task that requires visual understanding, physical reasoning, planning, and closed-loop control.
arXiv:2607. 11119v1 Announce Type: cross Abstract: Robot manipulation is a complex task that requires visual understanding, physical reasoning, planning, and closed-loop control.
General-purpose agents increasingly write code, use tools, and complete complex digital tasks, raising the question of how far these capabilities carry into the physical world. To investigate this, we...
arXiv:2610.10409v1 Announce Type: cross Abstract: General-purpose agents increasingly write code, use tools, and complete complex digital tasks, raising the question of how far these capabilities car...
arXiv:2607. 15641v1 Announce Type: cross Abstract: Humans combine reasoning and motor control to solve complex manipulation tasks under diverse constraints.
The paper introduces a closed‑loop framework to evaluate frontier AI models on the LIBERO‑10 robot manipulation benchmark, allowing models to control a robot via visual inputs, proprioception, and tool calls without task‑specific fine‑tuning. Six models (GPT‑6 Astra, GPT‑6.1 Sol, GPT‑6 Luna, Claude Opus 5, Claude Opus 5.5, Gemini‑4 Argon) were tested across 18 configurations and 1,800 episodes, with GPT‑6 Astra achieving the highest success rate of 44%. Results show that higher reasoning effort generally improves performance, yet benefits vary by model and task, and many models struggle with precise spatial arrangements and complex multi‑step interactions.
The paper introduces Agentic Manipulation Policies (AMPs), where a generalist AI model directly controls a robot manipulator without task‑specific training or demonstrations. AMP1, a reference harness, achieves state‑of‑the‑art zero‑shot success rates on RoboLab‑120 and CaP‑Gym, outperforming specialist vision‑language‑action and world‑action models. The agent autonomously develops strategies such as searching for hidden objects and using tools, and adding a persistent memory further reduces failure rates on bimanual tasks.
Recent advances in frontier AI models have demonstrated remarkable capabilities in visual understanding, reasoning, planning, and tool use, raising the possibility of using general-purpose AI models f...
Recent advances in vision-language-action (VLA) and world-action models (WAMs) have significantly improved robotic manipulation, yet deploying robots in the open world demands a higher level of autono...
arXiv:2605. 31286v2 Announce Type: replace-cross Abstract: Real-world household robots require Vision-Language-Action (VLA) foundation models that can acquire reusable manipulation skills across diverse objects, task conditions, and household environments.
RAPID is a system that automatically generates, verifies, and refines robot programs from a single visual human demonstration. It infers a testable task specification, action primitives, and an interactive environment, using an object-centric relational program representation to enable reuse beyond the demonstration. The approach was evaluated in simulation on eight contact-rich manipulation tasks and successfully deployed on a real Franka arm, showing strong generalization across object pose, shape, material, and environment.
arXiv:2503. 22122v2 Announce Type: replace-cross Abstract: Vision-language models (VLMs) have demonstrated remarkable capabilities in robotic planning, particularly for long-horizon tasks that require a holistic understanding of the environment for task decomposition.
arXiv:2610.34649v1 Announce Type: cross Abstract: Recent advances in vision-language-action (VLA) and world-action models (WAMs) have significantly improved robotic manipulation, yet deploying robots...