arXiv Computer Vision
Nov 9

On Agentic Manipulation Policies

The paper introduces Agentic Manipulation Policies (AMPs), where a generalist AI model directly controls a robot manipulator without task‑specific training or demonstrations. AMP1, a reference harness, achieves state‑of‑the‑art zero‑shot success rates on RoboLab‑120 and CaP‑Gym, outperforming specialist vision‑language‑action and world‑action models. The agent autonomously develops strategies such as searching for hidden objects and using tools, and adding a persistent memory further reduces failure rates on bimanual tasks.

By Chen Chen, Omid Bagherieh, Naveen Nikamanth Appiah Balaji, Jesse T. Gonzalez, Negin Heravi, Fahad Islam, Xueting Li, Jean-Baptiste Regli, Kejia Ren, Petr \v{S}vec, David J. Yoon, Matthias M\"uller, Vladlen Koltun
arXiv AI
Sep 25

World Action Agent: Harnessing VLMs for Robot Manipulation via World Action Rehearsal

World Action Agent (WAA) is a multi‑agent framework that lets vision‑language models (VLMs) directly pilot robots by operating within a visual action workspace. The workspace provides automatically selected contact views, editable action rehearsals, and in‑view correction to refine decisions before low‑level execution. WAA learns procedural skills from expert videos and human teaching, and its interaction traces can train smaller VLMs, achieving state‑of‑the‑art success on LIBERO‑Pro and improving out‑of‑domain performance on robosuite and Qwen3.5‑9B.

By Yehang Zhang, Haojian Huang, Yifan Chang, Jianchong Su, Bohan Zhou, Yingjie Xu, Wosong Chen, Tianhao Zhou, Chenxu Wang, Tianyi Zhang, Yangkai Wei, Wenqian Li, Shiyuan Deng, Yinchuan Li, Ying-Cong Chen, Zexi Li
Hugging Face Trending Papers
Nov 9

Embodied First Exam

The paper introduces the Embodied First Exam, a comprehensive evaluation framework for coding agents to control robots across diverse tasks and settings. It includes 1,156 tasks on 47 robots, spanning new domains such as spatial puzzles and multi-robot interaction, and offers three evaluation modes: Standard, Realtime, and Privileged. In the Standard setting, the best agent (GPT‑6 Astra in Codex) achieves only 34% success, highlighting significant room for improvement.

arXiv Computer Vision
Sep 30

EVO-WAM: Evolving World Action Models through Video-Action Verification

arXiv:2609.38057v1 Announce Type: new Abstract: Improving robot policies on new tasks without collecting additional expert demonstrations remains a central challenge in robot learning. World action m...

By Shiyang Zhou, Xionghao Wu, Wenbo Li, Shenghe Zheng, Jiyao Zhang, Songsong Yu, Yijun Yang, Jianhui Liu, Haoze Sun, Senqiao Yang, Li Jiang, Jingyong Su, Haoyang Huang, Zhuotao Tian