arXiv Computer Vision

Show-Harness: Just a VLM Agent Can Play Robots

arXiv AI
Jul 3

CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulation

arXiv:2603. 22435v2 Announce Type: replace-cross Abstract: "Code-as-Policy" considers how executable code can complement data-intensive Vision-Language-Action (VLA) methods, yet their effectiveness as autonomous controllers for embodied manipulation remains underexplored.

By Letian Fu, Justin Yu, Karim El-Refai, Ethan Kou, Haoru Xue, Huang Huang, Wenli Xiao, Guanzhi Wang, Dantong Niu, Fei-Fei Li, Guanya Shi, Jiajun Wu, Shankar Sastry, Yuke Zhu, Ken Goldberg, Linxi "Jim" Fan
arXiv AI
Oct 19

RoboHarness: A Simple Harness Outperforms VLA and World Action Models

The paper introduces RoboHarness, a simple robotic harness that equips large language models (LLMs) with a visual‑geometric control panel for direct manipulation of embodied tasks. By enabling LLM agents to understand and invoke actions without complex vision‑language‑action (VLA) training, RoboHarness allows models such as Qwen3.8‑Flash‑Next to outperform state‑of‑the‑art VLA models on the BEHAVIOR Challenge 2025 tasks. The authors provide an open‑source implementation of the system.

By Bince Qu, Wei Chen, Bo Zhang
arXiv Computer Vision
Sep 17

In-Context Robot Learning with VLM Agents

arXiv:2609.19138v1 Announce Type: new Abstract: Enabling robots to adapt to unfamiliar environments as readily as humans remains a moonshot goal of embodied AI. No finite collection of demonstrations...

By Dongzhou Cheng, Taoran Yi, Ye Fang, Xingwu Zhang, Fan Feng, Yixuan Li, Gengxiong Zhuang, Rongze Wang, Shuai Yang, Wei Song, Weizhi Xue, Minyan Wu, Jie Gui, Jiaqi Wang, Tong Wu
arXiv AI
Jun 9

GEAR-VLA: Learning Geometry-Aware Action Representations for Generalizable Robotic Manipulation

arXiv:2606. 08530v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models achieve strong benchmark performance but still struggle in real-world deployment with unseen objects, background shifts, and different robot embodiments.

By Yuan Zhang, Shiqi Zhang, Yedong Shen, Shuai Dong, Jiajun Deng, Xin Zhang, Yuxuan Gao, Jiajia Wu, Xin Nie, Zhiyuan Cheng, Jianmin Ji, Yanyong Zhang, Xingyi Zhang, Jia Pan
arXiv AI
Oct 27

Profiling a Frontier Agent with EBench: From Direct Control to Harness with Policy

The report evaluates the GPT-6-Astra multimodal large language model (MLLM) on the EBench platform, comparing two agent configurations: direct control, where the agent generates waypoint commands, and harness with policy, where it can invoke post‑trained vision‑language‑action (VLA) or world action model (WAM) policies. Direct control performs competitively overall, excelling on short‑horizon tasks and showing stable generalization, but falls behind on long‑horizon, tabletop, and high‑precision contact‑rich tasks. The harness with policy approach combines the strengths of both components, achieving success rates comparable to the best post‑trained policies while reducing token cost, yet still lags behind the standalone upper bounds due to suboptimal policy invocation and execution issues.

By Yifei Yao, Yude Zou, Guanbo Jiao, Xing Gao, Ning Gao, Yukai Wang, Jiantong Chen, Zihou Zhu, Xinyu Li, Ningyu Yan, Shuai Wang, Jianming Ma, Haoyu Guo, Weinan Zhang, Chunhua Shen