arXiv AI

RoboHarness: A Simple Harness Outperforms VLA and World Actions Models

arXiv AI
Oct 19

RoboHarness: A Simple Harness Outperforms VLA and World Action Models

The paper introduces RoboHarness, a simple robotic harness that equips large language models (LLMs) with a visual‑geometric control panel for direct manipulation of embodied tasks. By enabling LLM agents to understand and invoke actions without complex vision‑language‑action (VLA) training, RoboHarness allows models such as Qwen3.8‑Flash‑Next to outperform state‑of‑the‑art VLA models on the BEHAVIOR Challenge 2025 tasks. The authors provide an open‑source implementation of the system.

By Bince Qu, Wei Chen, Bo Zhang
arXiv AI
Jun 9

GEAR-VLA: Learning Geometry-Aware Action Representations for Generalizable Robotic Manipulation

arXiv:2606. 08530v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models achieve strong benchmark performance but still struggle in real-world deployment with unseen objects, background shifts, and different robot embodiments.

By Yuan Zhang, Shiqi Zhang, Yedong Shen, Shuai Dong, Jiajun Deng, Xin Zhang, Yuxuan Gao, Jiajia Wu, Xin Nie, Zhiyuan Cheng, Jianmin Ji, Yanyong Zhang, Xingyi Zhang, Jia Pan
arXiv AI
Jul 3

CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulation

arXiv:2603. 22435v2 Announce Type: replace-cross Abstract: "Code-as-Policy" considers how executable code can complement data-intensive Vision-Language-Action (VLA) methods, yet their effectiveness as autonomous controllers for embodied manipulation remains underexplored.

By Letian Fu, Justin Yu, Karim El-Refai, Ethan Kou, Haoru Xue, Huang Huang, Wenli Xiao, Guanzhi Wang, Dantong Niu, Fei-Fei Li, Guanya Shi, Jiajun Wu, Shankar Sastry, Yuke Zhu, Ken Goldberg, Linxi "Jim" Fan
Hugging Face Trending Papers
4d ago

BURGER: Benchmarking and Understanding Robotic Generalization via Embodied Drawing

BURGER is a language‑conditioned robotic drawing benchmark that uses a prompt‑driven pipeline to generate continuous drawing trajectories in both simulation and the real world. The benchmark provides 28,200 simulated demonstrations across 282 tasks, allowing evaluation of vision‑language‑action models on data scale, language grounding, and multimodal behavior. Experiments show that some models improve with more diverse data, capture complex drawing behaviors, and generalize to unseen compositions, with a trained policy successfully deployed on a Franka Panda arm.

arXiv AI
3d ago

BURGER: Benchmarking and Understanding Robotic Generalization via Embodied Drawing

BURGER is a benchmark for evaluating vision‑language‑action models on robotic drawing tasks. It provides a scalable, prompt‑driven pipeline that generates continuous drawing trajectories in both simulation and the real world, with 28,200 simulated demonstrations across 282 tasks. The benchmark enables fine‑grained analysis of language grounding, spatial composition, and action generation, revealing distinct failure patterns among five representative VLA models and demonstrating that some models can generalize to unseen compositions and scale with task diversity.

By Xiangyu Xu, Bangshuai Peng, Ziyi Liu, Mengjie Zhao, Chenhao Lu, Zhengyang Fan, Huazhe Xu, Kaizhe Hu
arXiv AI
Jun 30

RoboGaze: Evaluating Robot World Models via Structured Vision-Language Analysis

arXiv:2606. 28385v1 Announce Type: cross Abstract: Recent advances in robot world models enable synthetic video generation for embodied prediction and planning.

By Minh-Loi Nguyen, Nghiem Tuong Diep, Hung Khang Nguyen, Minh Le, Doanh Le Thien, Hoang H. Tran, Dung D. Le, Vu N. Duong, Daniel Sonntag, An Thai Le, Duy Minh Ho Nguyen, Vien Anh Ngo, Tran Van Nhiem
arXiv AI
Sep 7

RoboSPA: Can VLA Models Go Beyond Simple Scenes and Short-Horizon Tasks?

RoboSPA is a large-scale robotic manipulation dataset and benchmark designed to evaluate Vision‑Language‑Action models on fine‑grained spatial reasoning and long‑horizon procedural planning. It contains 10 task categories, 56 base tasks, and 280 variants across five difficulty levels, with 527K trajectories collected from multiple embodiments and scenes. The benchmark introduces diagnostic metrics beyond binary success, revealing that current VLA models struggle with complex spatial relations, precise execution, and memory‑intensive planning.

By Zhenxuan Fan, Bo Zhang, Yutong Lin, Yuqian Yuan, Juekai Lin, Liang Liang, Zhuoyi Huang, Wenqiao Zhang, Juncheng Li, Siliang Tang, Jun Xiao, Yueting Zhuang