arXiv AI By Xiangyu Xu, Bangshuai Peng, Ziyi Liu, Mengjie Zhao, Chenhao Lu, Zhengyang Fan, Huazhe Xu, Kaizhe Hu

BURGER: Benchmarking and Understanding Robotic Generalization via Embodied Drawing

Read the original on arXiv AI →

BURGER is a benchmark for evaluating vision‑language‑action models on robotic drawing tasks. It provides a scalable, prompt‑driven pipeline that generates continuous drawing trajectories in both simulation and the real world, with 28,200 simulated demonstrations across 282 tasks. The benchmark enables fine‑grained analysis of language grounding, spatial composition, and action generation, revealing distinct failure patterns among five representative VLA models and demonstrating that some models can generalize to unseen compositions and scale with task diversity.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Hugging Face Trending Papers
4d ago

BURGER: Benchmarking and Understanding Robotic Generalization via Embodied Drawing

BURGER is a language‑conditioned robotic drawing benchmark that uses a prompt‑driven pipeline to generate continuous drawing trajectories in both simulation and the real world. The benchmark provides 28,200 simulated demonstrations across 282 tasks, allowing evaluation of vision‑language‑action models on data scale, language grounding, and multimodal behavior. Experiments show that some models improve with more diverse data, capture complex drawing behaviors, and generalize to unseen compositions, with a trained policy successfully deployed on a Franka Panda arm.

arXiv AI
Oct 19

RoboHarness: A Simple Harness Outperforms VLA and World Action Models

The paper introduces RoboHarness, a simple robotic harness that equips large language models (LLMs) with a visual‑geometric control panel for direct manipulation of embodied tasks. By enabling LLM agents to understand and invoke actions without complex vision‑language‑action (VLA) training, RoboHarness allows models such as Qwen3.8‑Flash‑Next to outperform state‑of‑the‑art VLA models on the BEHAVIOR Challenge 2025 tasks. The authors provide an open‑source implementation of the system.

By Bince Qu, Wei Chen, Bo Zhang
arXiv AI
Jun 2

From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data

arXiv:2606. 00054v1 Announce Type: cross Abstract: Recent progress in generalizable embodied control has been driven by large-scale pretraining of Vision-Language-Action (VLA) models.

By Zhiyuan Feng, Qixiu Li, Huizhi Liang, Rushuai Yang, Yichao Shen, Zhiying Du, Zhaowei Zhang, Yu Deng, Li Zhao, Hao Zhao, Zongqing Lu, Oier Mees, Marc Pollefeys, Jiaolong Yang, Baining Guo