arXiv AI

BURGER: Benchmarking and Understanding Robotic Generalization via Embodied Drawing

BURGER is a benchmark for evaluating vision‑language‑action models on robotic drawing tasks. It provides a scalable, prompt‑driven pipeline that generates continuous drawing trajectories in both simulation and the real world, with 28,200 simulated demonstrations across 282 tasks. The benchmark enables fine‑grained analysis of language grounding, spatial composition, and action generation, revealing distinct failure patterns among five representative VLA models and demonstrating that some models can generalize to unseen compositions and scale with task diversity.

Hugging Face Trending Papers
4d ago

BURGER: Benchmarking and Understanding Robotic Generalization via Embodied Drawing

BURGER is a language‑conditioned robotic drawing benchmark that uses a prompt‑driven pipeline to generate continuous drawing trajectories in both simulation and the real world. The benchmark provides 28,200 simulated demonstrations across 282 tasks, allowing evaluation of vision‑language‑action models on data scale, language grounding, and multimodal behavior. Experiments show that some models improve with more diverse data, capture complex drawing behaviors, and generalize to unseen compositions, with a trained policy successfully deployed on a Franka Panda arm.

arXiv AI
Oct 19

RoboHarness: A Simple Harness Outperforms VLA and World Action Models

The paper introduces RoboHarness, a simple robotic harness that equips large language models (LLMs) with a visual‑geometric control panel for direct manipulation of embodied tasks. By enabling LLM agents to understand and invoke actions without complex vision‑language‑action (VLA) training, RoboHarness allows models such as Qwen3.8‑Flash‑Next to outperform state‑of‑the‑art VLA models on the BEHAVIOR Challenge 2025 tasks. The authors provide an open‑source implementation of the system.

By Bince Qu, Wei Chen, Bo Zhang
arXiv AI
Jun 2

From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data

arXiv:2606. 00054v1 Announce Type: cross Abstract: Recent progress in generalizable embodied control has been driven by large-scale pretraining of Vision-Language-Action (VLA) models.

By Zhiyuan Feng, Qixiu Li, Huizhi Liang, Rushuai Yang, Yichao Shen, Zhiying Du, Zhaowei Zhang, Yu Deng, Li Zhao, Hao Zhao, Zongqing Lu, Oier Mees, Marc Pollefeys, Jiaolong Yang, Baining Guo
arXiv Computer Vision
Sep 23

MachEmbodied-U0: Unified Understanding and Generation Model for Embodied Intelligence

arXiv:2609.25627v1 Announce Type: cross Abstract: General-purpose robot control requires models to understand task intent, identify where to interact, capture how the scene evolves, and generate prec...

By Haoran Wen, Wenfu Wang, Kunsong Shi, Jingke Wang, Wancheng Feng, Yiren Zhang, Yueran Zhao, Xuancheng Zhang, Nanfei Ye, Xingru Chen, Zhaohong Sun, Chengmin Yang, Zikang Yu, Penghao Bi, Jia Shi, Yu Liu, Kun Zhan, Yan Xie
arXiv AI
Sep 18

JEPA-WAM: Connecting Generated Visual Instructions to World Action Models through JEPA Latent Representations

JEPA-WAM enhances World Action Models (WAMs) by pairing text instructions with stochastically generated visual cues, using a text-to-image generator and a frozen V‑JEPA encoder to create dense goal representations. These representations are compressed into goal tokens that condition both video and action experts via cross‑attention, enabling the model to better ground instructions. On a new real‑robot benchmark, JEPA‑WAM attains 87.3%, 74.5%, and 80.9% success rates across in‑distribution, out‑of‑distribution scenes, and out‑of‑distribution instructions, outperforming prior methods by significant margins.

By Tianbin Liu, Jian Zhu, Taiyi Su, Jianjun Zhang, Chong Ma, Zitai Huang, Yi Xu
arXiv AI
Oct 12

Decoupling the Declarative from the Procedural in Vision-Language-Action Models

The paper introduces w$^{2}$VLA, a Vision‑Language‑Action model that restructures information flow to separate declarative knowledge (concepts and entity semantics) from procedural knowledge (how to act). By modulating the robot state sequence with visual, spatial, and skill information in a compositional, interpretable way, the model achieves robust behavior cloning and unprecedented zero‑shot skill transfer to unseen objects, overcoming brittleness seen in current state‑of‑the‑art VLA models.

By Nikolaos Tsagkas, Andreas Sochopoulos, Chris Xiaoxuan Lu, Oisin Mac Aodha, Alexandros Kouris
arXiv AI
Jun 2

Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodiments

arXiv:2605. 30280v2 Announce Type: replace-cross Abstract: Embodied intelligence is often studied through specialized models for individual tasks such as manipulation or navigation, resulting in fragmented capabilities and limited generalization across tasks, environments, and robot embodiments.

By Qiuyue Wang, Mingsheng Li, Jian Guan, Jinhui Ye, Sicheng Xie, Yitao Liu, Junhao Chen, Zhixuan Liang, Jie Zhang, Xintong Hu, Xuhong Huang, Pei Lin, Junyang Lin, Dayiheng Liu, Shuai Bai, Jingren Zhou, Jiazhao Zhang, Haoqi Yuan, Gengze Zhou, Hang Yin, Ye Wang, Yiyang Huang, Zixing Lei, Wujian Peng, Delin Chen, Yingming Zheng, Jingyang Fan, Xianwei Zhuang, Xin Zhou, Haoyang Li, Anzhe Chen, Tong Zhang, Xuejing Liu, Yuchong Sun, Ruizhe Chen, Zhaohai Li, Chenxu L\"u, Zhibo Yang, Tao Yu, Xionghui Chen
arXiv Computer Vision
Oct 2

Guide, Think, Act: Interactive Embodied Reasoning in Vision-Language-Action Models

The paper introduces GTA‑VLA, an interactive Vision‑Language‑Action framework that lets users guide robot policies with explicit visual cues such as affordance points, boxes, and traces. Unlike traditional direct sense‑to‑act models, GTA‑VLA incorporates a spatial‑visual Chain‑of‑Thought that blends human guidance with internal task planning, and couples this reasoning module with a lightweight reactive action head for efficient execution. Experiments on the SimplerEnv WidowX benchmark show a state‑of‑the‑art 81.2 % success rate, and the framework significantly improves task success under out‑of‑domain visual shifts and spatial ambiguities, demonstrating the benefit of interactive reasoning for failure recovery in embodied control.

By Yiran Ling, Qing Lian, Jinghang Li, Qing Jiang, Tianming Zhang, Xiaoke Jiang, Chuanxiu Liu, Jie Liu, Lei Zhang