arXiv AI

Recompose and Refine Latent Reasoning Flows for Vision-Language-Action Models

The paper introduces Reasoning and Flow Memory (FLOWMEM), a vision‑language‑action model that reuses successful latent reasoning steps instead of discarding them after each policy query. FLOWMEM dynamically retrieves and recomposes compatible latent fragments to form a reasoning route that aligns with the temporal structure of prior successful computations, then refines this route with current visual and proprioceptive data before generating actions. Experiments on RoboMME and LIBERO‑Plus show that FLOWMEM improves success rates by 1.7 and 4.1 percentage points over memory‑free policies, demonstrating the benefit of reusing latent computation for closed‑loop control.

Hugging Face Trending Papers
Jul 9

LEEVLA: Seeing What Matters in Latent Environment Evolution for Vision-Language-Action

Vision-language-action (VLA) models aim to map multimodal inputs to robot actions. However, most existing approaches struggle to cover complex dynamic scenarios due to treating all visual tokens uniformly and reasoning with human-selected factors, which lack mechanisms to emphasize task-critical evidence and ignore underlying factors.

arXiv AI
Jun 16

LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies

arXiv:2606. 15768v1 Announce Type: cross Abstract: Vision-Language-Action models (VLAs) leverage large-scale vision-language pretraining for semantic robot control, but often lack explicit foresight into how robot actions change the scene.

By Jialei Chen, Kai Wang, Kang Chen, Shuaihang Chen, Feng Gao, Wenhao Tang, Zhiyuan Li, Weilin Liu, Zhuyu Yao, Boxun Li, Yuanbo Xu, Chao Yu
arXiv Computer Vision
Oct 2

Guide, Think, Act: Interactive Embodied Reasoning in Vision-Language-Action Models

The paper introduces GTA‑VLA, an interactive Vision‑Language‑Action framework that lets users guide robot policies with explicit visual cues such as affordance points, boxes, and traces. Unlike traditional direct sense‑to‑act models, GTA‑VLA incorporates a spatial‑visual Chain‑of‑Thought that blends human guidance with internal task planning, and couples this reasoning module with a lightweight reactive action head for efficient execution. Experiments on the SimplerEnv WidowX benchmark show a state‑of‑the‑art 81.2 % success rate, and the framework significantly improves task success under out‑of‑domain visual shifts and spatial ambiguities, demonstrating the benefit of interactive reasoning for failure recovery in embodied control.

By Yiran Ling, Qing Lian, Jinghang Li, Qing Jiang, Tianming Zhang, Xiaoke Jiang, Chuanxiu Liu, Jie Liu, Lei Zhang
arXiv AI
Oct 9

ExecVLA: Following Fine-Grained Execution Constraints in Vision-Language-Action Models with Bi-Level Action Representation

The paper introduces ExecVLA, a framework for vision‑language‑action models that separates goal‑oriented behavior from execution‑specific constraints using a bi‑level action representation and supervised reasoning tokens. It adds explicit objectives to keep goal representations stable while preserving execution constraints, and builds datasets with fine‑grained reasoning annotations in simulation and on a Realman‑75 robot. Experiments on LIBERO and the real robot demonstrate better goal completion and notably more reliable adherence to instruction‑specified execution constraints.

By Gaoge Han, Zhengqing Gao, Ziwen Li, Jiaxin Huang, Shaoli Huang, Fakhri Karray, Mingming Gong, Tongliang Liu