arXiv Machine Learning June 11, 2026 By Hyun Joe Jeong, Gokul Swamy, Andrea Bajcsy

Learning What to Say to Your VLA: Mostly Harmless Vision Language Action Model Steering

Read the original on arXiv Machine Learning →

arXiv:2606. 12299v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models provide a natural language interface to robot control, but the mapping from language to behavior is often brittle and unintuitive: semantically similar instructions can induce drastically different behaviors, while some capabilities may not be elicitable through prompting alone.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Jul 3

Restoring Linguistic Grounding in VLA Models via Train-Free Attention Recalibration

arXiv:2603. 06001v2 Announce Type: replace-cross Abstract: Vision-Language-Action (VLA) models enable robots to perform manipulation tasks directly from natural language instructions and are increasingly viewed as a foundation for generalist robotic policies.

By Ninghao Zhang, Bin Zhu, Shijie Zhou, Jingjing Chen

robotics multimodal benchmarks safety

arXiv AI

Jul 7

VLA Grounder: Language-Conditioning Space Optimization for Black-Box VLA Models

arXiv:2607. 04517v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models are commonly treated as end-to-end action policies conditioned on natural-language task descriptions.

By Damir Shodiev, Aleksei Staroverov, Nikita Kachaev, Alexey K. Kovalev, Aleksandr I. Panov

reinforcement-learning robotics multimodal

arXiv AI

Aug 6

Explicit Language Memory for Long-Horizon Planning in Vision-Language-Action Models

arXiv:2608. 04765v1 Announce Type: cross Abstract: Vision-language-action (VLA) models provide a unified paradigm for connecting visual perception, language understanding, and robotic control.

By Houze Xu, Jizhong Li, Ziyi Ye

llms nlp robotics fine-tuning multimodal

arXiv AI

Sep 1

Training-Free Action Correction for VLA Model Failures via Language Feedback

arXiv:2608.29967v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models demonstrate strong semantic understanding yet exhibit systematic failures during deployment. The conditions under...

By Owen Kwon, Pablo Ortega-Kral, Arthur Bucker, Jean Oh

robotics multimodal

Hugging Face Trending Papers

Jul 5

VLA Grounder: Language-Conditioning Space Optimization for Black-Box VLA Models

Vision-Language-Action (VLA) models are commonly treated as end-to-end action policies conditioned on natural-language task descriptions. In practice, however, their behavior often depends sharply on how the instruction is phrased, suggesting that language is not merely a task label but an optimizable conditioning input.

reinforcement-learning robotics multimodal

arXiv AI

Jun 16

FineVLA: Fine-Grained Instruction Alignment for Steerable Vision-Language-Action Policies

arXiv:2605. 27284v2 Announce Type: replace-cross Abstract: Vision-Language-Action (VLA) models are increasingly expected to not only complete robot tasks, but also follow human instructions about how those tasks should be executed.

By Xintong Hu, Xuhong Huang, Jinyu Zhang, Yutong Yao, Yuchong Sun, Qiuyue Wang, Mingsheng Li, Sicheng Xie, Yitao Liu, Junhao Chen, Yixuan Chen, Yingming Zheng, Shuai Bai, Tao Yu

robotics multimodal benchmarks safety

One email a morning, machine-written

Related stories

Restoring Linguistic Grounding in VLA Models via Train-Free Attention Recalibration

VLA Grounder: Language-Conditioning Space Optimization for Black-Box VLA Models

Explicit Language Memory for Long-Horizon Planning in Vision-Language-Action Models

Training-Free Action Correction for VLA Model Failures via Language Feedback

VLA Grounder: Language-Conditioning Space Optimization for Black-Box VLA Models

FineVLA: Fine-Grained Instruction Alignment for Steerable Vision-Language-Action Policies