arXiv AI
Aug 7

Hijacking Robots with a Piece of Paper: A Systematic Study of Physical Prompt Injection in VLM-Controlled Robots

arXiv:2608. 05715v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) are increasingly deployed as planners in robotic systems, where they translate natural-language commands into executable actions grounded in visual scene understanding.

By S. M . Bhagya P. Samarakoon, M. A. Viraj J. Muthugala, W. K. R. Sachinthana, Mohan Rajesh Elara
arXiv Computer Vision
Aug 28

TrapVLA: Trapping Vision-Language-Action Models in Configured Failure Modes

The paper introduces Configured Failure Trapping, a new backdoor attack targeting Vision‑Language‑Action (VLA) models that activates through subtle textual triggers and forces the robot to fail in a specific, controlled manner. It presents a data engine for generating high‑quality target trajectories, an automated evaluation suite, and two benchmarks—Trap‑LIBERO and Trap‑RoboTwin—covering four failure modes. The authors propose TrapVLA, a method that learns trigger‑induced action residuals to steer policies toward the desired failure behavior, demonstrating effectiveness in both simulation and real‑world robotic experiments while maintaining performance on clean data.

By Jun-Hui Liu, Kun-Yu Lin, Yi-Lin Wei, Xu-Han Chen, Yinghao Li, Zhuohao Li, Yuan-Ming Li, Qing Zhang, Xiaoyi Fan, Dongmei Jiang, Yan Li, Wei-Shi Zheng
arXiv Machine Learning
Oct 22

Watch Your Step: Anticipated Perception for Humanoid Locomotion

The paper proposes a lightweight foothold prediction model (FPM) that anticipates future foot placements using only proprioception and velocity commands, allowing the robot to sample elevation maps only around predicted footholds. This preprocessing reduces redundant sensory input, enabling the locomotion policy to learn faster—reaching a given terrain difficulty in about one‑third the training iterations compared to using the full elevation map. The resulting policy outperforms both full‑map and attention‑based encoders on sparse foothold scenarios, and it zero‑shot transfers to a Unitree G1 humanoid across diverse indoor and outdoor obstacles.

By Matthias Heyrman, Chenhao Li, Ioannis Dadiotis, Marco Hutter