arXiv AI

Variational Cognitive Memory Abstraction for Long-Horizon Vision-Language-Action Models

arXiv Computer Vision
Oct 12

Dual-Stream Memory for Vision-Language-Action Policies

The paper introduces a dual‑stream memory architecture for vision‑language‑action policies, separating a task‑agnostic temporal compressor from a task‑conditioned visual retriever. The temporal compressor uses a Gated DeltaNet to condense history into a single token, while the retriever keeps frames above a relevance threshold and fuses them into spatial tokens. Evaluated on sixteen RoboMME tasks and four real‑robot tasks, the combined model outperforms the FrameSamp+Modul baseline, achieving higher mean success rates and notable gains on tasks requiring execution‑stage discrimination.

By Yang Wang, Ping Liu, Ruiyu Wang, Xuhua Chen, Lingfeng Zhang, Tao Zhang
arXiv Computer Vision
Sep 30

EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policies

arXiv:2606.20092v3 Announce Type: replace Abstract: Memory remains a critical bottleneck for long-horizon robotic manipulation, as standard Vision-Language-Action (VLA) policies often fail when task-...

By Ganlin Yang, Zhangzheng Tu, Yuqiang Yang, Sitong Mao, Junyi Dong, Tianxing Chen, Jiaqi Peng, Jing Xiong, Jiafei Cao, Jifeng Dai, Wengang Zhou, Yao Mu, Tai Wang
arXiv AI
Jul 24

VPWEM: Non-Markovian Visuomotor Policy with Working and Episodic Memory

arXiv:2603. 04910v2 Announce Type: replace-cross Abstract: Imitation learning from human demonstrations has achieved significant success in robotic control, yet most visuomotor policies still condition on single-step observations or short-context histories, making them struggle with non-Markovian tasks that require long-term memory.

By Yuheng Lei, Zhixuan Liang, Hongyuan Zhang, Ping Luo
arXiv Computer Vision
Oct 28

AWARE: Action-Entropy-Weighted and Attention-Guided Retrieval of Observation Evidence for Vision-Language-Action Models

AWARE is a plug‑in module for Vision‑Language‑Action models that retrieves observation evidence without extra training. It tracks uncertainty via Action Entropy, uses associative memory to fetch relevant features, and weights them with instruction‑guided attention, scaling the injection by entropy and depth. Experiments on LIBERO, SIMPLER, CALVIN, and real‑world robot tasks show consistent performance gains, especially on long‑horizon tasks, with negligible computational cost.

By Jiabing Yang, Yixiang Chen, Yuan Xu, Peiyan Li, Zichen Wen, Bowen Fang, Chenhang Cui, Tao Yu, Qisen Ma, Kai Wang, Ziheng He, Wen Ye, Xiangnan Wu, Yingda Li, Yan Huang, Liang Wang
arXiv Computer Vision
Oct 21

CondenseVLA: Learnable History Condensation for Efficient Multi-Frame VLA

CondenseVLA introduces a learnable history‑condensation module that distills short‑term visual context into a fixed set of slot tokens via learnable queries and cross‑attention, reducing redundancy and improving action decoding. The approach achieves notable gains on several robot manipulation benchmarks, raising Simpler‑WidowX success from 58.7% to 69.8%, reaching 97.2% on LIBERO, 52.8% on real‑world tasks, and 21.6% on memory‑dependent RMBench tasks.

By Feiyang Hong, Yujie Wei, Bo Zhao, Xiu Su, Hongxun Yao, Shuo Yang
Hugging Face Trending Papers
Oct 29

HiFOR: Hierarchical Foresight with Action-Guided World Grounding for Vision-Language-Action Model

HiFOR introduces a hierarchical foresight framework for Vision‑Language‑Action models, combining short‑term state evolution, semantic milestones, and final goal predictions via a Hierarchical Dependency Mask. It structures future latent representations across horizon, view, and spatial dimensions, enabling fine‑grained retrieval. An action‑guided factorized retrieval mechanism then selectively pulls relevant future information during denoising to guide action generation, improving robotic manipulation performance across simulation and real‑world tasks.

arXiv Machine Learning
Jun 16

AVA-VLA: Improving Vision-Language-Action models with Active Visual Attention

arXiv:2511. 18960v4 Announce Type: replace Abstract: Vision-Language-Action (VLA) models have shown remarkable progress in embodied tasks recently, but most methods process visual observations independently at each timestep.

By Lei Xiao, Jifeng Li, Juntao Gao, Feiyang Ye, Yan Jin, Jingjing Qian, Jing Zhang, Yong Wu, Xiaoyuan Yu
arXiv AI
Oct 2

Divide-and-Remember: Recursive Action-Relevant Memory for Long-Horizon VLA Policies

The paper introduces Divide-and-Remember (D&R), a recursive memory method for vision-language-action (VLA) policies that optimises memory by maximizing the conditional mutual information between actions and memory given observations. D&R recursively divides the full history into top‑K selections over 2K tokens, using a shared lightweight selector across all recursion blocks to handle unbounded histories efficiently. Evaluated on the RoboMME benchmark of 16 long‑horizon manipulation tasks, D&R achieves state‑of‑the‑art success rates with consistent gains across all suites while using only 64 tokens, and similar improvements are observed in real‑robot experiments.

By Xuehui Yu, Eason Yu, Meiyi Wang, Haozhe Du, Stefano V. Albrecht, Harold Soh