arXiv AI By Tianxing Chen, Yuran Wang, Mingleyang Li, Yan Qin, Hao Shi, Zixuan Li, Yifan Hu, Yingsheng Zhang, Kaixuan Wang, Yue Chen, Hongcheng Wang, Junjie Wang, Tianhang Yang, Renjing Xu, Ruihai Wu, Yao Mu, Yaodong Yang, Hao Dong, Ping Luo

RMBench: Memory-Dependent Robotic Manipulation Benchmark with Insights into Policy Design

Read the original on arXiv AI →

RMBench is a simulation benchmark featuring nine robotic manipulation tasks that vary in memory complexity, designed to systematically evaluate how well policies use memory. The authors also introduce Mem-0, a modular policy with explicit memory components that allows controlled ablation studies. Experiments in simulation and the real world reveal memory-related limitations in current policies and show how architectural choices affect memory performance.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 16

LTM: Latent Transition Based In-Context Memory for Vision-Language-Action Models

The paper introduces Latent Transition Memory (LTM), a method that stores interaction history as compact latent transitions between consecutive observations for vision‑language‑action models. Implemented as LTM‑π on the π₀.₅ architecture, it uses a frozen latent action encoder, a lightweight adapter, and causal KV caching to enable incremental inference without external reasoning models or memory‑specific annotations. Experiments on RoboMME and LIBERO‑Mem show that LTM‑π achieves state‑of‑the‑art success rates (58.54% and 80.5% respectively), and scaling the dataset or applying a 200‑token memory budget still yields high performance, demonstrating the method’s scalability and efficiency in real‑world robotic tasks.

By Qixin Sun, WenLong Gao, Xiansheng Chen, Zhongyuan Wang, Si Liu, Pengwei Wang
arXiv AI
Jul 7

RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policies

arXiv:2607. 04434v1 Announce Type: cross Abstract: Generalist robot manipulation policies have advanced rapidly, yet existing benchmarks remain limited in systematically evaluating their capabilities.

By Tianxing Chen, Yue Chen, Zixuan Li, Junyuan Tang, Kailun Su, Weijie Wan, Baijun Chen, Haoran Lu, Haowen Yan, Honghao Su, Zhiyang Dou, Kaixuan Wang, Dandan Zhang, Yunze Liu, Yan Qin, Qiwei Liang, Qiwei Wu, Zijian Lin, Wenwei Lin, Yuran Wang, Minghua He, Tianshu Wu, Ruihai Wu, Jingquan Zhou, Kai-Chong Lei, Haibao Yu, Yuanfeng Ji, Weiyang Jin, Guanyu Lin, Xiaofan Li, Qi Xiong, Renjing Xu, Zhongyu Li, Wenhao Chai, Enze Xie, Ziwei Wang, Yao Mu, Hao Dong, Wojciech Matusik, Mingyu Ding, Wenbo Ding, Ping Luo, Masayoshi Tomizuka