arXiv AI

Action Conditioned Bisimulation For GUI Agent Memory

The paper introduces an action‑conditioned bisimulation rule for merging states in a GUI agent’s memory, replacing observation‑based similarity with a requirement that shared actions produce identical outcomes and successor blocks. This rule is applied to the empirical predictive state graph built by a frozen agent during interaction. Experiments on MiniWoB++ show that the new merge rule improves success rates compared to a memoryless baseline, while controls that omit action conditioning or use the previous successor‑representation merge show no improvement.

arXiv AI
Sep 24

MemBodied: Recurrent Associative Memory for Vision-Language-Action Models

MemBodied introduces a fixed‑size episodic memory for Vision‑Language‑Action models, comprising an associative state that tracks interactions across policy calls and an episode anchor that stores a compact representation of the initial scene. By conditioning action generation on these memory components instead of raw past observations, MemBodied reduces context bloat and inference latency. In five memory‑dependent RMBench tasks, it outperforms stateless and vanilla recurrent policies by significant margins, and achieves a 90.6% success rate on the LIBERO‑Long suite, improving over the baseline by 5.4%.

By Tej Deep Pala, Navonil Majumder, Bryce Goh, Raphael Yee, Jianfei Yang, Liming Chen, Soujanya Poria
arXiv AI
Oct 9

DeltaReplay: Task-Relative Memory Reuse for Mobile GUI Agents

DeltaReplay is a step‑level memory reuse framework for mobile GUI agents that decides how to use stored execution trajectories without modifying them. It stores trajectories as paths in a transition graph, separating each action into a task‑independent operation and task‑specific parameters, and compares each recorded step with the new task and current screen to decide whether to follow, adapt, or ignore it. Experiments on AndroidWorld and SPA‑Bench show that DeltaReplay can increase task success rates by up to 10.3 and 25.0 percentage points over a base agent with the same backbone.

By Yudong Bai, Yihong Chen, Quanming Yao, Yaqing Wang
Hugging Face Trending Papers
Oct 8

DeltaReplay: Task-Relative Memory Reuse for Mobile GUI Agents

DeltaReplay introduces a step-level memory reuse framework for mobile GUI agents that selectively reuses parts of stored execution trajectories without modifying them. By representing trajectories as paths in a transition graph and separating actions into task-independent operations and task-specific parameters, the system compares each recorded step with the new task and current screen to decide whether to follow, adapt, or ignore it. Experiments on AndroidWorld and SPA-Bench show that this selective reuse can boost task success rates by up to 10.3 and 25.0 percentage points over a baseline agent.

arXiv Computation and Language
Sep 21

MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks

MemoryArena is a new evaluation gym that benchmarks agent memory in interdependent multi‑session tasks. Unlike prior benchmarks that test memorization or single‑session action in isolation, MemoryArena requires agents to acquire memory while interacting with the environment and then use that memory to guide future decisions across a range of tasks such as web navigation, planning, information search, and formal reasoning. The benchmark reveals that agents excelling on existing long‑context memory tests perform poorly here, highlighting a gap in current memory evaluation methods.

By Zexue He, Yu Wang, Churan Zhi, Yuanzhe Hu, Tzu-Ping Chen, Lang Yin, Ze Chen, Tong Arthur Wu, Siru Ouyang, Zihan Wang, Jiaxin Pei, Julian McAuley, Yejin Choi, Alex Pentland