arXiv Machine Learning By Ali Najar, Hosein Hasani, Amir Kooshan Fattah, Yasamin Rajabi, Mahdieh Soleymani Baghshah

METTA: Memory-Enhanced Test-Time Adaptation for Meta-Reinforcement Learning

Read the original on arXiv Machine Learning →

METTA: Memory-Enhanced Test-Time Adaptation for Meta-Reinforcement Learning proposes a new approach that splits fast adaptation into two temporal scales: a causal neural memory for fine-grained within-episode adaptation with linear complexity, and compact episode-level summaries for long-range cross-episode inference. This design reduces the quadratic memory and computation costs of transformer-based agents while retaining expressive capacity for test-time training. Experiments on unseen Meta-World and PointMaze tasks show METTA achieves over 50% success on Meta-World and outperforms transformer baselines on long-context sparse-reward environments.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computation and Language
3d ago

Uni-Mem: Learning a Long-Horizon Agentic Memory Manager with Unified Online Policy Optimization

arXiv:2610.29671v1 Announce Type: new Abstract: Long-term agent memory is shifting from predefined workflows toward learnable policies for memory construction and retrieval. Existing learning-based m...

By Zhiqian Xia, Jielong Tang, Ling-An Zeng, Shixiong Kai, Rong Yao, Hao Kong, Xiao Dong, Wei Wang, Mingxuan Yuan, Siyu Xia, Haifeng Xia
arXiv AI
Sep 3

AGI Maze Prediction Datasets: A Compact Benchmark for Learning World Dynamics with Transformers

The paper introduces the AGI Maze Prediction Datasets and Benchmark, a lightweight, procedurally generated grid‑world testbed for evaluating predictive models, particularly Transformers, on tasks such as per‑step transition prediction, fixed‑horizon state prediction, and sequential textual‑observation prediction. It compares byte‑level Transformer baselines with two memory‑augmented architectures, showing that a pseudo‑video spatial‑memory Transformer achieves perfect validation accuracy on selected tasks and improves sequential text‑trace prediction, while a generic auxiliary latent‑memory Transformer does not consistently help. The study highlights that structured, task‑aligned working memory can be more effective than merely increasing latent capacity, and positions the benchmark as a compact setting for testing architectures that couple textual interfaces to learned structured state.

By Alexey Potapov
arXiv AI
6d ago

RL-Guided Temporal Localization for Dual-Channel Retrieval in Long-Horizon Agent Memory

The paper introduces TIDER, a time‑aware retrieval framework that uses a reinforcement‑learning trained temporal interval locator to identify relevant time windows for evidence retrieval in long‑horizon agent memory. By combining temporally grounded candidates with semantic retrieval and reranking them by proximity to the inferred windows, TIDER mitigates the displacement of target memories caused by temporally mismatched yet semantically similar entries. The lightweight 1.7B locator achieves state‑of‑the‑art accuracy on LifeBench and LoCoMo benchmarks, demonstrating the importance of temporal cues for effective evidence retrieval.

By Dabin Sheng, Zhe Wu, Jinming Zhao, Junliang Xing, Yuanchun Shi