arXiv Machine Learning

Temporal Consistency Improves Generalization in Contextual Offline Meta Reinforcement Learning

arXiv AI
Jun 16

LatentGym: A Testbed For Cross-Task Experiential Learning With Controllable Latent Structure

arXiv:2606. 15306v1 Announce Type: cross Abstract: We envision continually learning agentic systems that become more useful over time: as they encounter sequences of related tasks, they should infer the hidden structure shared across those tasks and use it to improve future decisions.

By Daksh Mittal, Tommaso Castellani, Thomson Yen, Naimeng Ye, Fangyu Wu, Minghui Chen, Tiffany Cai, Emmanouil Koukoumidis, William Zeng, Hongseok Namkoong
arXiv AI
Jun 2

Behavior-Invariant Task Representation Learning with Transformer-based World Models for Offline Meta-Reinforcement Learning

arXiv:2606. 00780v1 Announce Type: cross Abstract: Offline meta-reinforcement learning leverages static datasets to enable agents to generalize to unseen environments by combining offline efficiency with meta-learning adaptability, yet it faces key challenges from context and policy distribution shifts.

By Fuyuan Qian, Menglong Zhang, Song Wang, Quanying Liu
arXiv AI
3d ago

Meta-RL with Bayesian Linear Task Models

The paper introduces GLiBRL, a deep Bayesian reinforcement learning framework that uses generalized linear task models with learnable nonlinear basis functions. GLiBRL performs exact, sequential Bayesian inference without variational approximations, providing closed‑form posterior updates and a marginal likelihood. The method is permutation‑invariant, compatible with both off‑ and on‑policy algorithms, and achieves the best zero‑shot performance among eight meta‑RL baselines on MuJoCo locomotion and MetaWorld manipulation tasks.

By Jingyang You, Hanna Kurniawati
arXiv AI
Aug 19

Towards Zero-Shot Task Transfer with Neurosymbolic World Models

The paper introduces a neurosymbolic world model that separates observation reconstruction from reward prediction, enabling the model to adapt zero‑shot to new reward functions defined over a shared symbolic state space. This approach addresses the task‑dependency of traditional neural world models, which learn latent representations tied to specific training tasks. Experiments show that the neurosymbolic formulation generalises more strongly than purely neural methods.

By Isidoro Tamassia, Lennert De Smet, Giuseppe Marra