EDGE: Experience-Distillation for Guided Exploration in Agentic Reinforcement Learning
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
The paper introduces ReTRAIL, a framework that allows long‑horizon agents to rewind the environment to earlier states while preserving forward progress in knowledge. By training a shared policy with State‑Anchored GRPO and a branch‑advancement reward, ReTRAIL enables agents to recover from unproductive states and reuse insights from abandoned exploration. Experiments on MineSweeper, Sokoban, ALFWorld, and ScienceWorld show that this combined rewinding and experience‑reuse strategy outperforms simple rewind primitives and improves long‑horizon task solving.
arXiv:2607. 21419v1 Announce Type: new Abstract: In long-horizon LLM agent reinforcement learning, weak policies often repeat similar failures, producing uninformative rollout trajectories and limiting effective policy optimization.
arXiv:2512. 07287v3 Announce Type: replace-cross Abstract: As intents unfold and environments change, multi-turn agents face continuously shifting decision contexts.
The paper introduces Agent Evolving Learning (AEL), a two‑timescale framework that dynamically evolves an LLM agent’s memory‑retrieval harness in open‑ended environments. A fast Thompson‑Sampling bandit selects among retrieval policies each episode, while a slower LLM reflection diagnoses performance drops and injects new policies when the current set plateaus. AEL outperforms ten self‑improving and non‑LLM baselines on a sequential portfolio benchmark, boosting Sharpe ratio by 27% and achieving significant accuracy gains on a support‑ticket routing stream.
arXiv:2610.27495v1 Announce Type: cross Abstract: Self-evolving agents aim to improve from their own experience rather than remain fixed after deployment, but naturally collected trajectories often l...
arXiv:2510.15047v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) as agents often fail to improve in new environments. We identify and characterize a failure mode we call explora...