arXiv Computation and Language
AtomSD: Procedural Atom-Guided Self-Distillation for LLM Agents
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
arXiv AI
Aug 11
Bidirectional Context Self-Distillation for Reinforcement Learning of Skill-Based LLM Agents
arXiv:2608. 09555v1 Announce Type: new Abstract: External natural-language skills provide large language model (LLM) agents with reusable and editable guidance for solving complex tasks.
Hugging Face Trending Papers
Aug 3
Instruction-Conditioned Exploration with Asymmetric Reinforcement Learning and Self-Distillation
Post-training Large Language Models (LLMs) with Reinforcement Learning (RL) has become an important tool for improving model capabilities, but the LLM action-space structure introduces challenges distinct from classical RL, with implications for inducing exploration. New methods are required that leverage the broad knowledge and flexibility of pre-trained LLMs to deliberately generate diverse experience at training time.
arXiv AI
Aug 26
AHEAD: Adaptive Hindsight with Environment-Augmented Distillation for Agentic RL
AHEAD is a step‑aware framework that augments reinforcement learning for multi‑turn LLM agents by matching different supervision sources to different step types. The teacher receives environment feedback on all steps and LLM‑generated corrective hints only on error steps, providing finer‑grained guidance than uniform trajectory‑level rewards. Across ALFWorld, WebShop, and Search‑based QA, AHEAD improves task success by 13.3 points on ALFWorld and 11.0 on WebShop at 7B, reaches target success rates faster, and solves tasks within tighter interaction budgets compared to outcome‑only RL and prior self‑distillation baselines.
arXiv Machine Learning
Aug 4
Instruction-Conditioned Exploration with Asymmetric Reinforcement Learning and Self-Distillation
arXiv:2608. 02087v1 Announce Type: cross Abstract: Post-training Large Language Models (LLMs) with Reinforcement Learning (RL) has become an important tool for improving model capabilities, but the LLM action-space structure introduces challenges distinct from classical RL, with implications for inducing exploration.
arXiv Machine Learning
Jul 22
HERAKLES: Hierarchical Skill Compilation for Open-ended LLM Agents
arXiv:2508. 14751v2 Announce Type: replace Abstract: We study goal-conditioned reinforcement learning in partially observable environments with sparse rewards and large, structured goal spaces.
arXiv Machine Learning
Aug 3
Learning Stateful Predictive Knowledge From Experience
arXiv:2607. 28638v1 Announce Type: cross Abstract: As large language model (LLM) agents increasingly learn from experience, they primarily rely on trajectory-level reflection to extract insights.