arXiv:2608. 01678v1 Announce Type: new Abstract: Existing skill generation methods largely rely on heuristics or pipeline-style consolidation, which must be specially designed for different evidence sources.
arXiv:2605.08693v3 Announce Type: replace Abstract: Skills provide an effective mechanism for improving LLM agents on complex tasks, yet in existing agent frameworks, their creation, refinement, and...
SkillSpec is a two‑phase framework for evolving natural‑language skills in large language model agents. The first phase, consensus‑gated evolution, generates candidate skills from complementary editing intents and commits updates only when paired evaluations reach consensus on overall improvement and non‑negative aggregate gain. The second phase, representation specialization, uses signals from the optimization trajectory to choose an appropriate flat, graph, or hybrid structure for the skill, improving success rates by an average of 6.89% over SkillOpt across six benchmarks and three target language models.
arXiv:2607. 26784v1 Announce Type: new Abstract: Large language model agents often encounter related yet distinct tasks that share reusable solution patterns.
arXiv:2606. 01139v1 Announce Type: new Abstract: Agent skills are procedural artifacts that enable LLM agents to execute workflows, verify constraints, and recover from failures.
arXiv:2609.08944v1 Announce Type: new Abstract: Agent skills provide a lightweight way to equip frozen language-model agents with domain knowledge and procedural guidance, yet obtaining high-quality...
The paper introduces Hindsight Meta-Experience Distillation (HMED), a method that lets self‑improving agents evaluate how revisions to their Meta‑Skills affect skill discovery by re‑executing both the original and revised Meta‑Skills from the same initial state. By comparing these outcomes, HMED creates structured Meta‑Experiences that provide learning signals even for revisions that are not ultimately kept. Experiments on three interactive benchmarks show that HMED consistently outperforms strong baselines, improving skill discovery by focusing on the consequences of the improvement process rather than just branch outcomes.
arXiv:2601. 03555v3 Announce Type: replace Abstract: Training reliable tool-augmented agents remains a significant challenge, largely due to the difficulty of credit assignment in multi-step reasoning.
arXiv:2606. 03980v1 Announce Type: new Abstract: Reward models (RMs) provide critical feedback signals for LLM post-training, notably in reinforced fine-tuning (RFT) and reinforcement learning (RL) pipelines.
SkillLift introduces a method for efficiently evolving reusable procedural prompts (skills) in large language model agents by learning a dense rubric that aligns with sparse oracle evaluations. Instead of directly revising skill text based on costly full agent rollouts, the approach decouples skill search from oracle cost through a bilevel optimization framework: an inner loop uses a frozen rubric as a cheap surrogate to guide skill updates, while an outer loop periodically realigns the rubric using a small number of oracle rollouts via rank correlation. Experiments on complex agent task benchmarks demonstrate that SkillLift outperforms existing auto-skill methods while reducing token cost by 40–70% compared to frontier-evolving approaches.
Reward models (RMs) provide critical feedback signals for LLM post-training, notably in reinforced fine-tuning (RFT) and reinforcement learning (RL) pipelines. However, current reward evaluation relies on heterogeneous criteria such as rule-based verifiers, ground-truth references, procedural checklists, and complex rubrics, where a unified mechanism to integrate all types of evidence remains unexplored.
Large language model agents often encounter related yet distinct tasks that share reusable solution patterns. Yet standard agentic reinforcement learning treats tasks as independent episodes, while existing approaches to skill learning either focus on repeated attempts of one task or use pipelines with multiple stages that entangle extraction, retrieval, and execution.
arXiv:2608. 15071v1 Announce Type: new Abstract: Learning from experience is critical for developing capable, self-improving large language model (LLM) agents.