arXiv Machine Learning By Yuchen Zhang

CausalEvo: Causal Skill Self-Evolution for Health LLM Agents

Read the original on arXiv Machine Learning →

CausalEvo is a method that enables large language model agents in health to evolve their textual skills—such as calculation rules and measurement units—by evaluating the causal impact of skill changes while keeping model weights, feedback cases, and rule count constant. The approach freezes the LLM to propose candidate rules, pools them with existing skills, and uses paired skill replacements scored on shared feedback to rank and retain the most effective rules. In experiments on six MedCalc-Bench-Verified tasks, CausalEvo achieved 60.00% accuracy, outperforming SkillOpt (55.83%) and a no‑skill baseline (51.67%), while also reducing training token usage by 55.6%. whyItMatters":"CausalEvo demonstrates that controlled, causal evaluation of skill updates can improve health‑focused LLM performance and efficiency, directly benefiting the reliability and resource usage of medical language agents."

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Hugging Face Trending Papers
Jun 10

SkillJuror: Measuring How Agent Skill Organization Changes Runtime Behavior

Agent Skills augment large language model (LLM) agents with procedural knowledge at inference time, but current benchmarks rarely distinguish what a Skill says from how it is organized. We study this distinction through Progressive Disclosure, where a concise root file points agents to supporting resources on demand, and compare it with a normalized flat baseline.

arXiv Computation and Language
Aug 25

When Not to Imitate: Boundary-Aware Skill Memory for Reliable Tool-Use LLM Agents

The paper introduces Boundary-Aware Skill Memory (BASM), a method that enriches skill memories for large language model agents with explicit boundary fields such as applicability conditions, risk cues, avoidance rules, and recovery notes. This approach transforms retrieved skills from unconditional templates into state‑conditioned guidance, preventing the Skill Imitation Trap where more skills lead to incorrect tool usage. Experiments on three agent benchmarks and four model scales show that BASM improves task success rates, accuracy, and reduces attack success while cutting average steps compared to memory‑free baselines.

By Zihan Lin, Zhenyu Chen, Jiawen Wei, Xiaohan Wang, Jie Cao, Jiajun Chai, Wei Lin, Guojun Yin, Ran He