arXiv AI By Zhenyu Zhang1, Jiudong Yang

MOSCOPT: Mixture-of-Skills Collective Optimization for LLM Agents

Read the original on arXiv AI →

MOSCOPT is a parameter‑free algorithm that jointly optimizes a pool of N skills and a gating skill G, which dynamically selects K skills at each step for LLM agents. It introduces EditAdam, a dual‑state optimizer, and a three‑phase interleaved update scheme that monotonically improves performance without gradient or parameter tuning. Experiments on five benchmarks and three target LLMs show MOSCOPT consistently outperforms baselines, highlighting the importance of mixture‑of‑skills architecture and collective evolution.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
1d ago

SkillSpec: Consensus-Gated Agent Skill Evolution via Representation Specialization

SkillSpec is a two‑phase framework for evolving natural‑language skills in large language model agents. The first phase, consensus‑gated evolution, generates candidate skills from complementary editing intents and commits updates only when paired evaluations reach consensus on overall improvement and non‑negative aggregate gain. The second phase, representation specialization, uses signals from the optimization trajectory to choose an appropriate flat, graph, or hybrid structure for the skill, improving success rates by an average of 6.89% over SkillOpt across six benchmarks and three target language models.

By Huancheng Chen, Xiaodi Sun, Zhaoqiong Huang, Shenyang Huang Shreya Singhal, Jingwen Lu