Cortex: Measurement-Gated Evolution and Pruning of Coding-Agent Skills and Rules
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
The paper investigates how a coding agent learns across a sequence of abstract reasoning tasks in the ARC-AGI-3 benchmark. The agent, operating on a frozen foundation model, writes and runs Python and shell scripts, retaining only its written artifacts as state. The authors develop a measurement protocol that traces each thought—any belief, rule, or plan committed to a file—through its lifecycle, revealing that most task-specific scripts are discarded at task boundaries and that the agent selectively forgets by rewriting knowledge into new scripts while accumulating unedited notes.
The paper investigates how co-installed coding‑agent skills can conflict, causing the model to choose a similar skill over the intended one based solely on name and description. An empirical study of 20,947 repositories uncovered 822,109 candidate skill pairs, with 312 confirmed conflicts tested across three models, revealing that nearly one in four installed skills is overridden by a similar skill. Key findings include that conflicts often involve normative skills, that the installed skill loses core functions in about one‑fifth of runs, and that the first skill read determines the outcome, suggesting benchmarks should evaluate exclusive core functions and platforms should guard the initial read.
arXiv:2607. 18064v1 Announce Type: cross Abstract: Coding agents can now be left alone to improve software against a score.
arXiv:2610.14495v1 Announce Type: new Abstract: Explainer videos -- a worked geometry problem, why the sky is blue, how a dynasty fell -- are usually one more target for pixel video generation. We ar...
arXiv:2608. 16630v1 Announce Type: cross Abstract: Repository-scale coding requires an agent to keep tests, imports, configuration, and migration rules consistent within a bounded context window.
SkillGLoW introduces a new way for large language model agents to self‑improve by consolidating procedural skills shared across related tasks. Instead of storing all skills in a single global document or a flat per‑task pool, SkillGLoW aggregates local skills into procedural families, compresses them into de‑instantiated global priors, and regenerates instance‑specific details on demand. Experiments on four diverse benchmarks show that these priors improve performance by an average of 17.2 points over a no‑skill baseline, are more compact than per‑task pools, and enable better transfer to unseen tasks.