ClawGym II: Exploring Black-Box RL on Agent Harness
arXiv:2608. 16798v1 Announce Type: cross Abstract: Agent harnesses have substantially improved performance on long-horizon tasks by coordinating agent interactions with the environment.
arXiv:2608. 16798v1 Announce Type: cross Abstract: Agent harnesses have substantially improved performance on long-horizon tasks by coordinating agent interactions with the environment.
The paper introduces the Agentic Compositional Generalization hypothesis, suggesting that reinforcement learning (RL) primarily refines high‑level decision‑making behaviors that orchestrate pre‑trained low‑level skills, rather than teaching new domain‑specific skills from scratch. It proposes River, a training recipe that enhances reward quality by filtering low‑quality synthetic environments and adding process‑level behavior regularization. Using River, RL‑trained agents outperform other open‑source 8B models on four terminal‑agent benchmarks, achieving significant gains with fewer than 30% of the training environments.
The paper investigates zero‑shot task generalisation in offline multi‑agent reinforcement learning by extending sequence‑modeling architectures to support multi‑task observation and action spaces and variable agent counts. It finds that increasing task diversity, rather than merely enlarging the dataset, is the key driver for robust zero‑shot transfer. Experiments on four challenging environments show a 3.2× mean improvement on held‑out tasks compared to single‑task models and outperform strong behaviour‑cloning baselines.
MiMo‑V2.6 is an omni‑modal reinforcement learning framework that scales compute to advance large foundation models toward self‑improvement. It trains on a broad multimodal corpus before RL, then scales RL along three axes: larger batches and throughput, diverse environments across code, general, visual, and cyber domains, and enhanced grader compute for better reward signals. The system incorporates infrastructure such as a frozen MoE router, multi‑layer defense against reward hacking, unified trajectory representation, high‑concurrency rollout, and training‑inference consistency, and it is open‑source to support reproducibility and further research.
arXiv:2512. 09706v2 Announce Type: replace Abstract: The paradigm of agentic AI is shifting from engineered complex workflows to post-training native models.
The paper investigates how data should be scaled in agentic reinforcement learning, where data is now a structured design space of tasks, environments, and trajectories. By fitting per‑axis scaling laws across various large language models and RL algorithms, the authors find that environment diversity has the strongest impact, followed by task and trajectory diversity. Using these laws, they price synthesis methods, identify critical synthetic‑to‑real ratios, and formulate a compute‑optimal budget allocation that can improve efficiency by up to 1.7× compared to the common practice of scaling trajectories alone.
arXiv:2610.28201v1 Announce Type: new Abstract: Recursive self-improvement (RSI) of agent harnesses has emerged as an effective approach to enhancing the capabilities of large language model (LLM) ag...
arXiv:2609.13739v1 Announce Type: cross Abstract: Language-model agents are increasingly deployed through diverse harnesses that differ in system prompts, tool schemas, control loops, and trajectory...
The paper investigates how optimizing the harness of language model agents—without changing model weights—affects performance. It distinguishes between gains that improve success on tasks already within reach (elicitation) and gains that broaden the range of solvable tasks (expansion). By comparing optimized harnesses to their pre‑optimization versions across static and dynamic tasks, the study finds that benefits can reverse at higher attempt budgets and that aggregate gains may mask shortcomings on harder tasks, highlighting the need for detailed diagnostics.
arXiv:2610.10426v1 Announce Type: new Abstract: Terminal-agent capability depends jointly on model weights and the runtime harness that formats prompts, binds tools, and handles error recovery. Exist...
arXiv:2606. 14249v1 Announce Type: new Abstract: AI agent performance depends critically on the runtime harness, comprising the prompts, tools, memory, and control flow that mediate how a model observes, reasons, and acts.
arXiv:2608. 10538v1 Announce Type: new Abstract: Agent skills represent a standardized format for packaging procedural knowledge and domain expertise, serving within agent harness systems as an essential mechanism to continually constrain a language model's behavior space for repeatable, high-quality task execution.