OpenEnv in Practice: Evaluating Tool-Using Agents in Real-World Environments

Open, Reliable, and Collective: A Community-Driven Framework for Tool-Using AI Agents

arXiv:2604. 00137v2 Announce Type: replace Abstract: Tool-integrated LLMs retrieve information, perform computations, and take real-world actions, but their reliability depends on both tool-use accuracy and intrinsic tool accuracy, including tool correctness, stability, and safety.

Building the Open Agent Ecosystem Together: Introducing OpenEnv

The Open Source Community is backing OpenEnv for Agentic RL

OpenCollab: A Multi-Agent Coding Framework with Programmable Collaboration and Controllable Runtime

OpenCollab is a multi‑agent coding framework that unifies organization design, enforces experimental control on a shared runtime, and tracks execution via fine‑grained event streams. It introduces the metric Adherence to measure whether the declared organization is actually realized, showing that small configuration changes can shift adherence from 47.2% to 97.2%. Experiments demonstrate that a two‑coder workflow built on OpenCollab achieves new state‑of‑the‑art performance against mainstream harnesses while using the fewest tokens, and that a well‑designed organization can outperform strong existing harnesses.

AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments

arXiv:2607. 05174v1 Announce Type: new Abstract: Language agents, i.

Is it agentic enough? Benchmarking open models on your own tooling