Introducing the SWE-Lancer benchmark

Judge Arena: Benchmarking LLMs as Evaluators

Open-source LLMs as LangChain Agents

Eta Given Delta: Defining LLM Tool Efficiency With Marginal Tool Utility

arXiv:2607. 14108v1 Announce Type: cross Abstract: This paper introduces tool efficiency, a new quantitative metric to evaluate the rate of useful tool calls in an LLM agent trajectory.

BizFinBench.v2: Towards Reliable LLMs in Finance via Real-User Data and Offline/Online Bilingual Evaluation

arXiv:2601. 06401v2 Announce Type: replace Abstract: Large language models are becoming increasingly significant in financial applications.

Towards Evaluation of Implicit Software World Models in Coding LLMs

arXiv:2606. 27406v1 Announce Type: cross Abstract: Software engineering, whether performed by humans or by AI agents, requires reasoning about how software behaves.

Optimizing your LLM in production

Investing in Performance: Fine-tune small models with LLM insights - a CFM case study

BenchMIRT: What are LLM benchmarks actually measuring?

Introducing Agents.js: Give tools to your LLMs using JavaScript

How frontier firms are pulling ahead

OpenAI’s B2B Signals research shows how frontier enterprises deepen AI adoption, scale Codex-powered agentic workflows, and build durable competitive advantage.

TextQuests: How Good are LLMs at Text-Based Video Games?

ADK Arena: Evaluating Agent Development Kits via LLM-as-a-Developer

arXiv:2606. 05548v1 Announce Type: cross Abstract: The rapid proliferation of Agent Development Kits (ADKs), SDK-level frameworks for building LLM-powered autonomous agents, has outpaced any empirical understanding of how framework choice affects agent performance.