Hugging Face Blog

Agentic Resource Discovery: Let agents search

arXiv AI
Sep 12

Defining AI Agents: A Compendium of Criteria, Metrics, and Benchmarks

The article "Defining AI Agents: A Compendium of Criteria, Metrics, and Benchmarks" surveys the lack of a standard definition for AI agents and organizes this ambiguity into five dimensions: environmental interaction, learning and adaptation, autonomy, goal‑directed behavior, and temporal coherence. It reviews how each dimension has been conceptualized in prior work and compiles the metrics, benchmarks, and evaluation frameworks used to assess them. The authors also introduce the Agent Compendium, a public digital resource that extends these evaluation methods, aiming to provide a common structure for evaluating and comparing agent capabilities across AI systems.

By Mia Lassiter, Brinnae Bent
Towards Data Science
Oct 2

Where the Agent Development Lifecycle Fits

The article "Where the Agent Development Lifecycle Fits" discusses how to coordinate the development of agent capabilities with the applications they power. It highlights the importance of aligning agent creation processes with the needs of the end‑use cases they support. The piece appears on Towards Data Science and focuses on integrating agent development into broader application workflows.

By Andrew Hinton
arXiv Computation and Language
Oct 9

Project Greenhouse: Progress Toward Fully Open and Sovereign Agentic Search

Project Greenhouse explores building fully open and sovereign agentic search models with modest computational resources. The authors present a competitive pointwise decoder-only reranker trained from scratch and fine-tuned on common datasets, avoiding reliance on third‑party open‑weight backbones. They demonstrate that most experiments can be run on a handful of GPUs and release data, code, configurations, and checkpoints for reproducibility.

By Jimmy Lin, Sahel Sharifymoghaddam, Lingwei Gu, Nour Jedidi