arXiv AI
Compound AI System Reliability: A Failure Taxonomy and Resilience Pattern Catalog from 150 Production Incidents
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Jul 21
FailureAtlas: A Taxonomy of Failure Modes in Multi-Provider LLM Serving Infrastructure
arXiv:2607. 17525v1 Announce Type: new Abstract: Multi-provider LLM gateways reverse proxies that route, load-balance, and rate-limit requests across foundation-model APIs have become critical production infrastructure.
arXiv AI
Aug 3
SREGym: A Live Benchmark for AI SRE Agents with High-Fidelity Failure Scenarios
arXiv:2605. 07161v3 Announce Type: replace Abstract: AI agents are increasingly used to diagnose and mitigate failures in production systems, known as agentic Site Reliability Engineering (SRE).
arXiv AI
Jul 1
FLARE-AI: Flaw Reporting for AI
arXiv:2606. 31567v1 Announce Type: cross Abstract: Flaw reporting for deployed AI systems is fundamental to identifying system failures and improving AI safety.
arXiv AI
Sep 12
The Agent Incident Registry: Toward Preventing Repeated AI Agent Failures
arXiv:2609. 11030v1 Announce Type: new Abstract: AI agents increasingly act through tools and delegated authority, but general incident repositories rarely capture the mechanisms needed to compare public failures with agent-security evaluations.
arXiv Machine Learning
Aug 5
Evaluation Blindness: How Silent Measurement Failures Corrupt AI Systems from Training to Deployment
arXiv:2608. 02786v1 Announce Type: new Abstract: AI systems can fail silently.
arXiv AI
Oct 15
When Messages Go Wrong: Understanding Communication Faults in LLM-Based Multi-Agent Systems
arXiv:2610.15459v1 Announce Type: cross Abstract: LLM-based multi-agent systems (LLM-MAS) use specialized agents that exchange messages to accomplish complex tasks. Their reliance on networked protoc...