POIROT: Agents as their own auditors for failure attribution in large language model multi-agent systems
Read the original on arXiv AI →POIROT (Phased Oversight via Introspection, Review and Opinion Tallying) is a modular protocol that lets agents in large language model multi‑agent systems attribute failures to themselves by casting private votes in a hazard space and aggregating those votes. The protocol progresses through phases—from independent self‑assessment to shared assessments and peer interrogation—to evaluate the contribution of each phase. Experiments on the Who&When benchmark and the newly released BLAME benchmark show that agent‑based attribution, especially the independent self‑assessment phase, outperforms a single‑LLM evaluator across multiple models and benchmarks.
Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.