arXiv AI By Fuad Ali

Who May Overrule the Agent? Evidence-Gated Authority in LLM Review Institutions

Read the original on arXiv AI →

The paper investigates how a reviewer in multi‑agent language‑model systems can be authorized to override an upstream agent’s decision. It compares unrestricted override authority with an evidence‑gated approach that requires a valid record of a binding‑constraint violation and a compliant repair before replacement is allowed. Experiments on two open‑weight models across 96 spatial‑policy tasks show that the evidence gate sharply reduces corruption of correct proposals while largely preserving legitimate repairs, though the effectiveness varies with reviewer transitions and upstream states.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computation and Language
Sep 7

Reviewer Capability Governs Rejection Targeting, Not Repair Skill: Evidence from LLM Execute-Review-Revise Pipelines

The study investigates how varying the capability of a reviewer model in a large‑language‑model (LLM) execute‑review‑revise pipeline affects rejection decisions on 100 olympiad mathematics problems. A mid‑tier reviewer improves final accuracy by 12 percentage points (from 52 % to 64 %) without damaging answers, while a self‑reviewer detects errors best (85 % recall) but rejects too often and harms correct solutions. Below a certain capability threshold the reviewer becomes inert, changing none of the answers and doubling token cost.

By Faizan Tanveer
arXiv AI
Oct 19

Monitor-Validity Failures: LLM Safety Evidence Paths at Evolving Framework Boundaries

The paper investigates failures in large language model (LLM) safety systems where runtime monitors detect policy‑relevant evidence but the evidence never reaches the enforcement decision point. Using canary contracts, the authors identified 18 evidence‑path failures across 11 safety projects and four ecosystems, categorizing them into established‑boundary repairs, new‑surface policy gaps, and boundary‑only evidence cases. The study demonstrates that ordinary application behavior can continue while safety‑specific evidence is lost, highlighting the need for regression tests on evolving monitor schemas, streams, tools, and adapters.

By Junchi Liao