arXiv AI By Bo Xue, Ji Cheng, Shen-Huan Lyu, Yuanyu Wan, Shuang Qiu

Test-Time Scaling via Budgeted Multi-Attribute Verification

Read the original on arXiv AI →

The paper introduces “BMA-GAI”, an algorithm for test-time scaling that jointly selects which candidates to inspect and which verification attributes to evaluate under a shared computational budget. It frames the problem as multi-attribute good-arm identification, where each candidate is an arm evaluated across several costly attributes, aiming to certify as many candidates as possible whose mean scores exceed thresholds on all attributes. The authors provide asymptotic coverage guarantees, an information-theoretic converse, and demonstrate that “BMA-GAI” allocates verification resources more efficiently and certifies more high-quality candidates than competing methods on synthetic benchmarks and an LLM answer-verification task.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Sep 15

The geometry of AI validation: From structural blindness to reusable audits

The paper investigates how AI systems that perform best‑of‑n search require different validation strategies as the search width changes. It shows that auditing only small search widths leaves a gap in reliability estimates for larger widths, and proposes retaining candidate ranks and truth labels to estimate reliability across all widths up to N. The authors derive theoretical bounds on the minimax mean‑squared error, design procedures that achieve these bounds, and demonstrate that a shared audit can significantly reduce maximum error across many widths in practical CodeRM pools.

By Ricardo Fitas
arXiv Machine Learning
Oct 5

Online Verification of Language Model Responses Under Cost Constraints

The paper introduces OMVV, an online multi-verifier algorithm that maintains a pool of weak verifiers with varying costs and performance. It adaptively selects a verifier each round using an online score combiner and exponential-weights routing, providing distribution-free guarantees on false-accept and false-reject rates. Experiments on reasoning benchmarks show OMVV achieves higher accuracy at lower verification cost than any single fixed verifier across different budgets.

By Erfan Hajihashemi, Yanning Shen