arXiv:2609.09250v1 Announce Type: cross
Abstract: A verifier for robot policies reads a candidate behavior and returns a score for how well it did, used both to evaluate vision-language-action polici...
By Yang Wan, Xihang Yue, Zhirui Liu, Ziyuan Chu, Shuxun Wang, Yuhan Chen, Xiaonan Jiang, Xukun Zhu, Yubo Dong, Linchao Zhu
arXiv:2608. 11274v1 Announce Type: cross Abstract: The dominant paradigm treats AI safety as a property to be instilled during model training via RLHF, DPO, or Constitutional AI.
By Albus W. Ng, Yi Han, Jusheng Zhang, Wenhao Wang
arXiv:2606. 16603v1 Announce Type: cross Abstract: LLM-based agents have demonstrated strong capabilities in data-intensive analytical tasks, yet their outputs are rarely verifiable: a reliance on linear text trajectories makes their reasoning difficult to audit.
By Jiajie Jin, Zhao Yang, Wenle Liao, Yuyang Hu, Guanting Dong, Xiaoxi Li, Yutao Zhu, Zhicheng Dou
EIO-Agents introduces an open specification for interoperable AI agent evaluation, consisting of two layers: the Evaluation Intelligence Ontology (EIO) and the Portable Evaluation Record (PER). The EIO layer supplies a semantic framework that defines typed evidence, behavioral predicates, evidence contracts, claims, witness rules, proof status, recurrence, and computable derivations for metrics, findings, controls, and decisions such as PASS, REVIEW, or BLOCK. The PER layer offers a canonical, content‑addressed record of an evaluation that preserves the evidence‑to‑decision chain, enabling re‑derivation, explanation, and verification of the evaluation outcome.
By Fouad Bousetouane
arXiv:2608.30757v1 Announce Type: new
Abstract: Before an intelligent system can decide whether an action is allowed, it must first know which rules the action has approached. A single proposed actio...
By Thomson D. Nguy (Radiant Institute for Manifold Studies)
The paper introduces TRUST, a token‑level reward model that predicts the correctness of partial chain‑of‑thought (CoT) traces in vision‑language‑action (VLA) policies, enabling monitoring and selective steering of reasoning. On driving and manipulation VLA benchmarks, TRUST improves reasoning accuracy and reduces collision rates and trajectory errors, though its impact on overall task performance varies across tasks. The study defines two evaluation axes—correctability and actionability—to assess when CoT can serve as a runtime safety interface.
By Sathwik Karnik, Joseph JR. Lee, Aryaman Gupta, Somil Bansal