arXiv AI By Thomson D. Nguy (Radiant Institute for Manifold Studies)

Can Semantic Geometry Teach an AI Judgement?

Read the original on arXiv AI →

The paper investigates whether geometric representations of actions and policies can enable an AI agent to judge which rules to follow. Experiments across four studies found that geometric approaches failed to provide reliable pre-action judgment, and a lexical router, while efficient, still escalated all actions. The authors conclude that AI judgment likely requires an explicit consequence graph linking actors, authorities, policy conditions, exceptions, and action outcomes.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Jun 16

VeriGraph: Towards Verifiable Data-Analytic Agents

arXiv:2606. 16603v1 Announce Type: cross Abstract: LLM-based agents have demonstrated strong capabilities in data-intensive analytical tasks, yet their outputs are rarely verifiable: a reliance on linear text trajectories makes their reasoning difficult to audit.

By Jiajie Jin, Zhao Yang, Wenle Liao, Yuyang Hu, Guanting Dong, Xiaoxi Li, Yutao Zhu, Zhicheng Dou
arXiv AI
Oct 7

EIO-Agents: The Missing Semantic Layer for AI Agent Evaluation

EIO-Agents introduces an open specification for interoperable AI agent evaluation, consisting of two layers: the Evaluation Intelligence Ontology (EIO) and the Portable Evaluation Record (PER). The EIO layer supplies a semantic framework that defines typed evidence, behavioral predicates, evidence contracts, claims, witness rules, proof status, recurrence, and computable derivations for metrics, findings, controls, and decisions such as PASS, REVIEW, or BLOCK. The PER layer offers a canonical, content‑addressed record of an evaluation that preserves the evidence‑to‑decision chain, enabling re‑derivation, explanation, and verification of the evaluation outcome.

By Fouad Bousetouane
arXiv AI
Oct 2

When Reasoning Helps Action: Monitoring and Steering Chain-of-Thought in Vision-Language-Action Policies

The paper introduces TRUST, a token‑level reward model that predicts the correctness of partial chain‑of‑thought (CoT) traces in vision‑language‑action (VLA) policies, enabling monitoring and selective steering of reasoning. On driving and manipulation VLA benchmarks, TRUST improves reasoning accuracy and reduces collision rates and trajectory errors, though its impact on overall task performance varies across tasks. The study defines two evaluation axes—correctability and actionability—to assess when CoT can serve as a runtime safety interface.

By Sathwik Karnik, Joseph JR. Lee, Aryaman Gupta, Somil Bansal