arXiv Computer Vision

Visual Orchestration Tax in Agentic VLM Pipelines: Auditing and Certifying Visual Evidence Reuse

The paper introduces the concept of a visual orchestration tax in agentic vision‑language model (VLM) pipelines, where the same static images are repeatedly processed by multiple agents, creating redundancy. It proposes a measurement‑to‑certification framework that audits visual evidence reuse using metrics M1_trace and M2, and certifies reuse through a SharedVisCache contract. Experiments on SeeingEye and MAMMQA show high redundancy rates (66.8‑75.6%) and demonstrate that certified reuse can reduce vision‑API calls while preserving output fidelity.

arXiv Machine Learning
Sep 25

Don't Read the Log: Execution Traces Contaminate Verifiers in Video-Generation Agents

The paper investigates how providing execution traces to multimodal judges in agentic video‑generation systems can bias their verdicts. On a benchmark of 109 two‑event clips, traces that falsely report successful tool calls cause large‑language‑model judges to incorrectly accept 78–90 % of failures, while contradictory traces lead to 100 % rejection of correct clips. The effect persists even when judges are instructed to consider only the video frames, indicating that the vulnerability stems from the judges’ learned trust in tool logs rather than the visual content itself.

By Jian Xu
arXiv Computer Vision
Aug 25

From Subjective Judgments to Auditable Standards:Protocol-Guided AI Auditing of Website Redundancy

The paper introduces CORA (Counterfactual, Observable Redundancy Audit), a protocol for auditing website redundancy by measuring repetition load, normal-use tax, and failure-domain recovery reserve. Each audit run records screenshots, stable element identities, and task traces, while a versioned vision‑language model generates annotations that are validated and released only if they meet calibrated criteria. Experiments on a transparent mechanistic testbed show that CORA’s factorized representation separates reserve from normal-use tax and predicts perturbed success more accurately than scalar-load baselines, but it withholds automated scores when instruments fail to meet release requirements, indicating that CORA is an auditable candidate procedure for the studied benchmark rather than a universal standard.

By Ge Kong, Yongtong Cao
arXiv AI
3d ago

Route First, See Later: Enabling Vision Agents to Reason Scientifically by Separating Routing Policy from Action Spaces

The paper introduces ZETA, an architecture that separates routing policy from action execution in scientific vision agents. By resolving scientific intent before invoking specialized visual tools, ZETA treats measurement as a deterministic operation grounded in explicit geometry, enabling independent evaluation of routing correctness and downstream execution. Experiments on a zero‑shot benchmark of 51 scientific‑intent queries demonstrate that explicit routing semantics can dramatically improve routing accuracy, especially for models like Qwen 3.8 where segmentation routing accuracy jumps from 6.2% to 75.0% and detection routing accuracy from 60.0% to 100%.

By Shubhabrata Mukherjee, Jeffrey Donatelli, Daniela Ushizima