arXiv Computer Vision By Huachao Zhu, Junjielong Xu, Sicheng Li, Liang Yang, Mingtao Chen, Zhichao Hu, Li Jiang, Pinjia He

VisualTrust: Video Reasoning under On-Screen Claim Framing

Read the original on arXiv Computer Vision →

VisualTrust introduces a counterfactual benchmark to evaluate how multimodal large language models handle on‑screen claims that may conflict with visual evidence. The benchmark contains 5,063 cases across 14 claim‑fact classes, each featuring a question paired with three video versions: no claim, accurate claim, and misleading claim. Results show a drop in accuracy from 90.1% to 51.9% when a misleading claim is present, and a new training‑free agent, DEAR, improves accuracy under misleading claims to 81.8–85.2% while reducing trap‑answer selection.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computation and Language
Oct 9

MiniVer-V: Identifying Minimal Sufficient Evidence for Short Video Verification

MiniVer‑V is a new benchmark for short‑video fact‑checking that contains 195 videos, each annotated with a supported, refuted, or insufficient verdict and 5,510 multimodal evidence units (visual keyframes, speech transcripts, and web‑retrieved sources). The authors propose a two‑layer verification framework that first checks claim‑video consistency using internal evidence, then determines the factual verdict with external corroboration, and employs a sufficiency‑driven greedy search to assemble only the minimal evidence needed for a confident decision. Using Claude Sonnet 4, the method achieves a Macro‑F1 of 0.510 with an average of 4.5 evidence units—about 16 % of the full set—while matching the full‑evidence baseline and improving detection of insufficient cases.

By Leran Chen, Lingnan Kong, Zile Cai
arXiv AI
Sep 10

Beyond the Verdict: Evidence-Aligned Evaluation of Visual Prompt-Injection Guardrails

The paper introduces Mind2Web-Injection, a benchmark of 9,954 instruction‑screenshot pairs designed to evaluate whether vision‑language models (VLMs) use visual evidence when judging conflicts between on‑screen text and user instructions. Across six VLMs, models with similar overall precision can differ dramatically in Evidence‑Aligned Detection (EAD), revealing that verdict‑only metrics miss critical grounding failures. The authors also propose two training‑free interventions—ReadGate and CmdCompare—to improve evidence grounding and instruction‑command consistency, and argue for separate reporting of verdict correctness, evidence localization, and counterfactual responsiveness.

By Suyoung Lee, Myungsub Choi
arXiv AI
Oct 5

Misinformation Without Triggers: From Factual Answers to Downstream Decisions

The study investigates how false content in training data can influence language models’ downstream decisions even without explicit triggers. By comparing models trained on misleading versus truthful documents in a controlled decision task and a real‑world bushfire case, the authors find a gap between factual answers and the decisions derived from them: correct facts do not always lead to correct decisions, and removing an injected number does not eliminate the misleading narrative. The research highlights that data poisoning can subtly alter model behavior beyond what is detectable through direct probing.

By Lin Tian, Marian-Andrei Rizoiu