arXiv Computer Vision By Nishi Kanta Paul, Md Shihabul Islam Shovo, Md Mostafijur Rahman, Jamil Fayyad

Coupled or Independent? Fault Coupling in Agentic Medical Vision Systems

Read the original on arXiv Computer Vision →

The paper investigates how vision‑language agents that expose intermediate outputs can be affected when the sensor reading is unreliable, causing both the tool and reasoning channels to share a visual fault. Using a dermatology agent on the PAD‑UFES‑20 dataset, the authors introduce a fault‑coupling taxonomy distinguishing single‑channel errors from joint errors that agree or disagree, and show that typographic injection leads to detectable directional retrieval errors while physical corruption does not. They find that crop‑first retrieval yields a higher rate of joint wrong agreement (55%) compared to full‑image retrieval (35%), and that hard‑label channel comparison struggles to detect joint failures, limiting disagreement recall to 0.29 for crop‑first and 0.57 for full‑image retrieval, with similar effects observed on the HIBA test set.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Oct 7

SalArt-VQA: Diagnosing Whether VLMs Understand Salient Artifacts in Generated Images

SalArt-VQA is a diagnostic benchmark that tests whether vision‑language models can understand salient artifacts in AI‑generated images. It includes 950 images and 3,681 multiple‑choice questions that assess artifact presence, semantic localization, spatial grounding, and evidence‑grounded defect identification. The benchmark reveals that high image‑level detection accuracy can mask failures in grounded understanding, showing a trade‑off between sensitivity and calibration.

By Ruotian Zhang, Xiaoxiao Sun, Junzhe Huang, James Burgess, Serena Yeung-Levy