Grounding Image Composition with Label-Conditioned Visual Evidence introduces the KU-PCPE benchmark, which provides image-level composition labels and class-specific geometric elements but lacks explicit visual evidence for each label. The dataset contains 4,093 training masks and a 1,327-task expert test split, with annotations that include segment-versus-line ratings to indicate whether region or semantic-guideline evidence better explains a label. Performance metrics show a gap between expert agreement (.867 Dice) and model predictions (.664 for the strongest deployable model, .672 for a proposal oracle, and .395 for a VLM proposal selector).
arXiv:2608. 09101v1 Announce Type: cross Abstract: Semantic segmentation models are trained and evaluated against human-drawn masks, yet remote-sensing annotations are often coarse, incomplete, or misaligned; high overlap scores may then reflect agreement with imperfect labels rather than faithfulness to the image, creating an evaluation paradox.
arXiv:2609.13228v1 Announce Type: new Abstract: Vision Language Models (VLMs) should rely on visual evidence that directly determines the correct answer, but supervision for grounding visual reasonin...
VisionQ is a new benchmark for qualitative analysis in computer vision that evaluates vision‑language models (VLMs) on criterion‑conditioned visual discrimination. It is built from over 1,800 peer‑reviewed comparison figures in CVPR and ICCV papers, linking each image crop to author‑stated visual claims through 3,911 hand‑annotated data points. The benchmark includes a 51‑leaf taxonomy of visual criteria, a protocol that hides method identities and reports accuracy per criterion, and a DPO‑tuned Gemma‑4‑E4B judge that improves accuracy on a held‑out test set.
arXiv:2608. 08021v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) should answer from concrete image evidence rather than language priors, dataset shortcuts, or irrelevant visual context.
arXiv:2607. 10666v1 Announce Type: cross Abstract: Deploying AI-based visual inspection in manufacturing is hard because requirements change often, new defect types appear, and large labeled datasets are rarely available.
AgroGround is a large‑scale dataset that links plant disease and agricultural target labels to image regions, enabling models to both recognize and localize these targets. It was created by automatically converting eight agricultural VQA datasets into 794,850 grounded instruction examples, including healthy images for negative supervision. Fine‑tuning a shared vision‑language model on these instructions improves recognition, joint accuracy, and healthy‑image abstention, outperforming its annotation teacher on both the AgroGround benchmark and the external PlantSeg test set.
arXiv:2609.01027v1 Announce Type: new Abstract: Out-of-distribution (OOD) detection predicts whether a test image belongs to none of the predefined classes. To evaluate this task, benchmarks need ima...
The paper investigates how evaluation protocols and ground‑truth quality affect the classification performance of Multimodal Large Language Models (MLLMs). It identifies and corrects key issues such as discarded out‑of‑list outputs, inflated distractor choices, and poor open‑world mapping, and shows that design choices like batch size, image ordering, and text encoder selection significantly influence accuracy. Using a multilabel reannotation of 625 ImageNet‑1k classes (ReGT), the study finds that corrected labels can boost MLLM performance by up to 10.8%, narrowing the gap with supervised models, and demonstrates that MLLMs can assist human annotators in about half of difficult cases.
arXiv:2607. 16311v1 Announce Type: cross Abstract: Vision-language models (VLMs) often answer visual questions using learned language and category priors rather than grounding their predictions in the image itself.
arXiv:2607. 18695v1 Announce Type: cross Abstract: A popular route to interpretable zero-shot classification asks a large language model (LLM) to describe each class name and prompts CLIP with the resulting descriptors.
arXiv:2608.01988v2 Announce Type: replace Abstract: Rapid advances in image generation models call for interpretable AI-generated image detection methods that not only determine authenticity but also...
arXiv:2611.02897v2 Announce Type: replace Abstract: Traditional image cropping assumes the photograph already contains the composition worth keeping, and asks only where to crop. A full 360$^{\circ}$...