arXiv Computer Vision By Tarunya Prasad, Bharatesh Chakravarthi

MiD-VLM: Detecting and Grounding Global Semantic Misinformation in Image-Caption Pairs

Read the original on arXiv Computer Vision →

MiD-VLM is a multimodal model that detects and grounds global semantic misinformation in image-caption pairs. It combines image-text representations from SigLIP with visual scene features from DINOv2, and adapts Qwen2‑VL‑7B using LoRA to jointly predict authenticity, identify manipulation type, and localize misleading caption tokens. On the DGM4+ validation split, it achieves an F1 score of 0.9679 for binary authenticity classification.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Oct 23

Class-Grounded Batik Captioning under Scarce Text Annotation: Label Retention and Source-Specific Error Propagation

The paper presents a batik-captioning system that uses class labels as compact supervision when expert text annotations are scarce. It combines a LoRA‑adapted DINOv2 classifier with a Qwen2.5‑VL‑7B captioner, both loaded in 4‑bit NF4, and evaluates three captioner conditions across 150 images, achieving a 0.9067 ground‑truth class‑label mention rate. The classifier attains 96.10% pooled accuracy, with higher performance on public‑source images (98.33%) than on local images (75.76%), and the study highlights how class conditioning preserves label information while also propagating classification errors into fluent captions.

By Novanto Yudistira, Muhammad Dzaka Aufa Fadhillah, Irawati Nurmala Sari
arXiv Computation and Language
Sep 17

PANORAMA: Panoptic Grounded Captioning via Mask Proposal Selection

PANORAMA introduces a new panoptic grounded captioning framework that jointly generates detailed image captions and associates each phrase with precise pixel-level masks. The authors create PanoCaps, a human‑annotated benchmark with dense captions and near‑complete pixel coverage, and propose a phrase‑mask matching protocol with a generalized Panoptic Quality metric. PANORAMA conditions a pretrained segmenter on contextualized phrase representations, learns to select appropriate masks, and achieves state‑of‑the‑art grounding performance on PanoCaps and other pixel‑level tasks.

By Sara Pieri, Evangelos Kazakos, Shizhe Chen, Josef Sivic, Cordelia Schmid
arXiv AI
Jun 11

OpenVTON-Bench: A Large-Scale High-Resolution Benchmark for Controllable Virtual Try-On Evaluation

arXiv:2601. 22725v4 Announce Type: replace-cross Abstract: Recent advances in diffusion models have significantly elevated the visual fidelity of Virtual Try-On (VTON) systems, yet reliable evaluation remains a persistent bottleneck.

By Jin Li, Tao Chen, Kai Wen, Siqi Yin, Shuai Jiang, Weijie Wang, Jingwen Luo, Chenhui Wu