arXiv AI
Sep 15

NoteVQA: Benchmarking VLMs on Real-Life Questions from Human Communities

NoteVQA is a new benchmark that collects 252 real‑life visual questions from the Chinese image‑sharing platform Xiaohongshu, covering 12 topics and 7 user intents. Each question is paired with a concise expert reference and a human‑audited interleaved answer that blends text and visual evidence. The study evaluates VLMs on short‑answer correctness and interleaved answer quality using a new AgenticInterleave framework and a 12‑dimensional IVR‑12 rubric, finding that even state‑of‑the‑art models achieve only about 53% accuracy and lag behind human references in content quality.

By Haonan Jiang, Guojian Zhan, Jiancong Xie, Shijun Wan, Dongiia Zhao, Cheng Chen, Yahui Liu, Yao Hu, Chuan Mu
Hugging Face Trending Papers
Oct 27

VGIQA: Fine-Grained Image Quality Assessment with Visual Grounding Rewards

VGIQA is a new image quality assessment model that provides both local and global quality evaluations. It uses a two‑stage training process—starting with a cold‑start phase and then reinforcement learning guided by local quality reward functions. The model demonstrates superior performance on the newly introduced VGSR‑2K dataset, outperforming existing open‑source multi‑modal large language models such as Qwen2.5‑VL‑72B‑Instruct and Qwen3‑VL‑32B‑Instruct, and it also improves degradation perception tasks.

arXiv Computer Vision
Oct 28

VGIQA: Fine-Grained Image Quality Assessment with Visual Grounding Rewards

VGIQA is a new image quality assessment model that provides both local and global quality evaluations. It uses a two-stage training process—initial cold-start followed by reinforcement learning—with local quality reward functions. The model outperforms existing large multimodal language models on the newly introduced VGSR-2K dataset and improves performance on degradation perception tasks.

By Weichang Wang, Liyu Chen, Shuyue Guan, Jie Hu, Fei Gao, Wei Li, Nannan Wang