arXiv Computer Vision By Ziheng Jia, Zicheng Zhang, Jiaying Qian, Guangtao Zhai, Xiongkuo Min

LLaVA-Assessor: Building the Foundation LMM For Visual Quality Assessment

Read the original on arXiv Computer Vision →

LLaVA‑Assessor is a unified large multi‑modal model (LMM) designed for visual quality assessment, combining image and video inputs. It introduces a two‑task framework—quality interpretation and quality scoring—supported by an adaptive architecture, a rigorous human‑annotated dataset, and a machine‑synthesized data expansion pipeline. The model employs a prompt‑disentanglement strategy to stabilize multi‑task training and achieves strong performance across 11 quality scoring test sets and 4 interpretation benchmarks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Sep 15

Q-SiT: Teaching LMMs for Image Quality Scoring and Interpreting

Q‑SiT is a unified framework that trains large multimodal models to perform both image quality scoring and interpreting simultaneously. By converting standard IQA datasets into question‑answer pairs and adding human‑annotated interpreting data, the model learns to quantify overall quality and describe perceived attributes. An efficient balance strategy optimizes data mix ratios on lightweight models before scaling to full‑size LMMs, reducing computational cost while improving cross‑task knowledge transfer.

By Zicheng Zhang, Haoning Wu, Ziheng Jia, Weisi Lin, Guangtao Zhai
arXiv Computer Vision
Aug 27

PreResQ-R1: Response-Preference Disentangled Ranking-and-Scoring Reinforcement Optimization for Robust Visual Quality Assessment

PreResQ‑R1 introduces a Preference‑Response Disentangled Reinforcement Learning framework for Visual Quality Assessment that jointly optimizes absolute score regression and relative ranking consistency. It employs a dual‑branch reward system—modeling intra‑sample response coherence and inter‑sample preference alignment—trained with Group Relative Policy Optimization. The method extends to video quality assessment via a global‑temporal and local‑spatial data flow strategy, achieving state‑of‑the‑art results on 10 IQA and 5 VQA benchmarks with only 6K images and 28K videos, and provides human‑aligned reasoning traces.

By Zehui Feng, Weichuan Wang, Xiaohan Chen, Ting Han
Hugging Face Trending Papers
Jun 29

LEIQ-Assessor: Multi-dimensional Quality Assessment of Low-light Enhanced Images via Multi-task Learning

Low-light image enhancement algorithms (LIEAs) aim to improve the visibility of images captured under poor illumination. However, the enhancement process often introduces artifacts such as noise amplification, color shift, structural damage, and over-exposure, which degrade the perceptual quality of the enhanced images.