arXiv AI By Dohyun Kim, Junyong Lhim, Kwanyong Park

A Systematic Benchmark for Evaluating Multimodal Personalized Reasoning of Vision-Language Models

Read the original on arXiv AI →

The paper introduces MPRBench, a benchmark designed to evaluate multimodal personalized reasoning in multimodal large language models (MLLMs). It comprises 12 sub-tasks and allows for interpretable analysis of error cases. Experiments show that current MLLMs struggle with personalized reasoning due to inaccurate concept recognition and sensitivity to irrelevant personal information.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 28

Can Linguistic Reasoning Vectors Enhance Multimodal Reasoning Ability?

The paper introduces LIFT, a lightweight vector‑intervention technique that transfers reasoning capability from a base large language model (LLM) to a vision‑language model (VLM) without retraining the VLM backbone. LIFT defines Reasoning Vectors as differences in hidden states between a reasoning path with an explicit trace and a solver path without it, and injects these vectors into the VLM’s language‑side activations. Experiments on two VLMs across six reasoning benchmarks show that vectors derived from the base LLM consistently outperform those derived from the aligned VLM, indicating that the base LLM is a more effective source for recovering degraded reasoning. "whyItMatters":"The study demonstrates that a simple, frozen‑backbone intervention can partially restore reasoning abilities in multimodal models, highlighting the value of leveraging the original language model’s reasoning power."

By Ziyi Wang, Li Li, Aolin Zhou, Yankun Shen, Chonghan Liu, Shuxia Lin, Xu Yang