arXiv Computer Vision By Robert Wijaya, Ngai-Man Cheung

Mixture of Cognitive Experts in Large Vision-Language Models

Read the original on arXiv Computer Vision →

The paper proposes a framework that integrates multiple specialized computer‑vision experts into large vision‑language models (LVLMs) by using a hierarchical, evidence‑driven reasoning protocol inspired by Bloom’s taxonomy. It introduces a two‑stage cognitive verbalization process: first, a Literal Evidence Summary decomposes expert outputs into atomic evidence statements; second, Bloom Verbalization converts these into a staged reasoning trace. A lightweight Reasoning Trace Module then quantitatively analyzes the trace, making evidence usage and reasoning progression explicit, leading to improved perception and reasoning performance and revealing query‑dependent cognitive entry levels and evidence‑use trajectories.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Oct 22

CAVE: A Structured Credit Assignment Approach for Fragmented Visual Evidence Reasoning

The paper introduces CAVE, a structured credit assignment method that enhances Vision‑Language Models by evaluating intermediate reasoning steps through belief updates, evidence acquisition, and adaptive focus control. CAVE is built on a GRPO framework and guides models to optimize each action, improving reliability in fragmented visual reasoning. The authors also present TRACER‑Bench, a new benchmark covering nonlocal and semantically confusable reasoning dimensions, and show that CAVE boosts performance on both public datasets and this benchmark while maintaining strong general multimodal results.

By Tengda Guo, Jie Leng, Hanlei Li, Yaoyuan Liang, Qingyue Zhang, Dian Yang, Mingyu Zhang, Yuhua Fu, Shao-Lun Huang
arXiv AI
Sep 1

Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes

arXiv:2506.09557v2 Announce Type: replace-cross Abstract: While Multimodal Large Language Models (MLLMs) demonstrate impressive performance in benign scenarios, their cognitive reliability deteriorat...

By Zhaoyang Wei, Bowen Jiang, Xumeng Han, Jiashu Li, Xuehui Yu, Yuling Liu, Guorong Li, Zhenjun Han, Jianbin Jiao
arXiv AI
Aug 12

Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes

arXiv:2608. 10954v1 Announce Type: cross Abstract: While Multimodal Large Language Models (MLLMs) demonstrate impressive performance in benign scenarios, their cognitive reliability deteriorates significantly in complex scenes under adverse conditions.

By Zhaoyang Wei, Bowen Jiang, Xumeng Han, Jiashu Li, Xuehui Yu, Yuling Liu, Guorong Li, Zhenjun Han, Jianbin Jiao
arXiv AI
Oct 16

CoWorld Reasoner: Agentic Multimodal Reasoning with the Evolving Video World Model-Driven Harness

CoWorld Reasoner is an agentic framework that leverages a Video World Model (VWM) as a unified visual reasoning engine for Vision‑Language Models (VLMs). It exposes multiple visual operations through tools and skills, allowing the VLM to decide when to imagine, select an operation, generate visual content, and interpret the resulting evidence. The framework includes a VLM‑VWM Harness Co‑Evolution mechanism that jointly refines tools, skills, and execution code based on feedback, while keeping model weights fixed. Across seven benchmarks covering spatial, temporal, causal, and perceptual reasoning, CoWorld Reasoner outperforms direct VLM reasoning and improves accuracy on all benchmarks, achieving notable gains on MMSI and ERQA.

By Dongjie Cheng, Ruifeng Yuan, Ran Wei, Ning Song, Yongqi Li, Wenjie Li