arXiv Computation and Language
What MLLMs Learn about When they Learn about Multimodal Reasoning
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
arXiv Computer Vision
Sep 21
DRT: Dense Reasoning Trace for Efficient and Grounded Multimodal Reasoning
arXiv:2609.21675v1 Announce Type: new Abstract: Despite the remarkable progress in Multimodal Large Language Models (MLLMs), prevailing Chain-of-Thought (CoT) paradigms remain confined to the natural...
arXiv AI
Sep 28
Can Linguistic Reasoning Vectors Enhance Multimodal Reasoning Ability?
The paper introduces LIFT, a lightweight vector‑intervention technique that transfers reasoning capability from a base large language model (LLM) to a vision‑language model (VLM) without retraining the VLM backbone. LIFT defines Reasoning Vectors as differences in hidden states between a reasoning path with an explicit trace and a solver path without it, and injects these vectors into the VLM’s language‑side activations. Experiments on two VLMs across six reasoning benchmarks show that vectors derived from the base LLM consistently outperform those derived from the aligned VLM, indicating that the base LLM is a more effective source for recovering degraded reasoning. "whyItMatters":"The study demonstrates that a simple, frozen‑backbone intervention can partially restore reasoning abilities in multimodal models, highlighting the value of leveraging the original language model’s reasoning power."
arXiv Machine Learning
Jul 2
VisReason: A Large-Scale Dataset for Visual Chain-of-Thought Reasoning
arXiv:2511. 17731v2 Announce Type: replace-cross Abstract: Chain-of-Thought (CoT) prompting has proven remarkably effective for eliciting complex reasoning in large language models (LLMs).
arXiv AI
Oct 15
Adaptive Look, Flexible Thought: Learning How and How Long to Think in Multimodal Reasoning
arXiv:2610.15810v1 Announce Type: cross Abstract: The introduction of long chain-of-thought (CoT) reasoning and external tools has substantially improved the performance of multimodal large language...
arXiv AI
Jul 24
MIRROR: Learning from the Other View for Multi-Modal Reasoning
arXiv:2607. 21552v1 Announce Type: new Abstract: Unlike large language models (LLMs) that exhibit strong reasoning capabilities, vision-language models (VLMs) struggle with visual reasoning, even on geometry problems that admit equivalent text, diagram, and combined diagram+text views.
arXiv Computation and Language
Sep 15
Func-R1: Incentivizing Mathematical Function Reasoning in Multimodal Large Language Models
arXiv:2609.14779v1 Announce Type: new Abstract: Performing deliberate mathematical reasoning in visual contexts is a hallmark of advanced Multimodal Large Language Models (MLLMs) and requires a sophi...