arXiv AI
Dual-Latent Memory Routing for Vision-Language Reasoning
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Jun 16
DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
arXiv:2606. 15160v1 Announce Type: cross Abstract: Reasoning capabilities of multimodal large language models (MLLMs) have improved considerably in recent years.
arXiv Machine Learning
Jul 28
LanteRn: Latent Visual Structured Reasoning
arXiv:2603. 25629v2 Announce Type: replace-cross Abstract: While language reasoning models excel in many tasks, visual reasoning remains challenging for current large multimodal models (LMMs).
arXiv AI
1d ago
Can Linguistic Reasoning Vectors Enhance Multimodal Reasoning Ability?
The paper introduces LIFT, a lightweight vector‑intervention technique that transfers reasoning capability from a base large language model (LLM) to a vision‑language model (VLM) without retraining the VLM backbone. LIFT defines Reasoning Vectors as differences in hidden states between a reasoning path with an explicit trace and a solver path without it, and injects these vectors into the VLM’s language‑side activations. Experiments on two VLMs across six reasoning benchmarks show that vectors derived from the base LLM consistently outperform those derived from the aligned VLM, indicating that the base LLM is a more effective source for recovering degraded reasoning. "whyItMatters":"The study demonstrates that a simple, frozen‑backbone intervention can partially restore reasoning abilities in multimodal models, highlighting the value of leveraging the original language model’s reasoning power."
arXiv AI
1d ago
Skip the Talk, Re-Focus on Vision: Latent Reasoning for Reasoning Segmentation in Multimodal Large Language Models
The paper introduces LIRSeg, a method that replaces explicit Chain-of-Thought reasoning in multimodal large language models with a compact set of learnable latent tokens for reasoning segmentation. LIRSeg is trained in two stages—spatial alignment and GRPO—while employing extreme-advantage sampling, decoupled exploration-stability updates, and latent diversity amplification to enhance token informativeness. Experiments show that LIRSeg improves segmentation accuracy and reasoning efficiency, achieving significant gIoU gains over the VisionReasoner baseline and reducing reasoning tokens by about 16×.
arXiv AI
Sep 12
Routing by Reasoning Need: Trajectory-Aware Decoding Control for Diffusion Vision-Language Models
The paper introduces a routing-by-reasoning-need controller for diffusion vision‑language models that dynamically selects early commitment, baseline preservation, or reasoning‑supportive decoding based on trajectory signals such as answer closure, commitment evidence, and representation revision pressure. This training‑free approach avoids a single universal generation length, instead tailoring inference‑time control to the reasoning demands of each question. Experiments on answer‑focused, mixed‑reasoning, and chain‑of‑thought benchmarks show that routed control improves robustness compared to fixed long or short decoding and single‑rule interventions, with benefits not solely due to shorter outputs.
arXiv AI
Jun 2
PolarMem: A Training-Free Polarized Latent Graph Memory for Verifiable Vision-Language Models
arXiv:2602. 00415v2 Announce Type: replace Abstract: Memory is not merely a storage mechanism for intelligent systems, but a structure for organizing evidence and constraining belief.