LanteRn: Latent Visual Structured Reasoning
arXiv:2603. 25629v2 Announce Type: replace-cross Abstract: While language reasoning models excel in many tasks, visual reasoning remains challenging for current large multimodal models (LMMs).
arXiv:2603. 25629v2 Announce Type: replace-cross Abstract: While language reasoning models excel in many tasks, visual reasoning remains challenging for current large multimodal models (LMMs).
SLVR (Structured Latent Visual Reasoning) is a training framework that blends explicit chain-of-thought with latent reasoning for multimodal large language models. It organizes reasoning into typed latent stages—planning, grounding, evidence selection, and integration—each supervised by corresponding signals such as plans, bounding boxes, visual evidence, and final rationales. Built on Qwen2.5‑VL‑7B, SLVR consistently improves performance on multimodal reasoning benchmarks, achieving significant gains on MMVP, BLINK Relation, V*, MathVista, and ChartQA.
arXiv:2511. 17731v2 Announce Type: replace-cross Abstract: Chain-of-Thought (CoT) prompting has proven remarkably effective for eliciting complex reasoning in large language models (LLMs).
arXiv:2606. 15160v1 Announce Type: cross Abstract: Reasoning capabilities of multimodal large language models (MLLMs) have improved considerably in recent years.
arXiv:2608. 03450v1 Announce Type: cross Abstract: Reasoning in Multimodal Large Language Models (MLLMs) requires both fine-grained visual perception and rigorous logical deduction.
The paper introduces LARK, a two‑stage latent reasoning framework designed to mitigate cross‑modal dilution in multimodal recommendation systems. In the first stage, learnable latent tokens are interleaved with chain‑of‑thought reasoning and aligned with a frozen vision encoder to preserve visual details. The second stage projects these latent representations through a bridge MLP, employing item‑to‑item contrastive learning and aligning intermediate features with the first‑stage hidden states to anchor final embeddings to the model’s reasoning output. Experiments on three public benchmarks and an industrial dataset demonstrate that LARK achieves state‑of‑the‑art performance across multiple recommendation architectures, with ablation studies confirming the contribution of each component.
arXiv:2603. 00171v3 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) are shifting towards "Thinking with Images" by actively exploring image details.
Recent advancements in chain-of-thought (CoT) reasoning have shown promise in enhancing video understanding and reasoning capabilities of multimodal large language models (MLLMs). However, existing CoT-based MLLMs require labor-intensive CoT annotations and incur substantial training and inference overhead.
The paper introduces LIRSeg, a method that replaces explicit Chain-of-Thought reasoning in multimodal large language models with a compact set of learnable latent tokens for reasoning segmentation. LIRSeg is trained in two stages—spatial alignment and GRPO—while employing extreme-advantage sampling, decoupled exploration-stability updates, and latent diversity amplification to enhance token informativeness. Experiments show that LIRSeg improves segmentation accuracy and reasoning efficiency, achieving significant gIoU gains over the VisionReasoner baseline and reducing reasoning tokens by about 16×.
arXiv:2608. 15869v1 Announce Type: cross Abstract: Multimodal large language models increasingly use visual chain-of-thought (Visual CoT) to reason about spatial, temporal, and embodied environments.
arXiv:2605.16638v2 Announce Type: replace Abstract: Recent research has demonstrated that Universal Multimodal Embedding (UME) benefits significantly from Chain-of-Thought (CoT) reasoning. In this pa...
arXiv:2606. 00562v1 Announce Type: cross Abstract: The emerging paradigm of "thinking with images" embeds visual states into intermediate reasoning steps, defining a new frontier for Vision-Language Models.