arXiv Computation and Language September 1, 2026 By Tsung-Han Wu, Heekyung Lee, Anya Ji, Haoming Chen, Trevor Darrell, Joseph E. Gonzalez, David M. Chan

CoVA-SFT: A Large-Scale Dataset for Chain of Visual Abstractions

Read the original on arXiv Computation and Language →

CoVA‑SFT is a new large‑scale dataset comprising 51.9K samples and over 222K multimodal reasoning steps that teach models to interleave text and visual abstractions across five layout families and 17 complex tasks. It includes explicit rationale formulations, agentic renderings, and verification loops to help models build and maintain internal visual workspaces for purely textual reasoning problems. A companion benchmark, CoVA‑Bench, contains 1,700 held‑out test samples for reproducible evaluation, and models fine‑tuned on CoVA‑SFT outperform all interleaved CoT baselines by more than 2× on average, though they still lag behind strong text‑only CoT baselines.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Machine Learning

Jul 2

VisReason: A Large-Scale Dataset for Visual Chain-of-Thought Reasoning

arXiv:2511. 17731v2 Announce Type: replace-cross Abstract: Chain-of-Thought (CoT) prompting has proven remarkably effective for eliciting complex reasoning in large language models (LLMs).

By Lingxiao Li, Yifan Wang, Xinyan Gao, Chen Tang, Xiangyu Yue, Chenyu You

llms fine-tuning multimodal benchmarks safety

arXiv AI

Oct 9

SLVR: Structured Latent Visual Reasoning via Human-like Reasoning Flows

SLVR (Structured Latent Visual Reasoning) is a training framework that blends explicit chain-of-thought with latent reasoning for multimodal large language models. It organizes reasoning into typed latent stages—planning, grounding, evidence selection, and integration—each supervised by corresponding signals such as plans, bounding boxes, visual evidence, and final rationales. Built on Qwen2.5‑VL‑7B, SLVR consistently improves performance on multimodal reasoning benchmarks, achieving significant gains on MMVP, BLINK Relation, V*, MathVista, and ChartQA.

By Albert Gao, Bing Xue, Andrea Zanette

llms multimodal benchmarks

arXiv AI

Aug 5

CURV: Enhancing Chart Understanding Through Curriculum Visual Grounded Reasoning

arXiv:2608. 02833v1 Announce Type: cross Abstract: Chart question answering (CQA) requires multimodal large language models (MLLMs) to integrate visual comprehension with logical reasoning, yet current models struggle with accurate visual grounding and coherent reasoning chains.

By Xuehang Guo, Pingyue Zhang, Ruiyi Zhang, Zhenhailong Wang, Hanrui Lyu, Heng Ji, Tong Sun, Qingyun Wang, Manling Li

llms nlp multimodal benchmarks

arXiv Computer Vision

Sep 21

DRT: Dense Reasoning Trace for Efficient and Grounded Multimodal Reasoning

arXiv:2609.21675v1 Announce Type: new Abstract: Despite the remarkable progress in Multimodal Large Language Models (MLLMs), prevailing Chain-of-Thought (CoT) paradigms remain confined to the natural...

By Wan Xu, Yuanfan Guo, Kevin Han, LaLa Chen, Wangmeng Zuo

llms reinforcement-learning multimodal benchmarks safety

arXiv AI

Jun 10

V-REX: Benchmarking Exploratory Visual Reasoning via Chain-of-Questions

arXiv:2512. 11995v2 Announce Type: replace-cross Abstract: While many vision-language models (VLMs) are developed to answer well-defined, straightforward questions with highly specified targets, as in most benchmarks, they often struggle in practice with complex open-ended tasks, which usually require multiple rounds of exploration and reasoning in the visual space.

By Chenrui Fan, Yijun Liang, Shweta Bhardwaj, Kwesi Cobbina, Ming Li, Tianyi Zhou

llms multimodal benchmarks

arXiv AI

Aug 18

Beyond Visual CoT: Internalized Visual Thinking for Proactive Video Reasoning

arXiv:2608. 15869v1 Announce Type: cross Abstract: Multimodal large language models increasingly use visual chain-of-thought (Visual CoT) to reason about spatial, temporal, and embodied environments.

By Xiaoyu Zhu, Xinke Deng, Suresh Taddewadikar, Arnab Kumar Mondal, Zhongyu Jiang, Ian Fasel, Joerg Liebelt

llms rag robotics fine-tuning multimodal

One email a morning, machine-written

Related stories

VisReason: A Large-Scale Dataset for Visual Chain-of-Thought Reasoning

SLVR: Structured Latent Visual Reasoning via Human-like Reasoning Flows

CURV: Enhancing Chart Understanding Through Curriculum Visual Grounded Reasoning

DRT: Dense Reasoning Trace for Efficient and Grounded Multimodal Reasoning

V-REX: Benchmarking Exploratory Visual Reasoning via Chain-of-Questions

Beyond Visual CoT: Internalized Visual Thinking for Proactive Video Reasoning