arXiv Computer Vision August 25, 2026 By Xuanle Zhao, Deyang Jiang, Zhixiong Zeng, Lei Chen, Haoyue Yang, Haibo Qiu, Jing Huang, Yufeng Zhong, Liming Zheng, Yilin Cao, Lin Ma

VinciCoder: Unifying Multimodal Code Generation via Coarse-to-fine Visual Reinforcement Learning

Read the original on arXiv Computer Vision →

VinciCoder is a unified framework for multimodal code generation that addresses the limitations of single-task models by training on a large-scale curated corpus of 1.3 M direct generation pairs and 300 k visual‑refinement tasks. It introduces a coarse‑to‑fine Visual Reinforcement Learning (ViRL) approach that uses visual similarity across multi‑scale patches to provide an implementation‑agnostic reward, improving alignment between rendered outputs and input visuals. Experiments on diverse benchmarks show VinciCoder outperforms existing methods, and ablation studies confirm the effectiveness of ViRL.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI

Sep 3

TikZilla: Scaling Text-to-TikZ with High-Quality Data and Reinforcement Learning

TikZilla is a new approach to generating TikZ code from textual descriptions, built on a larger, higher‑quality dataset called DaTikZ‑V4 that includes LLM‑generated figure descriptions. The method uses a two‑stage pipeline: supervised fine‑tuning of small Qwen models (3B and 8B) followed by reinforcement learning with an image encoder that provides semantically faithful reward signals. Human evaluations show that TikZilla outperforms its base models by 1.5–2 points on a 5‑point scale, beats GPT‑4o by 0.5 points, and matches GPT‑5 in image‑based tests while remaining much smaller.

By Christian Greisinger, Steffen Eger

llms reinforcement-learning fine-tuning

arXiv Machine Learning

Sep 16

Towards Scalable RLVR: Multimodal Instruction Following Data Synthesis and Distillation

arXiv:2609.16059v1 Announce Type: cross Abstract: Multimodal instruction following (MMIF) is crucial for building generalist agents. However, current training paradigms rely heavily on Supervised Fin...

By Yirong Zeng, Zhang Sai, Yuxian Wang, Yutai Hou, Yufei Liu, Xiao Ding, Bibo Cai

agents reinforcement-learning fine-tuning efficiency multimodal benchmarks

arXiv AI

Jun 3

Vision Inference Former: Sustaining Visual Consistency in Multimodal Large Language Models

arXiv:2605. 18160v2 Announce Type: replace-cross Abstract: In recent years, multimodal large language models (MLLMs) have achieved remarkable progress, primarily attributed to effective paradigms for integrating visual and textual information.

By Xinpeng Dong, Min Zhang, Kairong Han, Xu Tan, Fei Wu, Kun Kuang

llms computer-vision multimodal benchmarks safety

arXiv AI

Sep 2

VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editing

arXiv:2603.29852v2 Announce Type: replace-cross Abstract: We introduce VectorGym, a comprehensive benchmark suite for Scalable Vector Graphics (SVG) that spans generation from text and sketches, comp...

By Joan Rodriguez, Haotian Zhang, Abhay Puri, Haoran Dai, Tianyang Zhang, Meng Lin, Rishav Pramanik, Xiaoqing Xie, Marco Terral Rodriguez, Darsh Kaushik, Aly Shariff, Perouz Taslakian, Spandana Gella, Sai Rajeswar, David Vazquez, Christopher Pal, Marco Pedersoli

llms reinforcement-learning multimodal benchmarks

arXiv Machine Learning

2d ago

PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesis

arXiv:2610.20538v1 Announce Type: cross Abstract: Multimodal code intelligence connects the symbolic world of programs with the visual world their execution creates. Interest in this capability is bu...

By Qiushi Sun, Jingyang Gong, Yang Liu, Qiaosheng Chen, Zhangyue Yin, Zixian Huang, Hanxu Hu, Jing Xiong, Fangzhi Xu, Haochen Tan, Haoli Bai, Lifeng Shang, Xiaoguang Li, Ben Kao, Qipeng Guo, Lingpeng Kong, Jiahui Gao

reinforcement-learning multimodal data-engineering

arXiv AI

Sep 30

ResComEmb: Effective and Efficient Multimodal Embedding via Residual Homogeneity Compression

arXiv:2609.37225v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) have shown strong potential for universal multimodal representation learning. However, existing methods eith...

By Zijing Cai, Yuzhe Wang, Jingxian Zhu, Fengbin Zhu, Richang Hong

llms rag multimodal

One email a morning, machine-written

Related stories

TikZilla: Scaling Text-to-TikZ with High-Quality Data and Reinforcement Learning

Towards Scalable RLVR: Multimodal Instruction Following Data Synthesis and Distillation

Vision Inference Former: Sustaining Visual Consistency in Multimodal Large Language Models

VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editing

PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesis

ResComEmb: Effective and Efficient Multimodal Embedding via Residual Homogeneity Compression