The paper introduces Iris, a framework that extends typed decision‑making models to multimodal settings where candidates can be images, text, or hybrids. Iris preserves key properties such as candidate‑order invariance, scalability, and cache reuse, and achieves high accuracy on a visual‑candidate benchmark while reducing latency through efficient encoding strategies. The authors also demonstrate significant speedups on GPU systems and outperform larger baseline models on MetaEncoder benchmarks.
By Fengxin Li
arXiv:2610. 29052v1 Announce Type: cross Abstract: A typed decision maps evidence, a question and a fixed set of options to a probability for every option, computed in one forward pass, by reading a language model's logits or a small head over its hidden states, instead of generating and parsing text.
By Yuchuan Weng, Chi Liu, Xin Chen, Srinivasan Manoharan
Verdict-MQ is an open encoder that processes a single piece of state once and then answers multiple typed questions about that state, avoiding separate passes for each question. By using a structured attention mask, it ensures the state encoding is independent of question order and prevents questions from influencing one another. On the typed‑decisions benchmark, Verdict‑MQ outperforms a larger specialist model, achieving higher accuracy and better calibration, while on other benchmarks it shows mixed results compared to fine‑tuned baselines.
By Avdhesh Singh Chouhan, Jack Perry
ReVisIT is a train‑free framework that turns retrieved image‑label pairs into units of visual thought, combining structured class definitions, multimodal retrieval, and alternating user/assistant injection before joint decoding. On several benchmarks—including Fast Open MiniImageNet, Bongard‑OpenWorld, and the newly released MAAC‑Bench—ReVisIT achieves performance comparable to or surpassing large, trained models while using far fewer parameters. The approach demonstrates that high‑quality retrieval and a simple turns layer can provide a universal performance boost across diverse multimodal tasks.
By Bingchen Huang, Zhiling Wang, Yifu Chen, Yuanchao Du
The paper introduces GLANCE, a one‑pass block drafting method that enables lossless speculative decoding for vision‑language models. By using a block‑diffusion head that reads the fused vision‑language state, GLANCE eliminates the need for the drafter to process the image at every step, allowing it to fill an entire block in a single forward pass. Experiments show that GLANCE can decode up to 2.93× faster than autoregressive decoding while maintaining exact greedy decoding results across multiple tasks.
By Jungseob Lee, Seongtae Hong, Dongyub Jude Lee, Chanjun Park, Jaehyung Seo, Sugyeong Eo, Heuiseok Lim
arXiv:2610.36877v1 Announce Type: new
Abstract: Mobile GUI agents are typically fine-tuned 7B-scale vision-language models (VLMs) that generate each action as text. However, these VLMs decode every a...
By Bingchao Wang, Yongcheng Jing, Shunyu Liu, Chengyu Wang, Jun Huang, Jie Yang, Wei Liu, Dacheng Tao
Visual Jev is a method that encodes an image and its public context once, then processes multiple independent forced‑choice questions in a single batch by reading candidate probabilities from the backbone’s language‑model head. Post‑training on four benchmarks improves macro accuracy from 70.6% to 76.1%, especially for the two task families seen during training. The batched approach is 8.9× faster than serial execution and 3.4× faster than a baseline that recomputes the prefix, though it uses more peak memory.
By Guanxu Yu, Yuhang Yao
Intern-Decision introduces 0.8B, 2B, and 4B multimodal decision models that output structured choices and probabilities directly from text and optional images, avoiding the latency of free‑form responses. The models use an autoregressive masked language modeling objective, placing decision placeholders in a JSON skeleton and evaluating all fields in a single causal pass. The 4B variant attains 90.02% unweighted accuracy across seven benchmarks, with sub‑45 ms latency on an RTX 4090, and demonstrates improved calibration and handoff performance in pilot studies.
arXiv:2606.18974v3 Announce Type: replace
Abstract: Unified multimodal models (UMMs) interleave generated ''visual thoughts'' (VTs) with text reasoning to improve spatial tasks. This incurs roughly a...
By Pengyu Li, Zhitao Gao, Lingling Zhang, Muye Huang, Yuanming Li, Fangzhi Xu, Jun Liu
arXiv:2607. 13188v1 Announce Type: new Abstract: Human cognition does not separate understanding and generation.
By Minh-Quan Le, Armand Comas, Alexandros Lattas, Stylianos Moschoglou, Pedro V\'elez, Amit Raj, Aaron Germuth, Thabo Beeler, Dimitris Samaras, Di Qiu
arXiv:2606. 31495v1 Announce Type: new Abstract: We study a single idea across two settings: that a prediction-error signal, computed by a small predictor over the latent space of a frozen encoder, can serve both as a gate on plasticity and as a substrate for metacognition.
By Louis Mouchon
The paper investigates how new concepts can be integrated into unified multimodal models (UMMs) by separating generation and understanding objectives through a novel visual entity bound to a single task direction. Experiments show that the effectiveness of cross‑task usability depends on where the concept is injected into the shared computation, with a mid‑stack alignment objective achieving high concept acquisition with minimal loss to overall performance. The study highlights that unified weights alone are insufficient; the two directions must share a semantic format at the entry point for efficient concept integration.
By Zongyang Qiu, Yihan Wu, Kaixuan Fan, Bo Li, Hui Xiong