arXiv Machine Learning June 15, 2026 By Ali Asaria, Tony Salomone, Deep Gandhi

Neither Parallel Nor Sequential: How DiffusionGemma Actually Commits Tokens

Read the original on arXiv Machine Learning →

arXiv:2606. 14620v1 Announce Type: new Abstract: Open diffusion language models are marketed as parallel, non-autoregressive decoders, yet the order in which a shipped checkpoint actually commits its tokens is almost never measured.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Aug 7

Answer First, Reason Later: Commitment Order in Diffusion LLMs

arXiv:2608. 05687v1 Announce Type: cross Abstract: Masked diffusion language models (dLLMs) can commit tokens in any order -- a freedom marketed as their core advantage over autoregressive decoding.

By Jewon Yeom, Jaewon Sok, Seonghyeon Park, Jeongjae Park, Hwiyeong Lee, Taesup Kim

llms diffusion

arXiv Machine Learning

Jun 11

Teaching Diffusion to Speculate Left-to-Right

arXiv:2606. 11552v1 Announce Type: cross Abstract: Large language models (LLMs) achieve remarkable performance across a wide range of tasks, but their autoregressive decoding process incurs substantial inference costs due to inherently sequential token generation.

By Lexington Whalen, Yuki Ito, Ryo Sakamoto

llms diffusion benchmarks safety

arXiv AI

Aug 25

Answer First, Reason Later: When Commitment Order Costs Accuracy in Diffusion Language Models

The paper studies how the order in which tokens are committed in masked diffusion language models affects accuracy. It finds that when the final answer is committed before the preceding reasoning (an answer‑first trajectory), accuracy can suffer compared to unrestricted decoding, especially on tasks like GSM8K and MATH‑500. Experiments with controlled token positions show that delaying the answer token can improve performance, indicating that commitment order influences the context and output allocation of the model.

By Jewon Yeom, Jaewon Sok, Seonghyeon Park, Jeongjae Park, Hwiyeong Lee, Taesup Kim

llms diffusion

arXiv AI

Aug 14

Commit Locally, Exit Globally: Coordinating Adaptive Sampling and Early Exit in Diffusion Language Models

arXiv:2607. 28166v2 Announce Type: replace-cross Abstract: Diffusion language models expose a provisional prediction at every denoising step, and on many tasks the candidate answer inside it stabilizes before the step schedule is exhausted.

By Chia-Ming Lee, Shao-Kai Liu, Ming-Ching Chang, Xin Li, Yu-Lun Liu, Chih-Chung Hsu

llms diffusion

arXiv AI

3d ago

Does This Action Still Explain the Task? Reverse Scoring for Diffusion Language Model Agents

arXiv:2609.38536v1 Announce Type: cross Abstract: Diffusion-based large language models (dLLMs) promise to break the sequential latency bottleneck of autoregressive agents through parallel decoding,...

By Jiacheng Qiu, Christopher E. Mower, Jan Peters, Haitham Bou-Ammar, Matthieu Zimmer

llms agents diffusion robotics benchmarks

arXiv AI

Jun 19

How Transparent is DiffusionGemma?

arXiv:2606. 20560v1 Announce Type: cross Abstract: LLM reasoning transparency is a critical affordance for understanding model decisions, mitigating misuse and misalignment, and debugging surprising model behaviors.

By Joshua Engels, Callum McDougall, Bilal Chughtai, Janos Kramar, Senthoran Rajamanoharan, Cindy Wu, Arthur Conmy, Asic Q Chen, Jean Tarbouriech, Min Ma, Brendan O'Donoghue, Jo\~ao Gabriel Lopes de Oliveira, Rohin Shah, Neel Nanda

llms diffusion safety

One email a morning, machine-written

Related stories

Answer First, Reason Later: Commitment Order in Diffusion LLMs

Teaching Diffusion to Speculate Left-to-Right

Answer First, Reason Later: When Commitment Order Costs Accuracy in Diffusion Language Models

Commit Locally, Exit Globally: Coordinating Adaptive Sampling and Early Exit in Diffusion Language Models

Does This Action Still Explain the Task? Reverse Scoring for Diffusion Language Model Agents

How Transparent is DiffusionGemma?