arXiv Computation and Language
Oct 21

TeCoP: Accelerating Diffusion Large Language Model Decoding via Tentative Context Pipelining

TeCoP is a training‑free decoder that accelerates diffusion large language model (dLLM) decoding by decoupling prediction readiness from context utility. It uses tentative context pipelining and draft‑and‑verify to reuse stable but uncommitted predictions as provisional cross‑block context, with commitment based on confidence and stability checks. Across four dLLMs on GSM8K, Minerva MATH, and MBPP, TeCoP cuts forward evaluations by up to 87% and boosts throughput up to 7.5‑fold without KV caching and 11.77‑fold with caching, outperforming Fast‑dLLM and DSB while maintaining accuracy within one percentage point.

By Jui-Chien Tsou, Hsuan-Chi Liu, Wei-Chin Wang, Yu-Syuan Xu, Chun-Yi Lee
arXiv Machine Learning
Oct 8

CoDR: Training-Free Confidence-Drift Remasking for Diffusion Language Models

CoDR (Confidence Drift Remasking) is a training‑free, sampler‑agnostic refinement pass for masked diffusion language models that detects and corrects early token commitments that become unsupported as context grows denser. It estimates confidence drift for all committed positions using only a few forward passes and remasks only the tokens whose confidence has dropped, thereby improving accuracy across multiple backbones, tasks, and samplers with modest computational overhead.

By Yue Wu, Qinghe Zhang, Yu Zhang, Jian Huang