arXiv AI June 30, 2026 By Avinash Reddy, Thayne T. Walker, James S. Ide, Amrit Singh Bedi

The Hidden Cost of Structured Generation in LLMs: Draft-Conditioned Constrained Decoding

arXiv:2603. 03305v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are increasingly used to generate executable outputs, JSON objects, and API calls, where a single syntax error can make the output unusable.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning

Jul 9

Constrained Decoding for Diffusion Language Models via Efficient Inference over Finite Automata

arXiv:2607. 07026v1 Announce Type: new Abstract: Constrained decoding is essential for serving LLMs, ensuring that generated outputs follow specific structures such as JSON schema-formatted function calls.

By Meihua Dang, Stefano Ermon

llms agents diffusion data-engineering

arXiv Computation and Language

Aug 25

Lookahead-then-Verify: Reliable Constrained Decoding for Diffusion LLMs under Context-Free Grammars

arXiv:2602.00612v3 Announce Type: replace Abstract: Diffusion Large Language Models (dLLMs) have demonstrated promising generative capabilities and are increasingly used to produce formal languages d...

By Yitong Zhang, Yongmin Li, Yuetong Liu, Jia Li, Xiaoran Jia, Zherui Li, Ge Li

llms diffusion benchmarks

arXiv AI

Jul 24

DC-Leap: Training-Free Acceleration of dLLMs via Draft-Guided Contiguous Leaping Decoding

arXiv:2607. 20467v1 Announce Type: new Abstract: While parallel decoding is central to the efficiency of Diffusion Large Language Models (dLLMs), current strategies are often hindered by overly conservative confidence thresholds.

By Yanhua Jiao, Tianyi Wu, Xiaoxi Sun, Yulin Li, HuiLing Zhen, Libo Qin, Baotian Hu, Zhuotao Tian, Min Zhang

llms diffusion benchmarks

Hugging Face Trending Papers

Jul 8

Constrained Decoding for Diffusion Language Models via Efficient Inference over Finite Automata

Constrained decoding is essential for serving LLMs, ensuring that generated outputs follow specific structures such as JSON schema-formatted function calls. Existing systems are designed for autoregressive models and assume left-to-right generation, masking out invalid next tokens at each step.

llms agents diffusion data-engineering

arXiv AI

Sep 1

Entropy-Aware Token Rejection for Improving Speculative Decoding

arXiv:2512.23765v2 Announce Type: replace-cross Abstract: Speculative decoding (SD) accelerates large language model (LLM) inference by using a lightweight draft model to propose tokens and a stronge...

By Tiancheng Su, Meicong Zhang, Guoxiu He

llms benchmarks

arXiv Machine Learning

Aug 12

The Parser Already Knows: Lightweight Bias Correction in Constrained Decoding

arXiv:2608. 10137v1 Announce Type: cross Abstract: Grammar Constrained Decoding (GCD) forces Language Models (LMs) to produce syntactically valid outputs by masking out non-conforming tokens at each step.

By I\c{s}{\i}l \"Ozg\"u, Yaoxuan Wu, Guy Van den Broeck, Miryung Kim

llms efficiency safety

One email a morning, machine-written

Related stories

Constrained Decoding for Diffusion Language Models via Efficient Inference over Finite Automata

Lookahead-then-Verify: Reliable Constrained Decoding for Diffusion LLMs under Context-Free Grammars

DC-Leap: Training-Free Acceleration of dLLMs via Draft-Guided Contiguous Leaping Decoding

Constrained Decoding for Diffusion Language Models via Efficient Inference over Finite Automata

Entropy-Aware Token Rejection for Improving Speculative Decoding

The Parser Already Knows: Lightweight Bias Correction in Constrained Decoding