arXiv:2507. 08390v5 Announce Type: replace Abstract: Discrete diffusion models have recently emerged as strong alternatives to autoregressive language models, matching their performance through large-scale training.
By Meihua Dang, Jiaqi Han, Minkai Xu, Kai Xu, Akash Srivastava, Stefano Ermon
arXiv:2607. 04780v1 Announce Type: cross Abstract: Sequential Monte Carlo (SMC) methods are a natural tool for post-hoc conditioning of pretrained generative models, but in many applications the mutation kernels used by the particle system are biased approximations of an ideal Feynman--Kac flow.
By Stanislas Strasman (SU, LPSM), Gabriel Victorino Cardoso (LPSM), Sylvain Le Corff (LPSM), Vincent Lemaire (LPSM), Antonio Ocello
arXiv:2607.04780v2 Announce Type: replace-cross
Abstract: Post-hoc conditioning of pretrained diffusion models can be addressed using Sequential Monte Carlo (SMC) methods. By evolving an interacting...
By Stanislas Strasman (SU, LPSM), Gabriel Victorino Cardoso (STIM), Sylvain Le Corff (LPSM), Vincent Lemaire (LPSM), Antonio Ocello
Sequential Monte Carlo (SMC) methods are a natural tool for post-hoc conditioning of pretrained generative models, but in many applications the mutation kernels used by the particle system are biased approximations of an ideal Feynman--Kac flow. This paper develops a non-asymptotic error analysis for such SMC samplers.
arXiv:2609.35947v1 Announce Type: new
Abstract: Many inference-time tasks for pretrained discrete diffusion models and diffusion language models reduce to drawing samples from a tilted version of the...
By Yinuo Ren, Haoxuan Chen, Grant M. Rotskoff, Jiequn Han, Lexing Ying
The paper introduces the Energy-based Feynman-Kac Corrector (EBFKC), a method that improves inference-time scaling for diffusion models that are imperfect due to data and training limitations. EBFKC derives Feynman-Kac dynamics to exactly track a prescribed path in continuous time, then approximates these dynamics with sequential Monte Carlo and variance‑controlling guidance. Experiments on Gaussian mixtures, particle systems, and molecular simulations demonstrate that EBFKC closely matches target distributions and free‑energy profiles, outperforming standard inference‑time scaling baselines that still exhibit significant sampling errors.
By Zuokai Wen, Louis Grenioux, Weinan E, Jiequn Han
SpecCTMC is a training‑free speculative sampler for masked diffusion language models that reduces the sequential bottleneck of exact continuous‑time sampling. It updates tokens successively using previously computed predictions, evaluates intermediate states in parallel, and applies an exact acceptance‑and‑correction step, thereby preserving the joint distribution of event times, generation order, and token values. Experiments on LLaDA‑8B‑Instruct and Dream‑v0‑Instruct‑7B show 1.73‑4.38× fewer sequential model evaluations while maintaining the reference sampling distribution.
By Siva Rajesh Kasa, Yasong Dai, Sumit Negi, Hongdong Li
arXiv:2607. 23488v1 Announce Type: new Abstract: Text-to-image diffusion models expose many inference-time sampling parameters, including prompts, negative prompts, classifier-free guidance scales, and noise schedules.
By Arisrei Lim, Yossi Gandelsman
arXiv:2601.21647v2 Announce Type: replace-cross
Abstract: Discrete Diffusion Language Models (DLMs) offer a promising non-autoregressive alternative for text generation, yet effective mechanisms for...
By Eden Avrahami, Eliya Nachmani
arXiv:2609.37227v1 Announce Type: new
Abstract: Inference-time steering adapts pretrained diffusion and flow-based models to new tasks, e.g., to generate samples from a conditional distribution or sa...
By Adhithyan Kalaivanan, Zheng Zhao, Jens Sj\"olund, Fredrik Lindsten
Text-to-image diffusion models expose many inference-time sampling parameters, including prompts, negative prompts, classifier-free guidance scales, and noise schedules. These parameters are typically manually chosen once and then held fixed across prompts and denoising timesteps, even though different prompts and stages of generation can benefit from different parameter values.
arXiv:2602. 11133v2 Announce Type: replace Abstract: Diffusion language models generate text through iterative refinement, a process that is often computationally inefficient because many tokens reach stability long before the final denoising step.
By Zakhar Kohut, Severyn Shykula, Mykola Vysotskyi, Serhii Dmytryshyn, Dmytro Khamula, Michal Zakrzewski, Damian Rynczak, Jacek Ma{\l}ecki, Taras Rumezhak, Volodymyr Karpiv