arXiv Machine Learning

Insertion Based Sequence Generation with Learnable Order Dynamics

arXiv:2602. 18695v2 Announce Type: replace Abstract: Existing insertion-based masked diffusion models that generate sequences by interleaving token insertion with unmasking use fixed schedules that are not dependent on the data.

arXiv AI
Jun 2

Variational Learning for Insertion-based Generation

arXiv:2606. 02133v1 Announce Type: cross Abstract: Non-monotonic sequence generation methods, such as masked diffusion models, provide a flexible alternative to left-to-right autoregressive modeling by allowing tokens to be generated in non-fixed and prescribed orders.

By Yangtian Zhang, Zhe Wang, Arthur Gretton, Rex Ying, David van Dijk, Michalis K. Titsias, Jiaxin Shi
arXiv Machine Learning
Jul 13

Autoregressive latent diffusion for 3D molecule generation

arXiv:2607. 09277v1 Announce Type: new Abstract: Three-dimensional (3D) molecule generation has been dominated by diffusion models, which achieve strong generation quality but typically require the molecular size to be specified a priori.

By Federico Ottomano, Gaopeng Ren, Yingzhen Li, Kim E. Jelfs, Alex M. Ganose
arXiv Machine Learning
Jun 2

Adaptive Order Policies for Masked Diffusion

arXiv:2606. 00295v1 Announce Type: new Abstract: Masked diffusion models have seen great success in capturing data distributions over discrete sequences in domains such as text and proteins.

By Jama Hussein Mohamud, Mohsin Hasan, Mirco Ravanelli, Yoshua Bengio
arXiv Machine Learning
Aug 12

Order Matters in Retrosynthesis: Structure-aware Generation via Reaction-Center-Guided Discrete Flow Matching

arXiv:2602. 13136v2 Announce Type: replace Abstract: Template-free retrosynthesis methods treat the task as black-box sequence generation, limiting learning efficiency, while semi-template approaches rely on rigid reaction libraries that constrain generalization.

By Chenguang Wang, Zihan Zhou, Lei Bai, Tianshu Yu