arXiv Machine Learning

Decomposition-Guided Diffusion Language Models for Inertial Confinement Fusion Prediction

arXiv AI
Jul 14

Co4ICF: Co-evolving Physics-Informed Surrogate and RL-based Pulse Optimizer for Inertial Confinement Fusion

arXiv:2607. 10366v1 Announce Type: new Abstract: Offline-trained surrogates for Inertial Confinement Fusion (ICF) suffer a well-known failure mode that iterative optimizers drive inputs into out-of-distribution (OOD) regions where predictions become unreliable.

By Jiatong Zhao, Tengyue Zhang, Yuhan Wang, Fuyuan Wu, Junchi Yan
arXiv Machine Learning
Jun 8

ScatterPrism: convergence for generative simulation and inverse problems in particle and nuclear physics

arXiv:2604. 01313v2 Announce Type: replace Abstract: High-fidelity simulations and complex inverse problems, such as detector modeling and unfolding, are computationally intensive bottlenecks across subatomic physics, yet essential for accurate physical interpretation.

By Zeyu Xia, Tyler Kim, Trevor Reed, Judy Fox, Geoffrey Fox, Adam Szczepaniak
arXiv AI
3d ago

How Lossless Is Lossless Speculative Decoding? The Role of Numerical Precision in Orthrus

Orthrus is a hybrid autoregressive‑diffusion model that claims to perform lossless speculative decoding by generating multiple tokens in parallel while maintaining a frozen autoregressive backbone. In our independent reproduction, we found that under BF16 precision the model matches the exact autoregressive trajectory only about 45% of the time, whereas with FP32 precision it achieves perfect matching on all evaluated prompts. Despite trajectory mismatches at lower precision, Orthrus does not exhibit systematic degradation on downstream lm‑eval‑harness benchmarks.

By Ilya Koziev, Leonid Sinev, Ivan Oseledets
arXiv Machine Learning
Sep 4

Unlocking Lossless Speedups in LLMs via Discrete Diffusion

arXiv:2609. 04010v1 Announce Type: new Abstract: Large Language Models (LLMs) owe much of their success to next-token prediction (NTP), but their autoregressive (AR) structure requires slow, sequential token generation.

By Subham Sekhar Sahoo, Lingjie Chen, Khiem Pham, Jonathan Geuter, Chaitanya Dwivedi, Varad Pimpalkhute, Yash Akhauri, Alexander Moreno, Mikhail Yurochkin, Zhenting Wang, Mostafa Elhoushi, Nolan Dey, Shane Bergsma, Joel Hestness, John Thickstun, Eric Xing, Zhengzhong Liu
arXiv Machine Learning
Aug 27

Cross-Domain Transfer with Particle Physics Foundation Models: From Jets to Neutrino Interactions

The paper investigates whether two particle physics foundation models, OmniLearned and ParticleViT, pretrained on high‑energy proton–proton and electron–proton collisions can transfer knowledge to a low‑energy neutrino experiment. Using MINERvA neutrino–nucleus scattering data, the authors evaluate the models on energy regression and charged‑current pion classification tasks, finding that the pretrained models outperform similarly sized models trained from scratch, with OmniLearned excelling in regression and ParticleViT in classification. When the same transformer architecture is initialized from unrelated text pretraining (BERT), the performance advantage is minimal for classification and absent for regression, indicating that particle‑level foundation models capture inductive biases that generalize across energy scales, detector technologies, and physics processes.

By Gregor Krzmanc, Vinicius Mikuni, Benjamin Nachman, Callum Wilkinson
arXiv Machine Learning
2d ago

Improving Reduced-Order Rotating Detonation Engine Models with Data Assimilation and Machine Learning

The paper presents a method to enhance one‑dimensional rotating detonation engine (RDE) models by integrating data assimilation and machine learning. Continuous data assimilation (nudging) aligns the low‑order Koch‑Kutz solver with high‑fidelity temperature data, while a Jacobian‑regularized closure is trained on the recorded correction forces. The resulting corrected model, once the observation term is removed, autonomously reproduces the temperature spectrum and key statistical properties of the full high‑fidelity simulation.

By Ashwin Suriyanarayanan, Romit Maulik
arXiv Machine Learning
Aug 7

Kastor: An efficient fine-tuning strategy for generative emulation of PDE simulations

arXiv:2608. 06107v1 Announce Type: new Abstract: Machine learning offers a promising avenue to accelerate physical simulations by replacing computationally expensive traditional Partial Differential Equation (PDE) solvers with fast, differentiable surrogate models.

By Guillaume Couairon, Alexis Jacq, Yu-Han Wu, Renu Singh, Yana Hasson, Quentin Berthet, Romuald Elie