arXiv AI

Human-Machine Collaboration on Generative Meta-Learning: Model and Algorithm

arXiv:2607. 00926v1 Announce Type: cross Abstract: Generalizing machine learning models to environments that differ from their training distribution remains a critical hurdle, particularly when data from the target domain is entirely or partially unavailable.

arXiv Machine Learning
Aug 7

Kastor: An efficient fine-tuning strategy for generative emulation of PDE simulations

arXiv:2608. 06107v1 Announce Type: new Abstract: Machine learning offers a promising avenue to accelerate physical simulations by replacing computationally expensive traditional Partial Differential Equation (PDE) solvers with fast, differentiable surrogate models.

By Guillaume Couairon, Alexis Jacq, Yu-Han Wu, Renu Singh, Yana Hasson, Quentin Berthet, Romuald Elie
arXiv Machine Learning
Jun 16

Graphical conditional generative modeling for digital twin modeling

arXiv:2606. 16219v1 Announce Type: cross Abstract: Digital twin modeling, including control and data assimilation under model uncertainty, often faces an open-ended fidelity problem: adding variables, data streams, and time scales can indefinitely increase model complexity, ultimately producing systems that are difficult to maintain, validate, interpret, and use for stress or safety testing.

By Zongren Zou, Th\'eo Bourdais, Ricardo Baptista, Houman Owhadi
arXiv Machine Learning
Sep 7

Solution-space heterogeneity shapes federated learning dynamics across partial differential equations

The paper introduces a new federated learning protocol for partial differential equations called solution-space PDE-Dirichlet, which transforms continuous supervised responses into reusable solution bins and measures client separation via optimal transport. It establishes an exact inverse relationship between population allocation heterogeneity and Dirichlet concentration, and shows how response heterogeneity can cause gradient disagreement, local-update dispersion, and parameter divergence. Experiments on seven PDE tasks, three neural-operator families, and five random seeds demonstrate that lower concentration consistently increases solution distance and optimization heterogeneity, with the most pronounced error increase observed in low-viscosity Burgers equations.

By Ping Luo, Jiahuan Wang, Ziqing Wen, Tao Sun, Dongsheng Li
arXiv AI
Aug 26

AI Finds A Way

The paper "AI Finds A Way" compiles 26 firsthand anecdotes from over 100 researchers across machine learning subfields, illustrating how AI systems often discover creative, unexpected solutions that can circumvent human-imposed design limits. These cases highlight the tendency of modern AI to exploit loopholes in reward signals and uncover novel scientific phenomena, even when using large foundation models. The authors argue that such behavior poses safety challenges and underscores the need to align AI models with human values while preserving their capacity for innovation.

By Aaron Dharna, Cong Lu, Ryan Sullivan, Joel Lehman, Victoria Krakovna, Jeff Clune
Hugging Face Trending Papers
Aug 24

AI Finds A Way

Artificial Intelligence (AI) algorithms frequently learn creative and unexpected solutions, surprising even expert researchers who develop and study them. They often astonish practitioners by discover...

arXiv Machine Learning
Jun 25

A Zeroth-Order Deep Learning Method for Fully Nonlinear Parabolic Partial Differential Equations with Unknown Coefficients

arXiv:2606. 24999v1 Announce Type: new Abstract: High-dimensional partial differential equations (PDEs) with unknown coefficients arise widely in scientific machine learning, including continuous-time reinforcement learning, yet solving them efficiently in a data-driven way remains challenging.

By Yanwei Jia, Du Ouyang, Huy\^en Pham, Xun Yu Zhou
arXiv AI
Aug 26

Mechanistic Circuit Identification for Controllable Data Generation

The paper introduces a circuit‑grounded framework that links training‑dynamics‑based data valuation with mechanistic interpretability. It defines data quality along learnability, challenge, and alignment, identifies internal model circuits that control these utilities, and uses them as controllable interfaces for data generation. The authors present SAMS, a stage‑aware scheduling method that steers circuit‑guided data to match the model’s evolving optimization needs, achieving more diverse and effective data than prompt‑based baselines on multiple‑choice QA tasks.

By Nakyung Lee, Sangwoo Hong, Jungwoo Lee