arXiv Machine Learning

Trajectory-Aware Node Contributions and the Limits of Static Controllability

arXiv:2606. 03067v1 Announce Type: cross Abstract: A recurring data mining task in complex networks is to determine how individual nodes contribute to system behavior.

arXiv Machine Learning
Jul 20

Discovering Generalizable Governing Equations for Graph Dynamical Systems with Interpretable Neural Networks

arXiv:2508. 18173v2 Announce Type: replace Abstract: The discovery of symbolic governing equations is a central goal in science; yet, it remains challenging particularly for graph dynamical systems, where the network topology further shapes the system behavior.

By Riccardo Cappi, Paolo Frazzetto, Nicol\`o Navarin, Alessandro Sperduti
arXiv Machine Learning
Sep 14

Fundamental Dynamical Units for Physics-Informed Structural Inference from Perturbation Time-Series in Networked Systems

The paper introduces Fundamental Dynamical Units (FDUs), signed three‑node interaction patterns that reduce the combinatorial complexity of interaction architectures in networked dynamical systems. By embedding FDU‑regularized structural inference into a physics‑informed neural ODE, the authors jointly recover interaction structure and perturbation‑resolved trajectories, demonstrating the approach on synthetic benchmarks. This framework enables motif‑prescribed intervention design and mechanistically interpretable inference in complex systems.

By Nima Nouri
arXiv Machine Learning
Jul 1

Predictable GRPO: A Closed-Form Model of Training Dynamics

arXiv:2606. 30789v1 Announce Type: new Abstract: Group Relative Policy Optimization (GRPO) has become a standard tool for improving the reasoning ability of large language models, yet its training dynamics are still described empirically: reward trajectories are fit with low-parameter functional forms whose constants carry no mechanistic meaning, and hyperparameter choices remain a matter of trial and error.

By Rajat Ghosh, Datta Nimmaturi, Aryan Singhal, Vaishnavi Bhargava, Henry Wong, Johnu George, Debojyoti Dutta
arXiv Machine Learning
Aug 27

Simultaneous inference of environmental and interaction forces in collective dynamics

The paper presents a variational learning framework that simultaneously infers non‑parametric interaction kernels and environmental or intra‑agent forces in collective dynamics. It extends existing methods to handle both interaction and environmental components, validating the approach on benchmark models such as synchronization, alignment, and attraction‑repulsion systems. A model‑selection procedure is also introduced to identify the best explanatory framework from trajectory data, enabling direct recovery of mechanistic interaction mechanisms.

By Nipuni de Silva, Ming Zhong, James M. Greene
arXiv Machine Learning
Sep 10

When Does Scale-Invariant Optimization Become Unstable? An Exact Schedule Law with Weight Decay

The paper derives an exact discrete‑time law that captures how learning‑rate schedules and weight decay interact in scale‑invariant neural networks, showing that a single scalar quantity governs the effective step size. It demonstrates that the balance point between contraction and expansion is intrinsically unstable, leading to recurrent dynamics when using constant learning rates with weight decay. The authors extend this analysis to various optimizers and datasets, confirming the law’s precision and showing that performance peaks sharply at the predicted boundary.

By Hasan Amin, Wei-Kai Chang, Rajiv Khanna
arXiv Statistics ML
4d ago

On the Nonasymptotic Scaling Guarantee of Hyperparameter Estimation in Inhomogeneous, Weakly-Dependent Complex Network Dynamical Systems

The paper develops a nonasymptotic theoretical framework for estimating hyperparameters in hierarchical Bayesian models applied to large, inhomogeneous complex network dynamical systems. It provides bounds on the deviation of hyperparameter estimates as network size grows, first for independent nodes and then extending to weakly‑dependent nodes, and validates these results with numerical experiments on SIS and spiking neuronal network models.

By Yi Yu, Yubo Hou, Yinchong Wang, Nan Zhang, Jianfeng Feng, Wenlian Lu
Hugging Face Trending Papers
Sep 8

When Does Scale-Invariant Optimization Become Unstable? An Exact Schedule Law with Weight Decay

The paper investigates how normalization makes neural networks scale‑invariant, creating a feedback loop between learning‑rate schedules and weight decay that controls the effective step size of the optimizer. It derives an exact discrete‑time law showing that a single scalar quantity captures all schedule and decay effects, with norm growth providing a self‑quenching counter‑force that defines a sharp boundary between contraction‑ and expansion‑dominated regimes. Through exact analysis of a normalized regression model and experiments on MLPs, CNNs, GPT‑2, and various datasets, the authors demonstrate that constant learning rates with weight decay are intrinsically unstable, leading to recurrent dynamics, and that adaptive optimizers exhibit weaker stabilization under normalization. "whyItMatters":"The study provides a precise, actionable rule for controlling training dynamics and schedule design in modern deep learning by isolating a single governing quantity for scale‑invariant optimization."