arXiv Machine Learning

Federated Learning of Nonlinear Temporal Dynamics with Graph Attention-based Cross-Client Interpretability

The paper introduces a vertical federated learning framework that learns one‑step‑ahead cross‑client temporal interdependencies in decentralized industrial systems with heterogeneous, proprietary models. Each client compresses high‑dimensional sensor data into low‑dimensional latent states via a nonlinear state‑space model, while a central Graph Attention Network (GAT) learns a state‑transition model and derives attention coefficients that reflect cross‑client interactions. The authors analytically link these attention coefficients to the Jacobian of the transition model, proving bounded closeness to a centralized oracle, and validate the approach with synthetic and real‑world experiments showing improved federated root‑cause analysis.

arXiv AI
Sep 25

Beyond Static Graph World Models: Learning Stochastic Latent Dynamics over Evolving Topologies

The paper introduces the Graph Dynamics Model (GDM), a world model that learns stochastic latent dynamics over evolving graph topologies. GDM employs a sparse recurrent adjacency matrix for topology updates and a recurrent state‑space architecture for stochastic transitions, enabling it to handle partially observable, stochastic environments. The authors also propose the Graph Distribution Distance (GDD) metric, using maximum mean discrepancy with a graph kernel, to compare predicted and true joint graph state distributions, and demonstrate GDM’s superior performance and zero‑shot generalisation on large graphs.

By Alex Schutz, Nick Hawes, Victor-Alexandru Darvariu
arXiv Machine Learning
Oct 9

Uncertainty Quantification in Federated Granger Causality Learning

The paper studies uncertainty quantification in federated Granger causality learning, where multiple parties cannot share data but need to infer predictive dependencies across clients. It addresses the challenge that clients observe different features and that cross-client edges must be estimated indirectly through iterative client‑server communication, which propagates both aleatoric and epistemic uncertainty. By deriving closed‑form variance recursions and steady‑state variances, the authors show that initial model‑parameter uncertainty diminishes asymptotically, enabling statistically principled selection of genuine cross‑client dependencies and improving edge recovery in synthetic and real industrial datasets.

By Ayush Mohanty, Nazal Mohamed, Nagi Gebraeel
arXiv Machine Learning
Jul 20

Discovering Generalizable Governing Equations for Graph Dynamical Systems with Interpretable Neural Networks

arXiv:2508. 18173v2 Announce Type: replace Abstract: The discovery of symbolic governing equations is a central goal in science; yet, it remains challenging particularly for graph dynamical systems, where the network topology further shapes the system behavior.

By Riccardo Cappi, Paolo Frazzetto, Nicol\`o Navarin, Alessandro Sperduti
arXiv Machine Learning
Oct 15

BrainDyn: A Sheaf Neural ODE for Forecasting and Generating Brain Dynamics

BrainDyn is a graph ordinary differential equation (ODE) network that models brain activity as coordinated patterns across connected regions. It uses a cellular sheaf with dynamic restriction maps to mediate region-to-region communication through learned linear transformations, rather than the standard shared feature space and scalar summation of message‑passing networks. Evaluated on resting‑state fMRI, EEG, and simulated NEST data, BrainDyn outperforms competing models in multi‑region forecasting, autoregressive generation of brain transients, and prediction of altered transients after controlled perturbations, while its learned features are expressive, interpretable, and biologically aligned.

By Siddharth Viswanath, Panayiotis Ketonis, Cassidy All, William Dai, Gabriel Escobedo, Christine Gao, Jeffrey Lee, Joao Felipe Rocha, Andrew J Steindl, Ian Adelstein, Michael Perlmutter, Dhananjay Bhaskar, Smita Krishnaswamy
arXiv AI
Sep 7

Dynamic Heterogeneous Graph Representation Learning: A Survey

The article surveys Dynamic Heterogeneous Graph Representation Learning (DHGRL), a field that tackles the challenges of modeling evolving, multi‑type networks. It introduces a unified definition covering both discrete‑time and continuous‑time DHGs, and proposes an algorithm‑centric taxonomy that groups methods into embedding‑based, GNN‑based, and Transformer‑based approaches, highlighting their biases toward temporal granularity. The survey also reviews key applications, datasets, benchmarks, and outlines future research directions.

By Huan Liu, Pengfei Jiao, Jie Yin, Hongjiang Chen, Zhidong Zhao
Hugging Face Trending Papers
4d ago

Control Foundation Models across Changing Block Diagrams: Generalizing Time-Series Prediction to Dynamic Graphs

The paper introduces a control foundation model that treats control-experiment data as dynamic graphs, allowing both response prediction and control-input generation to be handled as a unified masked prediction problem. It defines a data space of dynamic graphs with connections, signal values, and missing values, and uses the Block Diagram Transformer (BDT) to combine temporal attention with graph neural networks. Trained on mixed experimental settings, the BDT successfully stabilized an unstable system via feedback control, outperforming fine‑tuned time‑series foundation models.