arXiv Machine Learning By Wooseong Choi, Italo'Ivo Lima Dias Pinto, Chen Sun, Gaurav Gupta, Dong Song, Paul Bogdan

A Generative Model of Complex Networks Using Graphons and Neural Inverse Operators

Read the original on arXiv Machine Learning →

The paper introduces a generative graph model that combines mechanistic interpretability with amortized inference by formulating both the generative process and parameter recovery in function space. It extends step graphons to a multifractal construction, enabling a neural inverse operator that can infer parameters for unseen graph sizes. Experiments show the model outperforms a pretrained graph foundation model on zero‑shot generation and matches instance‑specific methods on single‑observation networks, while also sensitively tracking brain state changes in an EEG study.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 7

Reservoir-Based Graph Convolutional Networks

The paper introduces RGC‑Net, a Reservoir‑Based Graph Convolutional Network that combines fixed‑random reservoir dynamics with a structured convolutional framework for graph learning. It addresses limitations of existing reservoir‑based GNNs by adding a leaky integrator for better feature retention and a robust, adaptable architecture for graph classification and generation. Experiments demonstrate state‑of‑the‑art performance on classification and generative tasks, including dynamic brain connectivity, with faster convergence and reduced over‑smoothing.

By Mayssa Soussia, Gita Ayu Salsabila, Mohamed Ali Mahjoub, Islem Rekik
arXiv Machine Learning
Oct 23

xVGAE: A Hierarchical Variational Graph Autoencoder for Exchangeable Graphs

The paper introduces xVGAE, a hierarchical variational graph autoencoder designed for exchangeable graphs. Leveraging the Aldous-Hoover theorem, the model uses a graph-level latent variable, exchangeable node-specific latent variables, and a graphon function to learn and generate graph distributions efficiently. Experiments demonstrate that xVGAE produces high-quality graphs quickly while capturing key structural properties of the training data.

By Daniele Micheletti, Federica Zoe Ricci, Erik B. Sudderth
arXiv AI
Oct 16

Interpreting Language Model Parameters

The paper introduces adVersarial Parameter Decomposition (VPD), a method that splits a language model’s parameters into simple subcomponents, each responsible for a small part of the model’s algorithm. VPD optimizes these decompositions so that the model’s input‑output behavior remains intact even when many subcomponents are removed, including adversarially chosen ones. This approach enables a new form of circuit analysis by tracing how sequences of parameter subcomponents interact to produce outputs for specific inputs.

By Lucius Bushnaq, Dan Braun, Oliver Clive-Griffin, Bart Bussmann, Nathan Hu, Michael Ivanitskiy, Linda Linsefors, Lee Sharkey