arXiv Machine Learning

Conservative Hybrid Graph Networks for Process Systems with Learned Routing

arXiv AI
Jul 21

Exact Network Surgery: Functional Invariance and Gradient Plasticity in Reactive Computational Graphs

arXiv:2607. 16568v1 Announce Type: new Abstract: Function-preserving network growth techniques such as Net2Net and progressive stacking expand a model's capacity without destroying its learned function, but existing formulations either tolerate numerical perturbations or require a full rebuild of the training program.

By Abdallah Khemais (ISITCOM, University of Sousse)
arXiv Machine Learning
3d ago

Universality and Convergence of Generative Flows

The paper studies generative flows that sample from an unnormalized target by training a flow to satisfy a balance condition. It shows that the training loss can certify sampler accuracy, can be driven to zero, and quantifies how fast gradient descent converges, with explicit bounds depending on the backward policy and graph structure. The authors provide theoretical guarantees, test them on finite graphs, and certify each theorem using a Lean 4 development.

By Leo Brunswic
arXiv Machine Learning
Sep 23

Differentiable Policy Transport over Multi-Layer Network Feasibility Geometry

The paper introduces Network Feasibility Geometry Reinforcement Learning (NFG‑RL), a method that enforces multi‑layer network constraints—such as interference, power‑rate coupling, flow conservation, service chains, capacity, latency, and reliability—by transporting a proto‑policy through a differentiable feasibility map. By compiling heterogeneous constraints into typed residual blocks and using a variational transport operator, NFG‑RL ensures almost‑sure feasible execution and shapes exploration and gradients to respect active constraints. Experiments on two wireless‑edge surrogate environments show that NFG‑RL boosts feasible utility by 37.5–41.5 %, cuts raw‑action violations by 48.5–60.8 %, and reduces P99 delay by 57.0–75.5 % compared to leading baselines.

By Zuyuan Zhang, Zeyu Fang, Mahdi Imani, Nathaniel D. Bastian, Tian Lan
arXiv AI
Jul 22

Cost Accounting for Reactive Computational Graphs: Exhaustive Sweeps, Sequential Mutation, and the Backward-Locality Gap

arXiv:2607. 18323v1 Announce Type: cross Abstract: Exhaustive site-by-site interventions on a neural network's computational graph -- activation-patching sweeps, circuit-discovery searches, systematic ablation studies -- mutate the graph at every candidate site, and their cost is dominated by recomputation after each mutation.

By Abdallah Khemais (ISITCOM, University of Sousse)
arXiv Machine Learning
23h ago

Towards Understanding the Training of GFlowNets: A Theoretical Perspective

The paper presents a theoretical framework linking balance objectives in Generative Flow Networks (GFlowNets) to sampling accuracy. It establishes bounds on terminal symmetric KL divergence in terms of expected balance loss and shows how approximate stationarity controls distribution error, accounting for parameterization incompleteness. The authors prove finite‑time convergence rates under various sampling and backward‑policy regimes, clarifying the roles of coverage, parameterization, and moving components in GFlowNet training.

By Rui Hu, Yu Chen, Zhuoran Li, Longbo Huang