arXiv AI

Monotone and Separable Set Functions: Characterizations and Neural Models

arXiv:2510. 23634v4 Announce Type: replace-cross Abstract: Motivated by applications for set containment problems, we consider the following fundamental problem: can we design set-to-vector functions so that the natural partial order on sets is preserved, namely $S\subseteq T \text{ if and only if } F(S)\leq F(T) $.

arXiv Machine Learning
Oct 23

Training Mixed-Monotone Neural Networks for Verification Without Set Propagation

The paper introduces a new neural network architecture that represents mixed‑monotone functions as the difference of two monotone subnetworks, enabling tight output enclosures via only two forward passes of opposite corners of an input interval. The enclosure size is a closed‑form function of the network weights, allowing direct minimization during training. Experiments on regression and dynamical‑system benchmarks show that the trained networks achieve enclosure sizes within 0.5% of a proven lower bound while maintaining prediction accuracy, and the method is significantly faster and often tighter than existing techniques such as CROWN, α‑CROWN, and zonotope propagation.

By Jonas Fingerhut, Lukas Koller, Matthias Althoff
arXiv Machine Learning
Oct 22

Supermodular Rank: Set Function Decomposition and Optimization

The paper introduces the concept of supermodular rank, defined as the minimal number of supermodular components required to express a function on a lattice. It characterizes the maximum possible rank and the structure of functions with a fixed rank, and analogously defines submodular rank. Leveraging submodular decompositions, the authors propose an algorithm that partitions a set‑function optimization problem into submodular subproblems, thereby improving approximation guarantees for monotone maximization and ratio minimization while incurring a computational cost tied to the submodular rank.

By Rishi Sonthalia, Anna Seigal, Guido Montufar
arXiv AI
Sep 15

Recurrent GraphNeural NetworkswithSet-BasedAggregation

The paper introduces recurrent Graph Neural Networks (GNNs) that use set-based aggregation and establishes conditions that can be verified directly from the network weights. It proves a two‑directional equivalence between these networks and the Boolean closure of reachability and safety properties, corresponding to the fragment BΣ◦₁ of the modal μ‑calculus. This equivalence allows for verifiable symbolic explanations of networks that satisfy the identified conditions, without relying on counting logic or external halting signals.

By Blai Bonet
arXiv Machine Learning
Oct 21

Do Neural Models Prefer Their Submodels?

arXiv:2610.28439v1 Announce Type: new Abstract: A neural model is the set of functions that can be expressed by a given neural network architecture. Neural models contain natural submodels, such as t...

By Alvaro Ribot, Yulia Alexandr, Anna Seigal