arXiv Machine Learning

Training Mixed-Monotone Neural Networks for Verification Without Set Propagation

The paper introduces a new neural network architecture that represents mixed‑monotone functions as the difference of two monotone subnetworks, enabling tight output enclosures via only two forward passes of opposite corners of an input interval. The enclosure size is a closed‑form function of the network weights, allowing direct minimization during training. Experiments on regression and dynamical‑system benchmarks show that the trained networks achieve enclosure sizes within 0.5% of a proven lower bound while maintaining prediction accuracy, and the method is significantly faster and often tighter than existing techniques such as CROWN, α‑CROWN, and zonotope propagation.

arXiv Machine Learning
Aug 14

Branch and Bound for Relational Verification of Neural Networks

arXiv:2608. 13118v1 Announce Type: new Abstract: Verification of neural networks against relational specifications, such as global robustness, is crucial for safety-critical applications of cyber-physical systems (CPS), given their increasing adoption of AI components.

By Kota Fukuda, Zhenya Zhang, Guanqin Zhang, Jianjun Zhao
Hugging Face Trending Papers
Jun 16

Monotonic Kolmogorov-Arnold Networks: A Theoretical and Empirical Study of Monotonicity as an Inductive Bias

Monotonicity has been a long-running architectural inductive bias for neural networks, motivated by tabular, scientific, and economic settings where outputs are known to respond monotonically to certain inputs. Existing approaches are MLP- or flow-based and lack per-edge functional transparency; the only Kolmogorov--Arnold Network (KAN) variant with monotonicity, MonoKAN, enforces the constraint only on a restricted parameter subset and requires a projection-style training procedure.

arXiv Machine Learning
Jun 24

Layer-wise Geometric Approximation Rates for Deep Networks

arXiv:2604. 20219v2 Announce Type: replace Abstract: Depth is widely viewed as a central contributor to the success of deep neural networks, whereas standard neural network approximation theory typically provides guarantees only for the final output and leaves the role of intermediate layers largely unclear.

By Shijun Zhang, Zuowei Shen, Yuesheng Xu