arXiv Machine Learning

Formally Verifying Analog Neural Networks Under Process Variations Using Polynomial Zonotopes

arXiv:2605. 10474v2 Announce Type: replace Abstract: Analog neural networks are gaining attention due to their efficiency in terms of power consumption and processing speed.

arXiv Machine Learning
Sep 15

Beyond Noise: Understanding and Overcoming Temperature Effects in Analog DNN Inference

The paper investigates how temperature affects analog deep neural network (DNN) inference, focusing on both stochastic and systematic non‑idealities in analog hardware. Experiments show that temperature‑induced performance loss is mainly driven by systematic errors rather than random noise. The study evaluates various mitigation techniques, finding that noise‑aware training and temperature‑aware calibration—especially hardware‑in‑the‑loop training—best preserve inference accuracy across different thermal conditions.

By Niklas Summ, Xiao Wang, Hendrik Borras, Bernhard Klein, Holger Fr\"oning
arXiv Machine Learning
Aug 19

Certified but Private: Scalable Zero-Knowledge Proofs for Neural Network Guarantees

PANDA is a scalable system that uses zero‑knowledge proofs to certify the robustness and fairness of neural networks without revealing their private parameters. Built on the CROWN robustness framework, PANDA introduces a novel algorithm for proving linear relaxation bounds on non‑linear activation layers, producing lightweight proofs. The system can generate proofs for networks with over 2.9 million parameters in just five minutes and verify them in ten seconds, scaling polynomially with network size and enabling verification of models four orders of magnitude larger than prior ZKP‑based approaches.

By Youwei Zhong, Ben Merbaum, Timos Antonopoulos, Ning Luo, Charalampos Papamanthou, Katerina Sotiraki, Ruzica Piskac
arXiv Machine Learning
Oct 23

Training Mixed-Monotone Neural Networks for Verification Without Set Propagation

The paper introduces a new neural network architecture that represents mixed‑monotone functions as the difference of two monotone subnetworks, enabling tight output enclosures via only two forward passes of opposite corners of an input interval. The enclosure size is a closed‑form function of the network weights, allowing direct minimization during training. Experiments on regression and dynamical‑system benchmarks show that the trained networks achieve enclosure sizes within 0.5% of a proven lower bound while maintaining prediction accuracy, and the method is significantly faster and often tighter than existing techniques such as CROWN, α‑CROWN, and zonotope propagation.

By Jonas Fingerhut, Lukas Koller, Matthias Althoff
arXiv Machine Learning
Jun 4

Certified Neural Approximations of Nonlinear Dynamics

arXiv:2505. 15497v3 Announce Type: replace Abstract: Neural networks hold great potential to act as approximate models of nonlinear dynamical systems, with the resulting neural approximations enabling verification and control of such systems.

By Frederik Baymler Mathiesen, Nikolaus Vertovec, Francesco Fabiano, Luca Laurenti, Alessandro Abate
arXiv AI
2d ago

Certified Circuits: Stability Guarantees for Mechanistic Circuits

Certified Circuits introduces a framework that wraps any black‑box circuit discovery algorithm with randomized data subsampling to provide provable stability guarantees. By certifying that inclusion decisions over circuit components are invariant to bounded edit‑distance perturbations of the concept dataset, unstable components are abstained from, producing more compact and accurate mechanistic explanations. Across ResNet, ViT, and GPT‑2 on vision and language tasks, Certified Circuits achieves up to 56% higher accuracy and up to 80% fewer components, maintaining reliability where baseline methods degrade.

By Alaa Anani, Tobias Lorenz, Bernt Schiele, Mario Fritz, Jonas Fischer
arXiv Machine Learning
Jun 26

Generative Models on Analog Hardware with Dynamics

arXiv:2606. 27294v1 Announce Type: cross Abstract: Analog hardware platforms such as coupled oscillators and Analog Ising Machines naturally solve differential equations at a fraction of the energy cost of digital computation, making them attractive for low-power generative modeling, yet a fundamental mismatch exists: modern generative models assume flexible, software-defined dynamics, whereas analog hardware imposes fixed, physics-determined differential equations with limited approximation capacity.

By Yu-Neng Wang, Sara Achour
arXiv Machine Learning
Aug 26

Encrypted Neural Networks without Overflows

arXiv:2605.23096v2 Announce Type: replace-cross Abstract: The popular Cheon-Kim-Kim-Song (CKKS) scheme enables efficient private inference in neural networks by evaluating them on encrypted data. Sin...

By Philipp Kern, Lorenzo Rovida, Samuel Teuber, Edoardo Manino, Carsten Sinz, Alberto Leporati