arXiv AI

Deep belief networks are exact

arXiv Machine Learning
Oct 28

Proofs of strong forms of the Bovdi--Geche universality conjecture and a complex analogue

The paper proves two universality theorems for single‑neuron neural networks. First, it establishes a strong form of the Bovdi–Geche universality conjecture for neurons over finite fields, employing a modified discrete logarithm activation function and the Weil bound on multiplicative character sums. Second, it generalises Aizenberg’s universality theorem to complex binary neurons with a weight vector independent of the target function, using an equidistribution theorem for dilates of maps into tori.

By Victor Bovdi, Ambrus Pal
arXiv AI
Aug 18

A concentration result for multilayer feedforward neural networks

arXiv:2608. 15335v1 Announce Type: new Abstract: We consider for an arbitrary fixed $\rho$ and for each positive integer $n$ a multilayer feedforward artificial neural network with $\rho$ layers, $n$ neurons in the first layer (the input layer) and only one neuron, the output neuron, in the last layer.

By Vera Koponen
arXiv Machine Learning
1d ago

Deep Neural Operator Learning for Probabilistic Models

The paper introduces a deep neural-operator framework for a broad class of probabilistic models, proving a universal approximation theorem under global Lipschitz conditions and explicit network-size bounds. It requires only integrability and general tail-probability conditions on the underlying stochastic processes, which are verified for European and American option-pricing problems within the forward-backward SDE framework. A numerical example with a basket of American options demonstrates that the learned model can generate optimal stopping boundaries for new strike prices without retraining.

By Erhan Bayraktar, Qi Feng, Zecheng Zhang, Zhaoyu Zhang