arXiv Machine Learning

Tractable Inference with Kolmogorov-Arnold Networks

The paper introduces TOUCKANs, a variant of Kolmogorov–Arnold networks that use finite‑degree polynomial outer functions to create a decomposable sum–product structure. This design allows expectations, variances, and higher moments to be computed via deterministic recursions over one‑dimensional integrals, eliminating the need for costly Monte Carlo sampling even in high dimensions. Experiments on uniform and Gaussian benchmarks up to 50 dimensions show deterministic mean and variance errors below those of fixed‑budget Monte Carlo, and the method successfully enforces conservation laws and normalization constraints in physical simulations such as Cahn–Hilliard mass conservation and Schrödinger eigenpair computation.

arXiv Machine Learning
Oct 16

SUPN: Shallow Universal Polynomial Networks for Efficient Function Approximation

The paper introduces Shallow Universal Polynomial Networks (SUPNs), a single‑hidden‑layer architecture that replaces standard activations with learnable multivariate polynomials, thereby increasing expressivity per unit. SUPNs achieve universal approximation by either widening the network or increasing polynomial complexity, and the authors prove convergence rates and quasi‑optimal parameter choices. Empirical tests across a wide range of smooth, nonsmooth, and discontinuous functions in up to ten dimensions show that SUPNs often outperform deep neural networks and Kolmogorov‑Arnold networks in accuracy and variability while requiring fewer parameters and lower training cost.

By Zachary Morrow, Michael Penwarden, Brian Chen, Aurya Javeed, Akil Narayan, John D. Jakeman
arXiv AI
Oct 2

SW-KAN: Kolmogorov-Arnold Networks with Stieltjes-Wigert q-Orthogonal Polynomials

The paper introduces SW-KAN, a Kolmogorov‑Arnold Network that replaces traditional B‑spline activations with Stieltjes‑Wigert q‑orthogonal polynomials defined on the semi‑infinite domain (0, ∞). It addresses the domain mismatch between unbounded inputs and bounded polynomial bases by applying a smooth exponential‑of‑tanh mapping, and uses a numerically stable three‑term recurrence to evaluate polynomial expansions efficiently. Experiments on image classification and continuous function approximation show that SW‑KAN achieves better accuracy‑efficiency trade‑offs than existing polynomial KANs, especially in resource‑constrained scenarios with limited data or feature dimensionality.

By Amirhosein Azarpour, Seyyed Moein Kazemi
arXiv Machine Learning
Oct 12

Low-Rank Kolmogorov-Arnold Generator Flows for Interpretable Operator Learning

The paper introduces KAFlow, a low‑rank Kolmogorov‑Arnold flow that learns the generator of physical operators as a compact symbol composed of univariate Kolmogorov‑Arnold functions. By fixing the gauge of these functions, integrating dynamics with exact exponential integrators, and automatically distilling closed‑form expressions, KAFlow achieves markedly lower out‑of‑distribution loss and higher precision on synthetic benchmarks, long‑horizon quantum dynamics, and variable‑order fractional operators. The method recovers operator coefficients to within 10⁻⁴ and discovers complex dispersion relations that sparse regression cannot capture.

By Minjong Cheon
arXiv Machine Learning
Oct 16

Kolmogorov-Arnold Networks: Curse of Dimensionality and Structural Bias

The paper investigates Kolmogorov‑Arnold networks (KANs) and their approximation properties. It shows that while KANs can achieve dimension‑independent approximation exponents for targets with smooth univariate edge functions, this advantage is tied to the target structure rather than the architecture itself. Empirical tests reveal that KANs outperform MLPs only when each nonlinear component depends on a single input coordinate; otherwise, MLPs can be more efficient, especially under tight parameter budgets or for interacting targets.

By Yunhao Ni, Yuxin Guo, Jie Luo, Wenjun Wu, Lei Huang
arXiv AI
Sep 3

RecKAN: Kolmogorov-Arnold Networks with a Learnable Recursive Polynomial Basis

RecKAN introduces a learnable recursive polynomial basis for Kolmogorov–Arnold Networks, replacing fixed bases like B-splines or Chebyshev polynomials. The basis is defined by a second‑order polynomial recurrence whose five coefficients are jointly learned with the network, enabling it to encompass classical families such as Chebyshev, Fibonacci, Pell, and Jacobsthal. Experiments across image, text, biomedical time‑series classification, and forecasting tasks show RecKAN outperforming parameter‑matched KAN baselines and achieving state‑of‑the‑art results on several benchmarks.

By Amirhosein Azarpour