Towards Data Science

Building and Visualising Kolmogorov–Arnold Networks

The article "Building and Visualising Kolmogorov–Arnold Networks" explores the concept of neural networks that learn functions rather than just weights. It discusses the construction and visualization of Kolmogorov–Arnold networks, providing insights into how these networks operate and how they can be represented visually. The post was originally published on Towards Data Science.

arXiv Machine Learning
Oct 9

Sample-Efficiency of Kolmogorov-Arnold Networks

The paper investigates the sample‑efficiency of Kolmogorov‑Arnold Networks (KANs) in reinforcement learning. Using experiments on the Feynman dataset and Gymnasium benchmarks, the authors find that KANs achieve comparable performance to standard Multi‑Layer Perceptrons while requiring 40% fewer samples, with up to 50% relative performance gains during training. These improvements hold even when reward noise varies, underscoring KANs’ potential for more sample‑efficient RL.

By Kevin Riehl, Shaimaa K. El-Baklish, Fan Wu, Anastasios Kouvelas
MIT News AI
Oct 13

How artificial neural networks build their own learning machinery

The article discusses how artificial neural networks can develop their own learning mechanisms without explicit guidance from designers. It highlights that such self-organizing networks may provide insights into the brain’s ability to reorganize itself during learning.

By Jennifer Michalowski | McGovern Institute for Brain Research
Hugging Face Trending Papers
Jun 25

Kolmogorov Arnold networks (KAN) for aerodynamic prediction: a comparison with MLPs and GNNs

Kolmogorov Arnold networks (KAN) have recently been introduced as a (deep) neural network architecture whose trainable parameters adapt the activation functions, instead of the coefficients of the affine transformations at the core of traditional architectures such as deep multilayer perceptrons (MLPs). This architecture builds on the Kolmogorov-Arnold theorem, which endows it with universal approximation properties.

arXiv Machine Learning
Jun 26

Kolmogorov Arnold networks (KAN) for aerodynamic prediction: a comparison with MLPs and GNNs

arXiv:2606. 27126v1 Announce Type: new Abstract: Kolmogorov Arnold networks (KAN) have recently been introduced as a (deep) neural network architecture whose trainable parameters adapt the activation functions, instead of the coefficients of the affine transformations at the core of traditional architectures such as deep multilayer perceptrons (MLPs).

By Miguel Jaraiz, Fermin Gutierrez, Pablo Yeste, Miguel S\'anchez-Dom\'inguez, Eusebio Valero, Gonzalo Rubio, Lucas Lacasa
arXiv Machine Learning
Oct 3

Neural scaling laws and evolution of learnable activation functions of Kolmogorov-Arnold networks

The paper studies Kolmogorov‑Arnold Networks (KANs), a neural architecture that treats activation functions as learnable components, offering improved interpretability for scientific applications. It investigates how KANs scale with dataset size on image classification tasks (MNIST, Fashion‑MNIST) and a magnetic‑parameter regression task, revealing a broken neural scaling law that transitions from a faster to a slower decay of test loss as data grows. The authors also analyze how the learned activation functions evolve from simple linear approximations to more complex, interpretable symbolic forms as more data is provided.

By Tilen Cadez, Sanghoon Lee, Kyoung-Min Kim
Towards Data Science
Sep 1

Beyond Point Predictions: A Practical Introduction to Bayesian Neural Networks

The article "Beyond Point Predictions: A Practical Introduction to Bayesian Neural Networks" discusses how Bayesian neural networks enable more informed decision-making by quantifying uncertainty in predictions. It introduces practical aspects of implementing these models and highlights their advantages over traditional point prediction approaches.

By Tom Narock
arXiv AI
Sep 17

Lecture notes on Physics Informed Neural Networks, Neural Operators, and their applications

These lecture notes accompany the PhD course "Physics Informed Neural Network" offered at the University of Bozen/Bolzano in 2025/2026. They introduce Physics Informed Deep Neural Networks (PINNs) and Neural Operators (NOs), covering implementation from scratch in PyTorch and with libraries such as NVIDIA PhysicsNeMo. The notes also discuss advanced topics like Mixture-of-Models, Fourier Neural Operators, and Physics‑Informed Kolmogorov‑Arnold Networks (PIKANs).

By Alessandro Bombini