arXiv Machine Learning By Peiman Mohseni, Nick Duffield, Raymond K. W. Wong

Revisiting Neural Processes via Fourier Transform and Volterra Series

Read the original on arXiv Machine Learning →

arXiv:2606. 01172v1 Announce Type: new Abstract: Modeling unknown latent functions from finite, irregularly sampled measurements is a recurring challenge across science and engineering.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 17

NObSP: Functional Decomposition of Neural Networks via Oblique Subspace Projections

NObSP (Nonlinear Oblique Subspace Projections) is a framework that decomposes neural network predictions into explicit per‑feature contribution functions and an interaction residual, leveraging the linear final layer and oblique projections to avoid double counting when feature subspaces overlap. It connects to functional ANOVA and the Kolmogorov‑Arnold representation theorem, and introduces an efficient partial regression algorithm for out‑of‑sample evaluation. For convolutional networks, NObSP‑CAM generates class activation maps without backward passes after a single calibration, and experiments on tabular and vision datasets show faithfulness comparable to established attribution methods, with high function reproduction scores and improved class purity on TinyImageNet.

By Alexander Caicedo, V\'ictor De La Hoz, Santiago Alf\'erez
arXiv Machine Learning
Jul 23

Native Multi-Dimensional Subquadratic Operators via Input Dependent Long Convolutions

arXiv:2607. 19378v1 Announce Type: new Abstract: Subquadratic alternatives to attention require compromises when applied to multi-dimensional data: standard convolutions lack global receptive fields and input dependency, while recurrent models require rasterizing data such as images, volumes, and partial differential equation (PDE) into an ad-hoc $1\rm D$ scan order that violates their spatial structure.

By David R. Wessels, Farhad Ramezanghorbani, David W. Romero, Alireza Moradzadeh, Olivia Viessmann, Maksim Zhdanov, John St. John, Ken Janik, David M Knigge, Yucheng Tang, Erik J Bekkers, Saee Gopal Paliwal
arXiv Machine Learning
Sep 4

Kernel Reboot: Breaking the Boundaries of Neural Tangent Kernels for Neural Fields

The paper introduces three algorithms—NTK-KIP, MetaQuill, and MetaQuill-KIP—to enhance neural fields (NFs) for reconstructing signals from sparse data. NTK-KIP distills a support set of coordinates to enable non‑linear inpainting with a finite NTK, while MetaQuill meta‑learns a shared initialization that allows quick adaptation to new scenes via a small weight offset. MetaQuill-KIP combines both approaches, achieving high‑quality, semantically plausible reconstructions with lightweight per‑instance adaptation, outperforming diffusion‑style baselines that rely on large pretrained generative models.

By Amir Mallak, Alaa Maalouf, Lior Wolf, Daniela Rus, Dan Rosenbaum