NObSP (Nonlinear Oblique Subspace Projections) is a framework that decomposes neural network predictions into explicit per‑feature contribution functions and an interaction residual, leveraging the linear final layer and oblique projections to avoid double counting when feature subspaces overlap. It connects to functional ANOVA and the Kolmogorov‑Arnold representation theorem, and introduces an efficient partial regression algorithm for out‑of‑sample evaluation. For convolutional networks, NObSP‑CAM generates class activation maps without backward passes after a single calibration, and experiments on tabular and vision datasets show faithfulness comparable to established attribution methods, with high function reproduction scores and improved class purity on TinyImageNet.
By Alexander Caicedo, V\'ictor De La Hoz, Santiago Alf\'erez
arXiv:2607. 19378v1 Announce Type: new Abstract: Subquadratic alternatives to attention require compromises when applied to multi-dimensional data: standard convolutions lack global receptive fields and input dependency, while recurrent models require rasterizing data such as images, volumes, and partial differential equation (PDE) into an ad-hoc $1\rm D$ scan order that violates their spatial structure.
By David R. Wessels, Farhad Ramezanghorbani, David W. Romero, Alireza Moradzadeh, Olivia Viessmann, Maksim Zhdanov, John St. John, Ken Janik, David M Knigge, Yucheng Tang, Erik J Bekkers, Saee Gopal Paliwal
arXiv:2609.22807v1 Announce Type: new
Abstract: Implicit Neural Representation (INR) leverages neural networks to represent discrete signals such as images as continuous ones, where the network weigh...
By Jinglei Shi, Xinran Chang, Jiaqi Cui, Yingjie Xia, Zhaolin Xiao, Chongyi Li
arXiv:2609.38348v1 Announce Type: new
Abstract: Many forms of data, including physical fields, geometric shapes, and visual signals, are naturally described by functions over continuous domains but a...
By Guorui Sang, Pedram Rooshenas
arXiv:2608.30720v1 Announce Type: new
Abstract: Representational similarity is foundational to analyses of deep networks, yet distances between point-valued representations are not intrinsically tied...
By Kieran Murphy
The paper introduces three algorithms—NTK-KIP, MetaQuill, and MetaQuill-KIP—to enhance neural fields (NFs) for reconstructing signals from sparse data. NTK-KIP distills a support set of coordinates to enable non‑linear inpainting with a finite NTK, while MetaQuill meta‑learns a shared initialization that allows quick adaptation to new scenes via a small weight offset. MetaQuill-KIP combines both approaches, achieving high‑quality, semantically plausible reconstructions with lightweight per‑instance adaptation, outperforming diffusion‑style baselines that rely on large pretrained generative models.
By Amir Mallak, Alaa Maalouf, Lior Wolf, Daniela Rus, Dan Rosenbaum