arXiv Machine Learning
Oct 12

Kernelized Parameter Sensitivity Atlases for Amortized Conditional Interpretability

The paper introduces Kernelized Parameter Sensitivity Atlases (KPSA), a method that uses a block decomposition of the empirical neural tangent kernel to estimate input‑specific parameter sensitivities efficiently. KPSA embeds parameter groups in a query space and applies a lightweight kernel to predict sensitivities for unseen inputs, achieving a high fraction of the perturbation susceptibility of full back‑propagation while dramatically reducing computation and memory usage. Experiments across vision, forecasting, and protein‑modeling tasks show that KPSA identifies sparse, depth‑spanning sensitivity circuits and improves throughput and memory efficiency in activation‑attribution problems.

By Davide Wiest, Ahanaf Hasan Ariq, Abdul Monaf Chowdhury