arXiv Statistics ML
Investigating Statistical Inference and Covariate Effects in Shallow Neural Networks
Read the original on arXiv Statistics ML →The Flow has not summarised this story yet — read it at arXiv Statistics ML.
Related stories
arXiv Machine Learning
Aug 27
Controlling for Omitted Variable Bias in Deep Neural Networks
The paper introduces a control‑variable framework for deep neural networks to mitigate omitted variable bias, particularly shortcut learning where covariates like demographics influence predictions. It refits the final layer of a pre‑trained network using cross‑fitting with ridge penalisation, orthogonalises covariate effects, and marginalises predictions over covariate distributions to achieve unbiased, interpretable results. Experiments on simulated images and neuroimaging data show consistent estimation of true effects and performance close to models trained on unconfounded data.
arXiv AI
Sep 10
Instance-wise Linearization of Neural Network for Model Interpretation
arXiv:2310.16295v2 Announce Type: replace-cross Abstract: Neural network have achieved remarkable successes in many scientific fields. However, the interpretability of the neural network model is sti...
arXiv Machine Learning
2d ago
NObSP: Functional Decomposition of Neural Networks via Oblique Subspace Projections
arXiv:2609.17825v1 Announce Type: new Abstract: Understanding how deep neural networks make decisions remains a fundamental challenge. We present NObSP (Nonlinear Oblique Subspace Projections), a fra...
arXiv Machine Learning
Aug 27
ICON Decomposition: Multivariate Concept-Level Explanations of Deep Representations for Model Auditing
ICON Decomposition is a new method for explaining deep neural networks by quantifying how much variance each concept explains in a network layer after accounting for all other concepts and the outcome. Unlike previous concept‑based methods that evaluate concepts in isolation, ICON can distinguish genuine model reliance from spurious correlations. Experiments on synthetic data, skin‑lesion, and brain‑imaging models show that ICON recovers concept importance more accurately, isolates truly relied‑upon concepts, and provides sparse explanations validated through retraining and out‑of‑distribution testing.
arXiv AI
3d ago
ICON Decomposition: Auditing deep neural networks for shortcuts by decomposing layer-wise representations using concepts
The paper introduces ICON Decomposition, a method for auditing deep neural networks by decomposing layer-wise representations into independent concept contributions. Unlike existing techniques that rely on linear probes or concept activation vectors, ICON quantifies the variance share each concept explains while conditioning on all other concepts and the outcome, allowing comparison across layers and concept types. Experiments on simulated data, skin‑cancer, and neuroimaging models show that ICON more accurately recovers true concept importance and can distinguish learned shortcuts from correlated concepts, as validated by retraining and out‑of‑distribution tests.
arXiv Machine Learning
Aug 5
Representing Random Utility Choice Models with Neural Networks
arXiv:2207. 12877v3 Announce Type: replace Abstract: Motivated by the successes of deep learning, we propose a class of neural network-based discrete choice models, called RUMnets, inspired by the random utility maximization (RUM) framework.