arXiv Computer Vision

Stochastic Nonlinearities Improve Uncertainty Estimation

The paper introduces stochastic activation switching, a lightweight technique that randomly selects between multiple nonlinear activation functions during inference. This approach generates predictive diversity without disabling intermediate features, enabling uncertainty estimation from a single trained model. Experiments on classification, semantic segmentation, and out‑of‑distribution detection with both convolutional and transformer architectures show improved uncertainty quality while maintaining competitive primary‑task performance.

arXiv AI
Jun 16

Bayesian 3D Steerable CNNs: Enabling Equivariance and Uncertainty Quantification Simultaneously

arXiv:2606. 15479v1 Announce Type: cross Abstract: Steerable convolutional neural networks (Steerable-CNNs) guarantee SE(3)-equivariance by parameterizing kernels as linear combinations of steerable basis functions, but their deterministic nature precludes uncertainty quantification - limiting their use in settings where confidence estimates are essential.

By Abhishek Keripale, Ponkrshnan Thiagarajan, Susanta Ghosh
arXiv Machine Learning
Aug 26

It depends: Incorporating correlations for joint aleatoric and epistemic uncertainties of high-dimensional output spaces

arXiv:2608.24518v1 Announce Type: new Abstract: Uncertainty Quantification (UQ) plays a vital role in enhancing the reliability of deep learning model predictions, especially in scenarios with high-d...

By Leonhard F. Feiner, Manuel Nickel, Martin Menten, Laurin Lux, Rickmer Braren, Daniel Rueckert, Georgios Kaissis, Raphael Rehms, Johannes Paetzold
arXiv AI
Aug 17

SAGE: Surrogate-gradient Adaptation via Attention-Guided Entropy for Spiking Transformers

arXiv:2608. 13702v1 Announce Type: cross Abstract: Spiking neural networks (SNNs) offer an energy-efficient alternative to conventional deep neural networks by exploiting sparse event-driven computation, but their training remains challenging because the non-differentiable spike function requires surrogate gradients whose fixed shape may be suboptimal across layers and training stages.

By Kiran Nair, Rodrigue Rizk, KC Santosh
arXiv Computer Vision
4d ago

OT-CAL: Optimal-Transport-Guided Adaptive Sample Selection for Efficient Visual Learning

OT-CAL is an adaptive sample selection method for visual learning that uses optimal transport to weight training samples based on five informativeness features such as difficulty, learnability, and uncertainty. It dynamically updates a curriculum vector during training, allowing it to focus on the most informative samples without a fixed schedule. Experiments on three visual benchmarks show that selecting only 50% of each mini‑batch with OT‑CAL yields 1.3–2.1 point performance gains over AdaSelection and speeds up training by 1.18–1.24× compared to full‑data training.

By Suryansh Talukdar, Jin Soung Yoo
arXiv Machine Learning
Jul 8

Drift Happens: An Empirical Study of Neural Architecture Robustness to Temporal Distribution Shift

arXiv:2607. 05908v1 Announce Type: new Abstract: Real-world data distributions evolve over time, inducing temporal distribution shift that can substantially degrade the reliability of deployed machine learning systems.

By Robin Holzinger (Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, USA), Riccardo Colletti (Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, USA)