arXiv Computer Vision By Mohammad Sarhangzadeh, Amirreza M. Shebly, Doruk Oner

Stochastic Nonlinearities Improve Uncertainty Estimation

Read the original on arXiv Computer Vision →

The paper introduces stochastic activation switching, a lightweight technique that randomly selects between multiple nonlinear activation functions during inference. This approach generates predictive diversity without disabling intermediate features, enabling uncertainty estimation from a single trained model. Experiments on classification, semantic segmentation, and out‑of‑distribution detection with both convolutional and transformer architectures show improved uncertainty quality while maintaining competitive primary‑task performance.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Jun 16

Bayesian 3D Steerable CNNs: Enabling Equivariance and Uncertainty Quantification Simultaneously

arXiv:2606. 15479v1 Announce Type: cross Abstract: Steerable convolutional neural networks (Steerable-CNNs) guarantee SE(3)-equivariance by parameterizing kernels as linear combinations of steerable basis functions, but their deterministic nature precludes uncertainty quantification - limiting their use in settings where confidence estimates are essential.

By Abhishek Keripale, Ponkrshnan Thiagarajan, Susanta Ghosh
arXiv Machine Learning
Aug 26

It depends: Incorporating correlations for joint aleatoric and epistemic uncertainties of high-dimensional output spaces

arXiv:2608.24518v1 Announce Type: new Abstract: Uncertainty Quantification (UQ) plays a vital role in enhancing the reliability of deep learning model predictions, especially in scenarios with high-d...

By Leonhard F. Feiner, Manuel Nickel, Martin Menten, Laurin Lux, Rickmer Braren, Daniel Rueckert, Georgios Kaissis, Raphael Rehms, Johannes Paetzold
arXiv AI
Aug 17

SAGE: Surrogate-gradient Adaptation via Attention-Guided Entropy for Spiking Transformers

arXiv:2608. 13702v1 Announce Type: cross Abstract: Spiking neural networks (SNNs) offer an energy-efficient alternative to conventional deep neural networks by exploiting sparse event-driven computation, but their training remains challenging because the non-differentiable spike function requires surrogate gradients whose fixed shape may be suboptimal across layers and training stages.

By Kiran Nair, Rodrigue Rizk, KC Santosh