arXiv Machine Learning
Jun 25
Efficient Analytic Uncertainty Quantification for Multi-Modal Regression
arXiv:2606. 25188v1 Announce Type: new Abstract: Efficient uncertainty quantification (UQ) is essential for trustworthy large-scale learning.
Beyond Homoscedasticity: Decoupled Uncertainty Optimization for Deep Imbalanced Regression
The paper introduces DUO, a framework for Deep Imbalanced Regression that models each prediction as a conditional Gaussian to capture instance‑level uncertainty. By decoupling mean and variance optimization, DUO enhances learning signals for tail samples and mitigates gradient coupling that hampers hard examples. A distribution‑guided contrastive learning component further refines feature representations, leading to state‑of‑the‑art performance on several visual and biological regression benchmarks.
Related stories
arXiv Statistics ML
5d ago
Two-sample comparison through additive tree models for density ratios
The paper introduces additive tree models for estimating the density ratio between two distributions, using a novel balancing loss that enables training with supervised learning algorithms such as forward‑stagewise optimization and gradient boosting. The loss also functions as a pseudo‑likelihood, allowing generalized Bayesian inference via backfitting samplers for Bayesian additive regression trees, which provides uncertainty quantification. Experiments show that the boosting algorithms achieve high accuracy with low computational cost, and the Bayesian approach offers competitive accuracy while delivering uncertainty estimates, demonstrated on microbiome compositional data.
arXiv AI
Sep 1
Learning Dynamics of Logits Debiasing for Long-Tailed Semi-Supervised Learning
arXiv:2608.30699v1 Announce Type: cross Abstract: Long-tailed distributions are prevalent in real-world semi-supervised learning (SSL), where pseudo-labels tend to favor majority classes, leading to...
arXiv Machine Learning
Sep 1
Prediction-Powered Conditional Inference
arXiv:2603.05575v2 Announce Type: replace-cross Abstract: We study prediction-powered conditional inference in the setting where labeled data are scarce, unlabeled covariates are abundant, and a blac...
arXiv Machine Learning
Aug 12
Uncertainty-Aware Deep Learning for Genomics Applications: Insights from an Empirical Study
arXiv:2608. 11054v1 Announce Type: new Abstract: Deep learning models have emerged as the standard computational tool for a wide range of applications in genomics.
arXiv AI
Jun 16
ALCL: An Adaptive Log-Correntropy Loss for Robust Learning under Non-Gaussian Noise
arXiv:2606. 16050v1 Announce Type: cross Abstract: Robust deep learning under heavy-tailed and impulsive noise remains challenging because conventional losses such as mean squared error (MSE) exhibit unbounded sensitivity to outliers.
arXiv Machine Learning
Jun 8
MIST: Mutual Information Estimation Via Supervised Training
arXiv:2511. 18945v4 Announce Type: replace Abstract: We propose a fully data-driven approach to designing mutual information (MI) estimators.
arXiv Machine Learning
Jun 5
Gradient-Flow Optimization as Dynamic Random-Effects Inference: Testing and Early Stopping with Applications to Deep Learning
arXiv:2605. 27991v2 Announce Type: replace-cross Abstract: Gradient-flow optimization is usually viewed as an algorithmic procedure for minimizing empirical loss, with training duration selected by validation or heuristic early-stopping rules.
arXiv Machine Learning
Jun 25
Model-agnostic Mitigation Strategies of Data Imbalance for Regression
arXiv:2506. 01486v2 Announce Type: replace Abstract: Data imbalance persists as a pervasive challenge in regression tasks, introducing bias in model performance and undermining predictive reliability.
arXiv AI
Sep 10
DUA-D2C: Dynamic Uncertainty Aware Method for Overfitting Remediation in Deep Learning
The paper introduces DUA-D2C, a Dynamic Uncertainty-Aware Divide2Conquer method that improves overfitting remediation in deep learning. It refines the traditional Divide2Conquer approach by dynamically weighting subset models based on a composite score of accuracy and normalized prediction entropy, allowing the central model to learn more from generalizable and confident edge models. The authors provide theoretical justification, show reduced model variance, and demonstrate significant generalization gains across image, audio, and text benchmarks, even when combined with standard regularizers like Dropout.
arXiv Statistics ML
6d ago
HIFI: A Highly Efficient Framework for Statistical Inference with Foundation Models
arXiv:2610.34550v1 Announce Type: new Abstract: Foundation models provide powerful representations for unstructured data, such as text and images, and parameter-efficient fine-tuning (PEFT) makes the...
arXiv Machine Learning
Sep 23
Exposing Blind Spots in Deep Imbalanced Regression Evaluation
arXiv:2609.25152v1 Announce Type: new Abstract: Deep Imbalanced Regression (DIR) addresses a common failure mode of regression models: target distributions are highly non-uniform, causing models to p...