arXiv AI

Uncertainty Quantification in Pairwise Difference Learning for Classification

The paper introduces a pairwise difference learning (PDL) approach for classification, where a model predicts the outcome difference between two instances and uses these predictions to classify a query instance by averaging over training examples. It presents a meta‑learning technique tailored to this setting and tackles uncertainty quantification by decomposing total uncertainty into aleatoric and epistemic components, extending these measures to PDL. Extensive empirical studies evaluate both predictive accuracy and the model’s awareness of uncertainty.

arXiv AI
Oct 16

Pairwise Difference Learning for Classification

The paper introduces Pairwise Difference Learning (PDL) for classification, extending a meta‑learning technique originally designed for regression. PDL learns a function that predicts the difference between outcomes of two instances; predictions for a new instance are obtained by averaging differences with all training examples. Experiments show that the resulting PDL classifier surpasses state‑of‑the‑art methods, and the authors release a user‑friendly Python implementation.

By Mohamed Karim Belaid, Maximilian Rabus, Eyke H\"ullermeier
arXiv Machine Learning
Jul 7

An Axiomatic Assessment of Entropy- and Variance-based Uncertainty Quantification in Regression

arXiv:2504. 18433v3 Announce Type: replace Abstract: Uncertainty quantification is crucial in machine learning, yet most (axiomatic) studies of uncertainty measures focus on classification, leaving a gap in regression settings with limited formal justification and evaluations.

By Christopher B\"ulte, Yusuf Sale, Timo L\"ohr, Paul Hofman, Gitta Kutyniok, Eyke H\"ullermeier
arXiv Machine Learning
Oct 3

Uncertainty-Aware Learning from Multi-Expert Interval Targets

The paper introduces a method for learning from multiple experts who provide interval labels, addressing both within‑label imprecision and between‑expert variation. It harmonizes diverse label vocabularies into a shared probabilistic space, retains individual intervals using a mixture of Beta distributions, and decomposes predictive uncertainty into components that are matched to their corresponding sources of label uncertainty. On sea‑ice concentration data, the approach achieves a 31% reduction in mean absolute error compared to hard‑label baselines and outperforms several aggregation and interval‑regression methods.

By Samira Alkaee Taleghan, Younghyun Koo, Andrew P. Barrett, Farnoush Banaei-Kashani
arXiv Machine Learning
Sep 24

Binary Classification from Coupled Pairwise Labels

The paper introduces SD-Pcomp learning, a binary classification framework that jointly utilizes Similarity/Dissimilarity (SD) labels and Pairwise Comparison (Pcomp) labels from instance pairs. It proposes an objective function that can be decomposed into either an SD estimator plus ordering information or a Pcomp estimator plus pair-type information, thereby integrating complementary relational cues. Experiments on eight datasets demonstrate that combining both label types improves classification accuracy and AUC compared to using either alone or a simple convex combination.

By Tomoya Tate, Kosuke Sugiyama, Masato Uchida
arXiv Machine Learning
Oct 9

Credal Machine Learning for Risk-Averse Decision Making

The paper introduces a method for risk‑averse machine learning that uses credal sets—collections of probability distributions—to capture epistemic uncertainty about the true loss distribution. By producing predictions as credal sets and applying a novel decision rule that selects a single predictive distribution for conditional value‑at‑risk (CVaR) minimization, the approach aims to reliably avoid catastrophic decisions across classification, distribution shift, and reinforcement learning scenarios while maintaining near‑optimal expected performance.

By Timo L\"ohr, Paul Hofman, Maximilian Muschalik, Eyke H\"ullermeier
arXiv Machine Learning
5d ago

Adaptive Uncertainty Quantification on Simplicial Complexes with Conformalized Simplicial Neural Networks

The paper introduces CF‑SNN, a conformalized simplicial neural network framework that provides uncertainty quantification for predictions on simplicial complexes. It generates simultaneous prediction sets for multiple targets, guaranteeing that each set contains the true label with a user‑specified coverage probability. Experiments across diverse SC prediction tasks show that CF‑SNN achieves the desired coverage while keeping prediction sets small and informative.

By Lekun Wang, Jaidev Goel, Yulia R. Gel, Yao Xie
arXiv Machine Learning
Jun 11

What Uncertainties Do We Need for Dynamical Systems?

arXiv:2606. 11988v1 Announce Type: new Abstract: The distinction between aleatoric and epistemic uncertainty has received considerable attention in machine learning research, mainly in the context of supervised learning but also in other settings such as generative modeling.

By Yusuf Sale, Christopher B\"ulte, Felix Czaja, Joshua Stiller, Eyke H\"ullermeier