arXiv AI

When Explanations Compete: Policy-Aware Selection Under Uncertainty

arXiv Machine Learning
Sep 10

Can Revealed Preferences Clarify LLM Alignment and Steering?

The paper proposes an empirical pipeline to estimate the preferences that a large language model (LLM) implicitly optimizes by combining the model’s probability distribution over unknowns with its chosen action, and fitting a discrete choice model to recover the underlying cost function. This revealed-preference framework enables rigorous assessment of whether LLMs act consistently toward a goal, can articulate objectives that align with their decision policy, and can be steered by prompting to follow a user-specified cost function. Experiments across four medical diagnosis domains and various frontier and open-source models show that while many LLMs exhibit internal coherence, they still struggle to accurately report or adopt preferences when guided by users.

By Khurram Yamin, Jingjing Tang, Eric Horvitz, Bryan Wilder
arXiv Machine Learning
4d ago

From Explaining to Enabling: Actionable Transparency in Algorithmic Insurance Pricing

The paper proposes a framework for making machine‑learning based insurance premiums explainable in a way that is valid, actionable, and reliable. It introduces axioms for each property and develops a method that uses Conformal Prediction to filter out uncertain recommendations, ensuring that suggested changes to controllable characteristics are likely to lower premiums. Experiments on real Florida flood‑insurance claims and synthetic driver‑telematics data show that constrained recommendations are more reliable and predict larger risk reductions than unconstrained ones.

By Agathe Fernandes Machado, Fei Huang
arXiv Machine Learning
Aug 31

Explainable Uncertainty Estimation for Reliable Medical AI

The paper introduces egRUE, an explainable uncertainty estimation method that merges uncertainty quantification with feature‑level explanations for medical AI predictions. egRUE incorporates prediction explanations into its uncertainty calculation and decomposes uncertainty into contributions from individual features. Experiments and a user study with medical experts show that egRUE improves reliability, interpretability, and calibrated trust compared to existing methods.

By Li Rong Wang, Jamie Duell, Xinran Xu, Thomas C. Henderson, Yu Yue Hew, Pik Wan Erica Chiang, Xiao Wei Alstar Ang, Bingwen Eugene Fan, Xiuyi Fan