arXiv AI

Interactive Multi-Objective Probabilistic Preference Learning with Soft and Hard Bounds

arXiv:2506. 21887v2 Announce Type: replace Abstract: High-stakes decision-making involves navigating multiple competing objectives with expensive evaluations.

arXiv Machine Learning
Jun 19

Interactive Pareto navigation for deep multi-task learning

arXiv:2606. 19521v1 Announce Type: new Abstract: In multi-task learning, handling an increasing number of objectives can quickly become challenging, both in terms of the computational resources and the decision maker's capacity to choose appropriate trade-offs.

By Augustina C. Amakor, Konstantin Sonntag, Sebastian Peitz
arXiv Machine Learning
Sep 10

Can Revealed Preferences Clarify LLM Alignment and Steering?

The paper proposes an empirical pipeline to estimate the preferences that a large language model (LLM) implicitly optimizes by combining the model’s probability distribution over unknowns with its chosen action, and fitting a discrete choice model to recover the underlying cost function. This revealed-preference framework enables rigorous assessment of whether LLMs act consistently toward a goal, can articulate objectives that align with their decision policy, and can be steered by prompting to follow a user-specified cost function. Experiments across four medical diagnosis domains and various frontier and open-source models show that while many LLMs exhibit internal coherence, they still struggle to accurately report or adopt preferences when guided by users.

By Khurram Yamin, Jingjing Tang, Eric Horvitz, Bryan Wilder