arXiv AI By Alexandre Flachs, Yves De Smet

From Outranking Flow Scores to Linear Programs: Group Decision Making in PROMETHEE II

Read the original on arXiv AI →

The paper presents a linear reparametrization of PROMETHEE II net flow scores that incorporates both criteria weights and preference functions, enabling a clearer understanding of their interaction. Using this representation, the authors formulate linear optimization models for three inverse‑analysis scenarios: (1) minimizing weight deviations while allowing preference functions to vary, (2) minimizing deviations over all preference parameters, and (3) achieving consensus among multiple decision makers with objectives based on total or maximal individual deviation to promote fairness. An illustrative example demonstrates that permitting preference functions to vary can substantially alter inverse‑analysis conclusions compared to weight‑only models, and that the group formulations can distinguish efficient consensuses from fairer ones.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Sep 1

Adaptive Doubly Robust Off-Policy Evaluation for Ranking Policies under Diverse User Behavior

The paper introduces Adaptive Doubly Robust (ADR), an off‑policy evaluation method for ranking policies that blends adaptive importance weighting with reward regression to reduce variance. ADR is unbiased when the true user behavior model is known and, under a sufficient condition, achieves lower variance than the prior Adaptive Inverse Propensity Scoring (AIPS) approach. Experiments on synthetic data show that ADR consistently improves mean squared error over AIPS and other ranking OPE estimators across various data sizes and ranking lengths.

By Kosuke Iguchi, Ren Kishimoto
arXiv Computation and Language
Aug 28

Multi-Expert Conformal Risk Control for Pairwise LLM Judging in Open-Ended Dialogue

The paper introduces multi-expert Conformal Risk Control (CRC) algorithms for pairwise LLM-as-a-Judge evaluation in open-ended dialogue. Two initial methods—Score Averaging and Decision Voting—aggregate at the score and decision levels, respectively, and outperform single-expert approaches on homogeneous expert panels. To address limited coverage on heterogeneous panels, the authors propose Marginal‑Calibrated Conformal Consensus (MC3), which captures distinct per‑expert scoring scales through threshold ratios while maintaining a unified decision function, and demonstrate its effectiveness on a new 1,800‑pair human pairwise‑preference benchmark called Panel.

By Ming Cheng, Yusheng Dai, Qiuhong Ke, Zhaolin Chen, Lizhen Qu