arXiv AI
Integrating the Analytic Hierarchy Process with Large Language Models for Transparent Multi-Criteria Decision-Making
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Aug 7
Stability of Ranking-dependent Pair-wise Comparison Patterns in the Analytic Hierarchy Process
arXiv:2608. 05958v1 Announce Type: new Abstract: The paper addresses several ranking-dependent decision support methods.
arXiv AI
Aug 6
EuroExec: Frontier Language Models Fall Short of Expert Judgment on European Executive Decision Tasks
arXiv:2608. 04549v1 Announce Type: cross Abstract: Frontier LLMs are increasingly put to use on open-ended complex questions, different in nature from the ones they are typically evaluated on.
arXiv AI
Aug 11
WuYuEval: A Multi-Level Benchmark for Large Language Models in Solid Waste Management
arXiv:2608. 07529v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used as technical assistants, but their competence in solid waste management (SWM) remains difficult to assess because existing benchmarks emphasize general knowledge rather than professional decisions under engineering, environmental, and policy constraints.
arXiv AI
Jun 3
JudgmentBench: Comparing Rubric and Preference Evaluation for Quality Assessment
arXiv:2605. 25240v2 Announce Type: replace-cross Abstract: Two methodologies dominate current practices of benchmarking: rubric-based scoring evaluates items against predefined criteria, whereas comparative judgment elicits pairwise preferences between outputs.
arXiv AI
Aug 21
Qworld: Question-Specific Evaluation Criteria for LLMs
arXiv:2603. 23522v2 Announce Type: replace-cross Abstract: Evaluating large language models (LLMs) on open-ended questions is difficult because response quality depends on the question's context.
arXiv AI
Jun 2
BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law
arXiv:2605. 28183v2 Announce Type: replace-cross Abstract: We introduce the BenGER (Benchmark for German Law) dataset for evaluating LLM systems on subsumption-based legal reasoning in German law.