arXiv AI

When Guardrails Look Effective: Construct Validity Failures in LLM Agent Commerce Evaluation

The paper investigates how marketplace guardrails affect welfare in language‑model agent simulations of hotel transactions. It finds that initial reports of large welfare gains disappear when controlling for offer schemas and buyer choice, and that guardrails mainly redistribute rather than increase welfare unless sellers are explicitly forced to produce inefficient bundles. The authors propose a construct‑validity framework to flag invalid or inconclusive policy claims before they are reported.

arXiv AI
Sep 3

The Endogeneity of Miscalibration: Impossibility and Escape in Scored Reporting

The paper examines how an agent’s probability report is evaluated twice—once by a strictly proper scoring rule and again by an approval rule that determines a decision. It shows that when the approval rule is welfare‑maximizing, it cannot be affine, yet the resulting distortion is predictable and can be mitigated by a reserve report that neutralizes the cost of pretending to be the marginal type. A Lipschitz rule with a single kink achieves first‑best welfare, while smooth rules cannot, and the key constraint is the steepness of the rule rather than its smoothness.

By Lauri Lov\'en, Sasu Tarkoma
arXiv AI
Sep 2

The Constitutional Coverage Trilemma in AI Governance

The paper investigates how well the implicit value rankings encoded by frontier AI systems—termed constitutional institutions—meet human demand. By auditing 23 large language model archetypes and surveying 1,649 U.S. participants, the authors find that user demand spans all five values (safety, helpfulness, honesty, autonomy, equity) but the supply is narrow, covering only about 2% of the demand space, with no model prioritizing helpfulness or autonomy. They propose a sparse two‑vertex menu that substantially reduces regret compared to the full set of models and formalize these observations as a budgeted‑pluralism trilemma. whyItMatters":"The study reveals a significant mismatch between the values users prioritize and the values encoded by current AI models, highlighting the need for more diverse and aligned constitutional designs."

By Natalija Mitic, Soona Sedahmed A. O., Mamadou Selly Ly, Moustapha Cisse