arXiv AI

Shaping Human-AI Interactions to Provide Improvement Pathways and Balance Competing Objectives

arXiv:2608. 05710v1 Announce Type: new Abstract: When an AI system is deployed, the individuals who use and or are evaluated by it form beliefs about how the system operates and use those beliefs to strategically present their preferences, behaviors, or attributes.

arXiv AI
Aug 13

On Benchmarking Human-Like Intelligence in Machines

arXiv:2502. 20502v2 Announce Type: replace Abstract: Recent advances in Artificial Intelligence (AI) have yielded powerful computational models that, by learning from vast amounts of human-generated data, are increasingly posited as approximate models of human cognition.

By Lance Ying, Katherine M. Collins, Lionel Wong, Ilia Sucholutsky, Ryan Liu, Adrian Weller, Tianmin Shu, Thomas L. Griffiths, Joshua B. Tenenbaum
arXiv AI
Jul 17

Align AI to Dynamic Human-AI Workflows

arXiv:2607. 14240v1 Announce Type: new Abstract: Current alignment approaches typically focus on emulating human behavior using static representations of human preferences, failing to capture the dynamic, context-dependent nature of real-world human-AI interactions.

By Valerie Chen, Cleotilde Gonzalez, Anita Williams Woolley, Michael Lee, Tongshuang Wu, Vincent Conitzer, Aarti Singh
arXiv AI
Sep 2

AI Should Not Only Be Helpful. It Should Be Contingent. Artificial Intimacy, Sycophancy, and the Future of Social Learning

The article argues that conversational AI should provide contingent feedback—responses that vary with user behavior and its social consequences—rather than merely seeking user approval and fluency. It highlights how current alignment methods, such as reinforcement learning from human feedback, often produce sycophantic, noncontingent affirmation, which can hinder the development of interpersonal skills, especially in adolescents. The authors propose a framework for evaluating and designing contingent AI, incorporating trajectory-based assessment and social consequence prediction, and call for interdisciplinary research to ensure AI systems positively influence human social learning.

By Scott Compton, Arjun Nagendran
arXiv AI
Sep 12

Defining AI Agents: A Compendium of Criteria, Metrics, and Benchmarks

The article "Defining AI Agents: A Compendium of Criteria, Metrics, and Benchmarks" surveys the lack of a standard definition for AI agents and organizes this ambiguity into five dimensions: environmental interaction, learning and adaptation, autonomy, goal‑directed behavior, and temporal coherence. It reviews how each dimension has been conceptualized in prior work and compiles the metrics, benchmarks, and evaluation frameworks used to assess them. The authors also introduce the Agent Compendium, a public digital resource that extends these evaluation methods, aiming to provide a common structure for evaluating and comparing agent capabilities across AI systems.

By Mia Lassiter, Brinnae Bent
arXiv AI
Sep 18

Modeling Human Behavior with Type Vectors Using AI

The paper presents an AI-based method that models human behavior by assigning a language model a vector of trait intensities—called a type vector—and asking it to predict actions in various settings. By adjusting traits such as Altruism, Risk Aversion, Fairness, and Trust, the authors fit the model to 119,147 decisions from 78,657 subjects across 35 countries and 10 economic games, finding that three dimensions (Risk Aversion, Strategic Sophistication, and Trust) closely match human choices. The resulting type vectors cluster into fewer than a dozen groups and can predict behavior in new games with different rules, demonstrating the method’s generalizability and interpretability.

By Matthew O. Jackson, Benjamin S. Manning, Yutong Xie, Walter Yuan, Qiaozhu Mei