arXiv AI
Aug 12
Toward a Theory of Value in AI Alignment
arXiv:2608. 10327v1 Announce Type: new Abstract: Can AI systems be aligned to human values?
A Roadmap to Impactful Pluralistic Alignment Research
The paper outlines a roadmap for advancing pluralistic value alignment in AI, noting that current research lacks evidence of influence on model training or evaluation. It identifies three key barriers: a need for empirical studies on benefits and drawbacks, clearer specifications of when and how pluralistic behavior should occur, and robust evaluation methods suitable for production. The roadmap aims to guide research toward practical deployment in responsible AI systems.
Related stories
arXiv AI
Jun 16
AI Pluralism and the Worlds It Misses
arXiv:2606. 16167v1 Announce Type: new Abstract: AI pluralism is often framed as a problem of representing diverse values, preferences, users, or outputs.
arXiv AI
Jun 29
The Alignment Target Problem: Divergent Moral Judgments of Humans, AI Systems, and Their Designers
arXiv:2604. 24155v3 Announce Type: replace-cross Abstract: The project of aligning machine behavior with human values raises a basic problem: whose moral expectations should guide AI decision-making?
arXiv AI
Jun 15
Position: Align AI to Our Aspirations, Not Our Flaws
arXiv:2606. 13755v1 Announce Type: cross Abstract: We argue that aligning AI to aggregated human preferences is the wrong target.
arXiv AI
Jul 3
Structuring the Space of Sociotechnical Alignment
arXiv:2607. 01250v1 Announce Type: cross Abstract: Sociotechnical alignment concerns the social desirability of AI behavior and is thus inherently normative, not merely technical.
arXiv AI
Jun 12
From AGI to ASI
arXiv:2606. 12683v1 Announce Type: new Abstract: Over the last decade, building human-level artificial general intelligence has moved from far-fetched speculation to being a concrete next-decade target for many of the largest AI organisations.
Hugging Face Trending Papers
Aug 25
Method, Mind, and Morality: How People Make Sense of Artificial Intelligence
How can humans make sense of the rapid takeoff of artificial intelligence (AI)? We studied the sensemaking dynamics of AI through an open-ended, mixed-methods study with computational text analysis of...
arXiv AI
Aug 5
Socially Grounded Agentic AI: Coordinating Plural Perspectives through Social Theory
arXiv:2608. 03910v1 Announce Type: new Abstract: As AI systems are deployed across increasingly diverse social contexts, alignment can no longer be framed as the optimization of a single, unified set of values.
arXiv AI
Aug 26
Method, Mind, and Morality: How People Make Sense of Artificial Intelligence
arXiv:2608.24748v1 Announce Type: cross Abstract: How can humans make sense of the rapid takeoff of artificial intelligence (AI)? We studied the sensemaking dynamics of AI through an open-ended, mixe...
arXiv Computation and Language
Sep 1
Thesis Proposal: Toward a Human-Centered and Perspective-Aware Framework for Reproducible ML Evaluation and AI Alignment
arXiv:2608.30842v1 Announce Type: new Abstract: Humans play a vital role at every stage of AI development, from data collection and curation to model development and evaluation. However, humans often...
arXiv AI
Jun 11
Preregistration for Experiments with AI Agents
arXiv:2606. 11217v1 Announce Type: cross Abstract: The proliferation of large language models (LLMs) and autonomous AI agents has given rise to a rapidly growing methodological paradigm: "in silico" behavioral experiments.
OpenAI Blog
Aug 27, 2025
Collective alignment: public input on our Model Spec
OpenAI surveyed over 1,000 people worldwide on how AI should behave and compared their views to our Model Spec. Learn how collective alignment is shaping AI defaults to better reflect diverse human values and perspectives.