arXiv AI
Aug 12
Toward a Theory of Value in AI Alignment
arXiv:2608. 10327v1 Announce Type: new Abstract: Can AI systems be aligned to human values?
Position: Align AI to Our Aspirations, Not Our Flaws
arXiv:2606. 13755v1 Announce Type: cross Abstract: We argue that aligning AI to aggregated human preferences is the wrong target.
Related stories
arXiv AI
Jun 9
Memetic Capture: A Pluralistic Policy Framework for Governing AI-Driven Cultural Disempowerment
arXiv:2606. 07802v1 Announce Type: cross Abstract: Culture is the most insidious vector of gradual human disempowerment by AI: unlike economic or political displacement, cultural displacement attacks the very preferences and values through which humans recognise and resist disempowerment itself.
arXiv AI
Jun 29
The Alignment Target Problem: Divergent Moral Judgments of Humans, AI Systems, and Their Designers
arXiv:2604. 24155v3 Announce Type: replace-cross Abstract: The project of aligning machine behavior with human values raises a basic problem: whose moral expectations should guide AI decision-making?
arXiv AI
Aug 12
The Deliberative Deficit: An Empirical Critique of LLMs in Democratic Discourse
arXiv:2608. 10186v1 Announce Type: cross Abstract: LLMs are increasingly deployed in settings that require collective reasoning on complex, value-laden problems.
arXiv AI
Jun 16
AI Pluralism and the Worlds It Misses
arXiv:2606. 16167v1 Announce Type: new Abstract: AI pluralism is often framed as a problem of representing diverse values, preferences, users, or outputs.
arXiv AI
Jul 2
Constructive Alignment: Governing Preference Dynamics in Human-AI Interaction
arXiv:2607. 00001v1 Announce Type: new Abstract: Most approaches to AI alignment treat human preferences as fixed targets to be inferred and optimized.
arXiv AI
Jul 3
Structuring the Space of Sociotechnical Alignment
arXiv:2607. 01250v1 Announce Type: cross Abstract: Sociotechnical alignment concerns the social desirability of AI behavior and is thus inherently normative, not merely technical.
arXiv AI
2d ago
Participatory Moral AI Is Not Neutral: The Invisible Hand of Developers
arXiv:2608. 14522v1 Announce Type: new Abstract: As AI systems make more morally loaded decisions across society, one response has been moral preference elicitation.
arXiv AI
Jul 10
PLURAL: A Global Dataset for Value Alignment
arXiv:2607. 08034v1 Announce Type: cross Abstract: Large language models (LLMs) are used worldwide, yet disproportionately reflect Western values, limiting their ability to represent diverse value systems.
arXiv AI
1d ago
Incoherent by Design? On the Moral Self-Consistency of LLMs
arXiv:2608. 15354v1 Announce Type: new Abstract: LLMs are increasingly used in morally sensitive contexts, yet it is unclear whether they apply ethical principles consistently across situations.
arXiv AI
Jun 8
Accounting for Context: Shaping Moral Credences for Value Alignment
arXiv:2606. 06972v1 Announce Type: new Abstract: Ensuring that agent behaviours are aligned with human moral values inevitably raises the problem of how to account for the plurality of moral perspectives that societies -- and even individuals -- typically adopt.
arXiv AI
Aug 5
Optimising for Flourishing: Flourishing Metrics and Return on Flourishing as Success Criteria for Artificial Intelligence and Post-AGI Economic Systems
arXiv:2608. 00151v2 Announce Type: replace-cross Abstract: Current evaluation frameworks for artificial intelligence focus mainly on capability, safety, and proxies such as adoption, engagement, efficiency, productivity, and financial return.