arXiv AI
Jun 15
Position: Align AI to Our Aspirations, Not Our Flaws
arXiv:2606. 13755v1 Announce Type: cross Abstract: We argue that aligning AI to aggregated human preferences is the wrong target.
Toward a Theory of Value in AI Alignment
arXiv:2608. 10327v1 Announce Type: new Abstract: Can AI systems be aligned to human values?
Related stories
arXiv AI
Sep 16
Do LLMs Have Values? A Quantitative Analysis and Alignment Framework for Values in Large Language Models
The paper investigates whether large language models (LLMs) possess intrinsic value systems and how to quantify and align them. By projecting responses from 106 LLMs and 95,000 human survey profiles into a shared sociological space, the authors confirm that LLMs do have values, though these values form a concentrated, idealized core rather than mirroring human diversity. They introduce the Prior-Environment-Cognition (PEC) framework to mathematically define value expression and propose an adaptive Alignment Prescription that identifies minimal interventions—ranging from prompts to targeted parameter updates—to steer LLM values efficiently without harming general performance.
arXiv AI
Jun 30
Modelling Human Values for Value-Aware Multi-Agent Systems
arXiv:2402. 06359v2 Announce Type: replace Abstract: One of today's most pressing societal challenges is building AI systems whose behaviour, or the behaviour it enables within communities of interacting human and artificial agents, aligns with relevant human values.
arXiv Computation and Language
Sep 1
Thesis Proposal: Toward a Human-Centered and Perspective-Aware Framework for Reproducible ML Evaluation and AI Alignment
arXiv:2608.30842v1 Announce Type: new Abstract: Humans play a vital role at every stage of AI development, from data collection and curation to model development and evaluation. However, humans often...
arXiv AI
Jun 29
The Alignment Target Problem: Divergent Moral Judgments of Humans, AI Systems, and Their Designers
arXiv:2604. 24155v3 Announce Type: replace-cross Abstract: The project of aligning machine behavior with human values raises a basic problem: whose moral expectations should guide AI decision-making?
arXiv AI
Aug 5
The Evolutionary Origin of Values: implications for AI alignment, sentience and existential risk
arXiv:2608. 03361v1 Announce Type: cross Abstract: AI systems based on Large Language Models (LLMs) have prompted fears that they may harbor hidden goals, seek to dominate or eliminate humanity, or even suffer as sentient beings.
arXiv AI
2d ago
VISPA: Pluralistic Alignment via Automatic Value Selection and Activation
arXiv:2601.12758v2 Announce Type: replace-cross Abstract: As large language models are increasingly used in high-stakes domains, it is essential that their outputs reflect not average} human preferen...
arXiv AI
Jun 8
VALUEFLOW: Toward Pluralistic and Steerable Value-based Alignment in Large Language Models
arXiv:2602. 03160v2 Announce Type: replace Abstract: Aligning Large Language Models (LLMs) with the diverse spectrum of human values remains a central challenge: preference-based methods often fail to capture deeper motivational principles.
arXiv AI
Aug 3
Fragility of Value under Imperfect Alignment
arXiv:2607. 28881v1 Announce Type: new Abstract: As more responsibility is placed upon AI systems, it becomes increasingly important to guarantee that these systems are aligned with humanity.
Hugging Face Trending Papers
Jul 8
Alignment Plausibility: A New Standard for Assuring AI in Healthcare
Large language models (LLMs) have become significant providers of mental health support, yet they remain products of an attention economy whose operational and commercial targets favour sustained engagement over the friction that effective psychological support often requires. Developers' safety responses have been largely reactive, addressing the most visible and acute harms while subtler, longer-term patterns of risk (e.
arXiv AI
Aug 11
Contextual Value Alignment via Multilayer Combinatorial Fusion
arXiv:2608. 07642v1 Announce Type: new Abstract: Aligning large language models (LLMs) with human values remains a major challenge, especially for trustworthy AI.
arXiv AI
Jul 10
Alignment Plausibility: A New Standard for Assuring AI in Healthcare
arXiv:2607. 07766v1 Announce Type: new Abstract: Large language models (LLMs) have become significant providers of mental health support, yet they remain products of an attention economy whose operational and commercial targets favour sustained engagement over the friction that effective psychological support often requires.