arXiv AI
Aug 12
Toward a Theory of Value in AI Alignment
arXiv:2608. 10327v1 Announce Type: new Abstract: Can AI systems be aligned to human values?
Do LLMs Have Values? A Quantitative Analysis and Alignment Framework for Values in Large Language Models
The paper investigates whether large language models (LLMs) possess intrinsic value systems and how to quantify and align them. By projecting responses from 106 LLMs and 95,000 human survey profiles into a shared sociological space, the authors confirm that LLMs do have values, though these values form a concentrated, idealized core rather than mirroring human diversity. They introduce the Prior-Environment-Cognition (PEC) framework to mathematically define value expression and propose an adaptive Alignment Prescription that identifies minimal interventions—ranging from prompts to targeted parameter updates—to steer LLM values efficiently without harming general performance.
Related stories
arXiv Machine Learning
Jul 16
Value Drifts: Tracing Value Alignment During LLM Post-Training
arXiv:2510. 26707v2 Announce Type: replace-cross Abstract: As LLMs occupy an increasingly important role in society, they are more and more confronted with questions that require them not only to draw on their general knowledge but also to align with certain human value systems.
arXiv AI
Sep 2
Uncovering the Computational Ingredients of Human-Like Representations in LLMs
arXiv:2510.01030v2 Announce Type: replace Abstract: The human ability to translate diverse perceptual and linguistic inputs into structured behavior has been thought to rest on learning robust repres...
arXiv Computation and Language
Sep 2
Aligned but Flattened: Analyzing the Trade-off between Cultural Alignment and Diversity in LLMs
arXiv:2609.00565v1 Announce Type: cross Abstract: Cultural fine-tuning has become the de facto paradigm for building culture-aware large language models (LLMs), yet existing optimization exclusively...
arXiv AI
Jun 12
LLMs Can Better Capture Human Judgments--With the Right Prompts
arXiv:2606. 12754v1 Announce Type: cross Abstract: Are large language models (LLMs) bad at capturing human judgment?
arXiv Computation and Language
Aug 25
Every Token Counts: Exact Likert-Scale Distributions for Measuring LLM Attitudes and Biases
arXiv:2608.10503v2 Announce Type: replace Abstract: As Large Language Models (LLMs) are increasingly deployed as autonomous agents, accurately evaluating their latent values and biases is critical. T...
arXiv AI
Jul 7
The Rise of Verbal Tics in Large Language Models: A Systematic Analysis Across Frontier Models
arXiv:2604. 19139v3 Announce Type: replace-cross Abstract: As Large Language Models (LLMs) continue to evolve through alignment techniques such as Reinforcement Learning from Human Feedback (RLHF) and Constitutional AI, a growing and increasingly conspicuous phenomenon has emerged: the proliferation of verbal tics--repetitive, formulaic linguistic patterns that pervade model outputs.
arXiv Computation and Language
Sep 1
Do LLMs Change Their Minds Like Humans? Diagnosing Human--LLM Divergence in Single-Turn Persuasion Judgments
arXiv:2608.29803v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly deployed as proxies for human participants in social simulations, yet whether they update their beliefs...
arXiv AI
Jun 8
VALUEFLOW: Toward Pluralistic and Steerable Value-based Alignment in Large Language Models
arXiv:2602. 03160v2 Announce Type: replace Abstract: Aligning Large Language Models (LLMs) with the diverse spectrum of human values remains a central challenge: preference-based methods often fail to capture deeper motivational principles.
Hugging Face Trending Papers
Jul 9
PLURAL: A Global Dataset for Value Alignment
Large language models (LLMs) are used worldwide, yet disproportionately reflect Western values, limiting their ability to represent diverse value systems. We introduce PLURAL, a large-scale, value-focused preference dataset grounded in the Integrated Values Survey (IVS), a nationally representative survey spanning 92 countries.
arXiv AI
Jun 16
Metacognitive Myopia in Large Language Models
arXiv:2408. 05568v2 Announce Type: replace Abstract: Large Language Models (LLMs) exhibit potentially harmful biases that reinforce culturally embedded stereotypes, influence moral judgments, or amplify positive evaluations of majority groups.
arXiv AI
Jun 17
Teaching Values to Machines: Simulating Human-Like Behavior in LLMs
arXiv:2605. 30036v2 Announce Type: replace Abstract: Large Language Models (LLMs) demonstrate a remarkable capacity to adopt different personas and roles; however, it remains unclear whether they can manifest behavior that adheres to a coherent, human-like value structure.