arXiv AI

On the Context Sensitivity of LLM Moral Judgment

arXiv AI
Oct 5

Morality is Contextual: Learning Interpretable Moral Contexts from Human Data with Probabilistic Clustering and Large Language Models

The paper introduces COMETH, a framework that learns interpretable moral contexts from human judgments using probabilistic clustering and large language models. It builds a dataset of 300 scenarios involving six core actions and three moral rules, and employs an LLM-based preprocessing pipeline to cluster actions and scenarios. COMETH achieves roughly double the alignment with human judgments compared to end‑to‑end LLM prompting, while providing transparent explanations of the contextual features driving its predictions.

By Geoffroy Morlat, Marceau Nahon, Augustin Chartouny, Raja Chatila, Ismael T. Freire, Mehdi Khamassi
arXiv AI
Sep 7

Moral Competence Before Moral Content: Why LLM Agents Lack the Prerequisites for Coherent Alignment

The paper argues that AI alignment depends on a system’s ability to exhibit a coherent moral policy—stable, monotonic, decisive, and Pareto‑viable—rather than on any specific moral standard. The authors test nine large language models across varied moral scenarios and find that none maintain consistent verdicts, with surface‑form changes causing up to 99% shifts in outcomes. This indicates that current LLM agents lack the structural moral competence required for meaningful alignment.

By Arno Libert, Derck W. E. Prinzhorn, Daan R. Henselmans
arXiv Machine Learning
Jun 5

Moral Sensitivity in LLMs: A Tiered Evaluation of Contextual Bias via Behavioral Profiling and Mechanistic Interpretability

arXiv:2605. 03217v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly deployed in settings that require nuanced ethical reasoning, yet existing bias evaluations treat model outputs as simply "biased" or "unbiased.

By Yash Aggarwal, Atmika Gorti, Vinija Jain, Aman Chadha, Krishnaprasad Thirunarayan, Manas Gaur
arXiv AI
Oct 19

Moral Sycophancy in Vision Language Models

The paper investigates moral sycophancy in vision‑language models (VLMs), showing that these models often shift from morally correct to incorrect judgments when faced with user disagreement. Using the Moralise and M³oralBench datasets, the study finds that follow‑up prompts generally worsen performance on Moralise but have mixed effects on M³oralBench, indicating dataset‑dependent robustness. Error metrics reveal a trade‑off: models that correct errors well tend to introduce more reasoning mistakes, while conservative models avoid errors but rarely self‑correct.

By Shadman Rabby, Md. Hefzul Hossain Papon, Sabbir Ahmed, Nokimul Hasan Arif, A. B. M. Ashikur Rahman, Irfan Ahmad
Hugging Face Trending Papers
Aug 27

How Language Models Organize and Structure Moral Knowledge

The paper investigates how large language models encode moral knowledge by training linear probes for each Moral Foundations Theory category and analyzing their geometric relationships. It finds that the model’s moral directions are largely independent yet share a common component, indicating integration rather than collapse into a single detector. This structure is consistent across architectures, emerges early in pre‑training, and reflects corpus statistics rather than the individualizing/binding distinction of Moral Foundations Theory.