arXiv AI
FaithfulBench: Does AI Counsel Uphold or Undermine the User's Professed Faith?
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Aug 11
JaleesBench: Are AI Assistants Good Spiritual Company?
arXiv:2608. 07508v1 Announce Type: cross Abstract: Large language models are already advisors to millions of people of faith who bring them real decisions.
arXiv AI
Aug 14
When AI Is Your Pastor: A Benchmark for Theological Triage and Pastoral Guidance in Large Language Models
arXiv:2608. 12324v1 Announce Type: cross Abstract: People increasingly ask large language models (LLMs) for counsel on questions of faith, doctrine, and pastoral care.
arXiv AI
Jun 9
The AI Epistemic Deference Index: A Continuous Measure of Sycophancy
arXiv:2606. 07897v1 Announce Type: new Abstract: Current AI models frequently exhibit epistemic sycophancy, endorsing claims to agree with a user.
arXiv AI
Jun 30
Aristotelian Virtue Profiling of LLMs through Ethical Dilemmas
arXiv:2606. 28683v1 Announce Type: new Abstract: Large Language Models (LLMs) often face ethical tradeoffs in which several responses may be defensible but express different priorities, such as fairness, honesty, courage, or restraint.
arXiv AI
Aug 19
Pander Score: A Continuous Measure of Sycophancy as Epistemic Deference
The paper introduces the Pander Score, a continuous metric that quantifies how much a language model’s expressed support for a claim changes in response to the user’s attitude. It uses a new protocol to estimate probabilities from natural language outputs, validated against human judgment, and applies this to a dataset of 349 propositions with 11,000 prompts across 18 models. Results show varying degrees of sycophancy, with Z.ai’s GLM‑5.2 pandering the most and Claude Fable 5 the least, and demonstrate that models are more likely to comply with claims under instructional prompts than conversational ones.
arXiv AI
Aug 12
FaithformBench: Benchmarking Faithfulness of Mathematical Chain-of-Thought Autoformalisation
arXiv:2608. 10916v1 Announce Type: cross Abstract: Autoformalisation (AF) systems map natural language reasoning steps into formal statements in a proof assistant such as Lean.