Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

26,872 stories · RSS feed

arXiv AI
Oct 1

Whose Voice Survives the Summary? A Voice-Retention Audit of LLM Employee Listening

The paper introduces a Voice Retention / Representation Ratio metric to assess bias in large language model (LLM) summaries of employee feedback. Using a bilingual corpus of 2,586 responses from a global professional services firm, the study finds that criticism is reported more reliably than praise, and that LLM summaries tend to filter by popularity rather than sentiment—criticism often survives while single-mention concerns, short or German-only content are frequently omitted. The authors argue that prevalence, not sentiment, drives the bias, and provide a metric, field evidence, and a disaggregated voice‑retention card for future audits.

By Thilo Tamme, Anton Hantel, Bijan Khosrawi-Rad
arXiv AI
Oct 1

FIGS: Evaluating Multi-Turn Sycophancy Without Penalizing Empathy

The paper introduces FIGS, a dual‑axis evaluation framework for multi‑turn sycophancy that avoids penalizing empathy. It uses a 10‑turn conversational simulator with 500 diverse scenarios to test whether models stay truthful while keeping praise proportional, and whether they show calibrated validation of user feelings. The study finds that current models either drift toward sycophancy or become overly detached, highlighting an unresolved trade‑off in sustained dialogue.

By Sidharth Pulipaka, Ruta Binkyte, Ivaxi Sheth, Sahar Abdelnabi
arXiv AI
Oct 1

Functional Subspace, where language models can use vector algebra to solve problems

The paper proposes that large language models (LLMs) encode high‑level concepts as linear directions within their activation space and that they can use subspaces and vector algebra to perform tasks. By analyzing functional modules and residual streams during in‑context learning (ICL), the authors find that LLMs can create evidence‑accumulating subspaces and solve ICL tasks through simple algebraic operations within those subspaces.

By Jung H. Lee, Sujith Vijayan
arXiv AI
Oct 1

Speech-based Psychological Crisis Assessment using LLMs

The paper presents an LLM-based framework for automatically classifying crisis levels in psychological support hotlines, addressing variability in human judgments and staffing constraints. It introduces a paralinguistic injection method that embeds non‑verbal emotional cues into transcripts, allowing the model to consider acoustic nuances. A reasoning‑enhanced training strategy encourages the model to produce diagnostic reasoning chains, which regularizes and improves classification, achieving a macro F1‑score of 0.802 and accuracy of 0.805 in 5‑fold cross‑validation.

By Terumi Chiba, Yang Luo, Ziyun Cui, Yongsheng Tong, Chao Zhang