arXiv AI

What a One-Hour Interview Does Not Tell an LLM About You: Interviews Elicit Traits, Not Decision Policies

The study examines whether a one‑hour adaptive interview can reveal a person’s value‑laden decision policies to a large language model (LLM). Forty‑six adults underwent the interview and later answered 25 dilemma questions; the researchers compared predictions from various transcript segments, adaptive versus fixed follow‑ups, and a baseline model with no personal data. Results show that no part of the interview reliably predicts the participants’ answers better than the baseline, and adaptive follow‑ups offer no advantage over fixed ones, though the transcripts do help recover the participants’ MBTI types.

arXiv AI
Oct 9

Evidence-Traceable Dynamic Interviewer Architecture for Expertise-Adaptive Qualitative Interviews Using Local LLMs

The paper introduces an Evidence-Traceable Dynamic Interviewer Architecture that uses a locally hosted Large Language Model to adapt interview questions in real time based on participants’ expertise. It features a five‑module prompt‑driven design that profiles expertise, generates iterative questions, and maintains conversational continuity. In a study with 246 participants, the system achieved 78.9% agreement with self‑reported expertise and high ratings for relevance, engagement, and satisfaction.

By Aisvarya Adeseye, Jouni Isoaho, Adeyemi Adeseye, Seppo Virtanen, Mohammad Tahir
Hugging Face Trending Papers
Oct 8

Evidence-Traceable Dynamic Interviewer Architecture for Expertise-Adaptive Qualitative Interviews Using Local LLMs

The paper introduces an Evidence-Traceable Dynamic Interviewer Architecture that uses a locally hosted Large Language Model to adapt interview questions in real time based on participants’ expertise. It features a five‑module prompt‑driven design, including an Expertise Profiling module that achieved 78.9% exact agreement with self‑reported expertise and a Generate Iterative Questions module that showed a strong expertise‑complexity association. In a study with 246 participants, the system received high ratings for relevance, engagement, and satisfaction, indicating that its adaptive components functioned as intended.

arXiv AI
Sep 7

A Removal Based Approach to Improve LLM Faithfulness at Test-Time

The paper proposes a test‑time method to enhance the faithfulness of large language model (LLM) explanations by removing concepts not credited in the model’s explanation before re‑querying the model. This approach targets incompleteness—omissions of influential factors—rather than unsoundness, and is model‑agnostic, requiring no changes to model weights. Experiments across two datasets and multiple model families show improved faithfulness compared to standard prompting and faithfulness‑encouraging prompts.

By Qinglan Luo, S M A Nahian, John Guttag, S. Mazdak Abulnaga, Katie Matton
arXiv AI
Jun 10

Superficial Beliefs in LLM Decision-Making

arXiv:2606. 11016v1 Announce Type: new Abstract: We ask whether large language models (LLMs) merely imitate rationales when choosing between two options, or whether their choices reflect a systematic underlying decision structure.

By Gabriel Freedman, Francesca Toni
arXiv Machine Learning
Oct 8

Beyond the Sycophancy Score: How Task, Model, and Pressure Shape LLM Yielding

The study investigates how task difficulty, model type, and user pressure influence large language models’ tendency to abandon correct answers or endorse user positions—a phenomenon known as sycophancy. Using 103,939 graded replies across ten configurations of eight LLMs (with and without reasoning) and 13 pressure conditions, the authors find that the cost of verifying a claim and the presence of a guardrail are the dominant factors, while model family and pressure tactics play minor roles. Key practical insights include simplifying hard-to-verify problems, employing deep reasoning, framing questions neutrally, and selecting models based on guardrail performance.

By Guang Yang, Homa Hosseinmardi, Fengchen Liu, Amir Ghasemian