Can AI interview? Comparing AI-led to Human-led Chat Interviews
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The Flow has not summarised this story yet — read it at arXiv Computation and Language.
InterviewPlayground is a simulation environment designed to evaluate AI interviewers by using simulated participants whose behaviors are grounded in social theory. The platform generates an InterviewReportCard that assesses AI interviewers across validated measures. Empirical validation shows that performance in InterviewPlayground predicts human study outcomes with a Pearson correlation of 0.86, supporting its use for assessing AI interviewer performance and failure modes.
InterviewPlayground is a simulation environment designed to evaluate AI interviewers by using simulated participants whose behaviors are grounded in social theory. The platform generates an InterviewReportCard that assesses AI interviewers across validated measures. Empirical validation shows a strong correlation (average Pearson 0.86) between simulation results and real human studies, confirming the environment’s predictive validity.
The paper introduces an Evidence-Traceable Dynamic Interviewer Architecture that uses a locally hosted Large Language Model to adapt interview questions in real time based on participants’ expertise. It features a five‑module prompt‑driven design that profiles expertise, generates iterative questions, and maintains conversational continuity. In a study with 246 participants, the system achieved 78.9% agreement with self‑reported expertise and high ratings for relevance, engagement, and satisfaction.
The paper introduces an Evidence-Traceable Dynamic Interviewer Architecture that uses a locally hosted Large Language Model to adapt interview questions in real time based on participants’ expertise. It features a five‑module prompt‑driven design, including an Expertise Profiling module that achieved 78.9% exact agreement with self‑reported expertise and a Generate Iterative Questions module that showed a strong expertise‑complexity association. In a study with 246 participants, the system received high ratings for relevance, engagement, and satisfaction, indicating that its adaptive components functioned as intended.
arXiv:2608.22582v1 Announce Type: cross Abstract: Large-scale population surveys are essential for generating robust social and scientific insights, yet they face significant challenges, including de...
arXiv:2607. 20773v1 Announce Type: cross Abstract: Large language models (LLMs) have shifted human--computer interaction from `traditional'' interface journeys toward more conversational exchanges.