arXiv AI By Mikhail L. Arbuzov (Independent researcher), Karan Dave (Independent researcher), Evgeniya Dontsova (Independent researcher), Yaodong Hu (Independent researcher), Vincent Lao (Independent researcher), Navita Jain (Independent researcher), Sisong Bei (Independent researcher), Dmitry Dimov (Independent researcher)

Clarify, Then Focus: Statement Normalization for Conversation Analytics at Scale

Read the original on arXiv AI →

The paper introduces statement normalization, a method that converts enterprise conversation transcripts into concise, speaker-attributed statements enriched with source references and semantic tags. This approach clarifies the text and enables focused retrieval of relevant evidence for specific analytical questions. Experiments on customer‑service calls show that normalization boosts classifier performance and, when combined with selection, benefits weaker prompted readers, all while allowing small models to handle the process efficiently.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computation and Language
Aug 27

Leveraging Speech Acts for Low-Data and Cross-Domain Conversation Derailment Forecasting

The paper introduces a method for forecasting conversational derailment by incorporating speech act information as an auxiliary signal to enhance pragmatic representations. This approach aims to reduce lexical noise and improve generalizability, especially in low-data and cross-domain scenarios. Experiments on three datasets demonstrate performance gains over existing methods.

By Angela Yifei Yuan, Christine De Kock, Christopher Leckie
arXiv AI
Sep 2

Topic Matching in the Wild: Benchmark and Lessons from Real-World ASR Transcripts

The paper introduces a benchmark for topic matching in real-world ASR transcripts from contact centers, where noisy, punctuation‑free speech data must be classified into predefined topics. It presents a human‑annotated dataset of topic‑utterance judgments and evaluates three matcher types—regex, zero‑shot sentence embeddings, and Gemini‑based LLMs—using two topic representations: keyphrases and natural language descriptions. Experiments show that lightweight LLM matchers outperform the other methods, especially when natural language descriptions are used.

By Saman Rahbar, Xiliang Zhu, Irvin Cardoza, David Rossouw
arXiv Machine Learning
Sep 11

Explainability Assistant: A Conversational XAI Interface for Interpreting Energy Consumption Models

The paper introduces the Explainability Assistant, an open‑source conversational XAI system designed to interpret complex energy consumption forecasting models. By leveraging large language model function‑calling, it achieves 94% intent‑parsing accuracy and supports flexible natural‑language interaction across different ML problem types without task‑specific fine‑tuning. A comparative evaluation with energy domain specialists shows improved usability and consistent task accuracy, with all experts preferring the conversational interface over a traditional XAI dashboard.

By Rodion Krjut\v{s}kov, Eduard Barbu, Nikos Sakkas, Sofia Yfanti
arXiv Computation and Language
Sep 3

A Tri-Agent Framework for Evaluating and Aligning Question Clarification Capabilities of Large Language Models

The paper presents a tri‑agent framework for evaluating large language models’ question‑clarification abilities. It involves a Question Clarifying Agent that identifies ambiguities and asks follow‑up questions, a Respondent Agent that simulates human replies, and an Evaluator Agent that judges the dialogue using metrics such as ambiguity handling, question quality, dialogue efficiency, language appropriateness, and intent alignment. The authors illustrate the approach with synthetic supply‑chain data and discuss validating the evaluator against human judgments.

By Yikai Zhao, Saurabh Pandey, Pradeep Kumar Misra