arXiv Computation and Language By Angela Yifei Yuan, Christine De Kock, Christopher Leckie

Leveraging Speech Acts for Low-Data and Cross-Domain Conversation Derailment Forecasting

Read the original on arXiv Computation and Language →

The paper introduces a method for forecasting conversational derailment by incorporating speech act information as an auxiliary signal to enhance pragmatic representations. This approach aims to reduce lexical noise and improve generalizability, especially in low-data and cross-domain scenarios. Experiments on three datasets demonstrate performance gains over existing methods.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language
Sep 4

Decoupling Turn-Taking from Semantics: A Decoupled Data Approach for Finite-State-Machine-Based Full-Duplex Dialogue

The paper introduces a decoupled data approach for the Neural Finite State Machine (NFSM) framework to improve full‑duplex dialogue. It serializes real human‑human spoken dialogues into FSM tapes using a rule‑based event‑guided transformation, while shaping semantics through human‑agent text dialogues. A Source‑Aware Calibrated (SAC) loss is proposed to balance state‑transition token distribution and align each data source with its strongest supervisory signal, leading to better turn‑taking performance without sacrificing semantic quality.

By Yihang Li, Chenhui Chu
arXiv AI
Oct 9

Clarify, Then Focus: Statement Normalization for Conversation Analytics at Scale

The paper introduces statement normalization, a method that converts enterprise conversation transcripts into concise, speaker-attributed statements enriched with source references and semantic tags. This approach clarifies the text and enables focused retrieval of relevant evidence for specific analytical questions. Experiments on customer‑service calls show that normalization boosts classifier performance and, when combined with selection, benefits weaker prompted readers, all while allowing small models to handle the process efficiently.

By Mikhail L. Arbuzov (Independent researcher), Karan Dave (Independent researcher), Evgeniya Dontsova (Independent researcher), Yaodong Hu (Independent researcher), Vincent Lao (Independent researcher), Navita Jain (Independent researcher), Sisong Bei (Independent researcher), Dmitry Dimov (Independent researcher)
arXiv AI
Sep 25

A Harness for Synthesizing Diverse Naturalistic Full-Duplex Conversations

The paper introduces a pipeline that generates intent‑labeled, two‑channel conversational speech from relational event lists, enabling controlled synthesis of full‑duplex dialogue with 42 phenomena across eight families in English and Mandarin. By having an LLM author each event’s speaker, text, conversational act, and attachment, and then aligning and timing these events independently, the system produces diverse, realistic turn‑taking signals. Experiments show that models trained on this synthetic corpus achieve higher floor‑occupancy accuracy and better start‑speaking/listening F1 scores compared to models trained on prior data.

By Matthew Sun, Vinay Kothapally, Meng Yu, Chao Huang, Hao Zhang, Yixuan Zhang, Steve Yves
arXiv AI
Aug 28

When Text Misleads: Inconsistent-Aware Reasoning for Audio-Grounded Dialogue

The paper introduces ContraTalk, a benchmark that tests whether dialogue models truly use acoustic cues or rely on transcript shortcuts. It formalizes cross‑modal disagreement, creates conflict and consistent QA examples, and proposes an Audio Twin representation to expose acoustic evidence to models. Experiments show that while text‑only LLMs perform well on consistent cases, they falter on conflict cases, and AudioLLMs only partially mitigate this issue.

By Yen-Ju Lu, Yuzhe Wang, Yaohan Guan, Xiluo He, Jiarui Hai, Mingrui Liang, Kaavya Chaparala, Thomas Thebaud, Laureano Moro-Velazquez, Najim Dehak, Jesus Villalba