arXiv Computation and Language

Transition-Matrix Regularization for Next Dialogue Act Prediction in Counselling Conversations

The paper introduces a KL regularization term that aligns predicted dialogue act distributions with empirical transition patterns derived from a corpus. Applied to a 60‑class German counselling taxonomy, this method improves macro‑F1 scores by 9–42% relative to various encoders and enhances dialogue‑flow alignment. Cross‑dataset validation on the HOPE dataset shows that the gains transfer across languages and counselling domains, and systematic ablations reveal that transition regularization consistently benefits weaker baseline models, especially in fine‑grained, data‑sparse dialogue tasks.

arXiv Computation and Language
Oct 5

Understanding Clinical Cognitive Dialogues Using Large Language Models

The paper introduces a de‑identified corpus of 33 in‑person cognitive assessment conversations, comprising 8,250 utterances annotated for three speaker roles and 56 dialogue acts. The authors benchmark large language models on fine‑grained dialogue‑act classification and next‑patient‑utterance generation, finding that instruction tuning and reasoning‑aware fine‑tuning improve performance but that models still struggle with closely related dialogue acts. The corpus and benchmark are presented as tools to measure interaction structure in cognitive assessments and to support future research on conversational markers, clinician education, and validated simulated patients.

By Vishalakshi Arumugam, Dan Schumacher, Veronica Rammouz, Erfan Nourbakhsh, Enrique Gonzalez Guerrero, Jeremy Davis, Anthony Rios
arXiv Computation and Language
Sep 3

TalkFa: A Unified Benchmark for Farsi Dialogue Generation and Understanding

TalkFa introduces a unified benchmark for Farsi dialogue generation and understanding, comprising three datasets: WIKI‑FADIAL (4.2K Wikipedia‑grounded dialogues), DAILYDIALOG‑FA (6.6K dialogues with dialogue‑act and emotion annotations), and PLAYDIAL‑FA (2.1K theatrical dialogues with sentiment labels). All dialogues are curated through multi‑stage review by native speakers, ensuring high quality. Experiments show that LoRA fine‑tuning improves generation performance with less data, while specific models excel on classification tasks, and human evaluation confirms the benchmark’s reliability.

By Neda Jamshidi, Kamyar Zeinalipour, Fahimeh Akbari, Monica Bianchini, Marco Maggini, Marco Gori
arXiv Computation and Language
Oct 19

ASR-Style Transcript Normalization Removes Useful Pragmatic Signal for Dialogue Act Classification

The study investigates how automatic speech recognition (ASR) transcript normalization—specifically the removal of filled pauses, punctuation, and colloquial expansions—affects dialogue act classification. By testing nine transcript conditions across six classifiers and three conversational corpora, the authors find that heavy normalization consistently lowers Macro‑F1 scores, especially when using a comprehensive filler lexicon. Punctuation removal and selective filler removal also degrade performance, indicating that the impact of normalization varies with preprocessing choices, feature extraction methods, and the conversational context.

By Lucky Onyekwelu-Udoka, Md Shafiqul Islam
arXiv Computation and Language
Aug 27

Leveraging Speech Acts for Low-Data and Cross-Domain Conversation Derailment Forecasting

The paper introduces a method for forecasting conversational derailment by incorporating speech act information as an auxiliary signal to enhance pragmatic representations. This approach aims to reduce lexical noise and improve generalizability, especially in low-data and cross-domain scenarios. Experiments on three datasets demonstrate performance gains over existing methods.

By Angela Yifei Yuan, Christine De Kock, Christopher Leckie
arXiv AI
Aug 25

DiaRelay: Relaying Dialogue Context with a Constant-Size Memory for Emotion Recognition in Conversation

DiaRelay introduces a lightweight adapter that lets large language models maintain a constant‑size dialogue‑level memory for emotion recognition in conversation. It builds on LoRA by adding a Selective Relay Memory Transition that aggregates useful historical evidence into a bounded memory, and a Dual‑axis Relay Memory Read that uses this memory to modulate low‑rank feature transformations. Experiments show DiaRelay achieves state‑of‑the‑art weighted F1 and accuracy on MELD with only 7.1 M additional trainable parameters, while also performing competitively on IEMOCAP.

By Zihao Zhou, Bin Yang, Jinghui Qin, Kebing Jin
arXiv Machine Learning
Sep 7

Dual-Scale State-Space Modeling with Speaker-Wise Dynamic CRF for Speech Emotion Recognition in Conversation

The paper introduces DSSM-CRF, an audio‑only architecture for conversational speech emotion recognition that separates cross‑speaker contextual influence from within‑speaker emotion evolution. It uses bidirectional state‑space models to encode fused self‑supervised speech representations at both frame and dialogue scales, then orders each speaker’s utterances into an independent dynamic conditional random field chain. The model achieves state‑of‑the‑art performance on IEMOCAP and MELD, with complementary gains from speaker‑wise factorization and CRF modeling.

By Guan-Hua Wen, Hou-Chiang Tseng, Kuan-Yu Chen
arXiv Computation and Language
Sep 4

Decoupling Turn-Taking from Semantics: A Decoupled Data Approach for Finite-State-Machine-Based Full-Duplex Dialogue

The paper introduces a decoupled data approach for the Neural Finite State Machine (NFSM) framework to improve full‑duplex dialogue. It serializes real human‑human spoken dialogues into FSM tapes using a rule‑based event‑guided transformation, while shaping semantics through human‑agent text dialogues. A Source‑Aware Calibrated (SAC) loss is proposed to balance state‑transition token distribution and align each data source with its strongest supervisory signal, leading to better turn‑taking performance without sacrificing semantic quality.

By Yihang Li, Chenhui Chu
Hugging Face Trending Papers
Jun 2

Efficient ASR Training with Conversations that Never Happened

Conversational ASR for lower-resource languages and niche domains is limited by the scarcity of domain-matched multi-speaker training data. We propose an augmentation pipeline that generates scenario-level dialogues with participant metadata, maps speaker attributes to TTS voice profiles, and assembles synthesized utterances into speaker-aware simulated conversations.