arXiv:2608.30325v1 Announce Type: new
Abstract: Natural-language instructions enable flexible control of synthesized speech, yet emotional TTS systems primarily model a single utterance-level affect,...
By Yan Zhou, Yun Hong, Yang Feng
arXiv:2504. 11837v3 Announce Type: replace-cross Abstract: Emotional support conversation (ESC) aims to alleviate people's emotional distress through effective conversations.
By Yue Zhao, Qingqing Gu, Xiaoyu Wang, Teng Chen, Zhonglin Jiang, Yong Chen, Hongyan Li, Luo Ji
arXiv:2507.01594v2 Announce Type: replace
Abstract: Task-oriented dialogue (ToD) systems aim to help users accomplish goals through natural language interaction. Beyond task success, effective ToD sy...
By Shutong Feng, Hsien-chin Lin, Nurul Lubis, Carel van Niekerk, Michael Heck, Benjamin Ruppik, Renato Vukovic, Milica Ga\v{s}i\'c
arXiv:2508. 09521v3 Announce Type: replace-cross Abstract: Emotional support conversations require more than fluent responses.
By Yunxiao Wang, Meng Liu, Sicheng Zhao, Lizi Liao, Liqiang Nie
arXiv:2606. 09837v1 Announce Type: cross Abstract: Emotional interaction is increasingly crucial for conversational AI, yet current systems lack a self-emotion determination mechanism to drive the streaming text-to-speech (TTS) synthesis.
By Yue Zhao, Hongyan Li, Yong Chen, Luo Ji
arXiv:2603. 06194v3 Announce Type: replace-cross Abstract: Reinforcement learning (RL) for large language models (LLMs) has shown strong performance in single-turn tasks, but extending it to multi-turn interaction remains challenging due to sparse rewards and poor per-turn credit assignment.
By Naifan Zhang, Ruihan Sun, Jinwei Su, Hengjie Yang, Zhengyuan Pan, Zhaohan Chen, Xiaofan Zhang
arXiv:2607.23648v2 Announce Type: replace
Abstract: Using large language models (LLMs) to assist psychological counseling is an important task in the field of natural language processing. The constru...
By Kaitong Weng, Lixin Liu, Zihao Liu, Bo Wang, Shiguang Ni
PragAlign is a feedback‑guided framework that improves synthetic dialogue generation by iteratively generating, evaluating, and revising conversations to meet specified service context, target intent, and target emotion. Using an LLM‑based evaluator that scores intent alignment, emotion alignment, coherence, fluency, and overall quality, PragAlign achieves a 99.50% acceptance rate on 800 dialogue specifications, outperforming one‑shot and repeated generation without feedback. Human evaluation confirms that intent expression and dialogue flow are reliably recognized, while emotion appropriateness remains more variable.
By Smitha Muthya Sudheendra, Jaideep Srivastava
arXiv:2607. 24191v1 Announce Type: cross Abstract: Conversational stance detection has shifted from static text analysis to dynamic multimodal modeling.
By Heyan Chai, Xin Li, Wenjie Wang, Jianyang Qin, Chaoyang Li, Lu Wang, Hao Chen, Qing Liao
arXiv:2608.29326v1 Announce Type: cross
Abstract: Positive psychology dialogue aims to support emotional distress and positive resource building, requiring models to produce not only empathetic repli...
By Yuxiong Wang, Ziwei Lin, Bo Wang, Yu Zhang, Shiguang Ni
The paper introduces an LLM-based framework for continuous dimensional emotion evaluation in multimodal dialogue, combining discrete emotion recognition with Valence-Arousal-Dominance (VAD) assessment on the IEMOCAP dataset. It incorporates acoustic cues as natural language descriptions via the SpeechCueLLM approach and evaluates six models from the LLaMA, GPT, and Qwen families using zero-shot, few-shot, and LoRA fine-tuning. LoRA-fine-tuned LLaMA models outperform prompt-engineered GPT models, achieving a new state-of-the-art Valence CCC of 0.7822, and ablation studies show that textual audio descriptions significantly benefit smaller models.
"whyItMatters":"The study demonstrates that domain adaptation through fine-tuning can surpass larger GPT models in multimodal emotion evaluation, highlighting the importance of tailored training for emotion recognition tasks."
By Yutong Hu, Jinho Choi
The article surveys multi‑turn conversational AI, highlighting its shift from isolated text prompts to sustained, multimodal interactions that involve clarifying goals, revising requests, and switching topics. It reviews literature across text‑only dialogue, AudioLLMs, multimodal and omni‑modal systems, and tool‑augmented agents, organizing findings around datasets, models, training, evaluation, and cross‑cutting challenges. The analysis reveals that while multimodal perception and action have progressed rapidly, systems still struggle with persistent memory, cross‑turn grounding, full‑duplex interaction, robust evaluation, and cultural alignment.
By Syeda Faiza Ahmed, Zien Sheikh Ali, Hunzalah Hassan Bhatti, Firoj Alam, Shammur Absar Chowdhury