The paper introduces EmoStance, a method for controlling the affective orientation of empathetic responses by leveraging weak supervision from emoji distributions. It builds the EmojiDialogue dataset, extending EmpatheticDialogues with emoji votes and confidence scores, and uses a frozen instruction‑tuned LLM steered by continuous prefix embeddings to generate responses that align with the listener’s stance. In blind pairwise evaluations, EmoStance achieves a 62.2% decisive win rate, notably improving contextual specificity and perceived responsiveness compared to baselines.
By Ziyuan Jin, Yuxuan Ge, Zheng Tian
arXiv:2609.38157v1 Announce Type: cross
Abstract: Emotion-conditioned text-to-speech (TTS) models may fail to express the requested emotion reliably, and improving controllability by additional train...
By Kuan-Po Huang, Haohe Liu, Puyuan Peng, Haibin Wu, Zhaoheng Ni, Hung-yi Lee, Jinwon Lee, Neha Chachra
arXiv:2610.28337v1 Announce Type: cross
Abstract: Emoji are widely treated as compact affective tokens whose meaning is summarised by a single sentiment score. We argue that this picture is incomplet...
By Rohan James, Ioannis Christofilogiannis, Yuuv Jauhari, Shreya Shah, Gauri Pethkar
The paper audits a multilingual affective generation benchmark that uses emoji summaries for Bangla, English, and Hindi sentences. It finds that the benchmark’s conclusions are largely artifacts of the measurement instrument, with no system significantly outperforming another when annotators are treated as random factors. The study shows that annotator identity and output length drive most variance, and proposes a new stable metric called emoji‑affect decodability.
By Fardeen Sadab, Adib Sakhawat
arXiv:2608.30325v1 Announce Type: new
Abstract: Natural-language instructions enable flexible control of synthesized speech, yet emotional TTS systems primarily model a single utterance-level affect,...
By Yan Zhou, Yun Hong, Yang Feng
arXiv:2609.38182v1 Announce Type: cross
Abstract: Avatar-based multimodal empathetic response generation has emerged as a pivotal capability in human-centric systems, aiming to recognize user emotion...
By Xiaolin Chen, Xuemeng Song, Jinlan Fu, Weili Guan, Mong-Li Lee, Wynne Hsu