arXiv Computation and Language September 17, 2026 By Christopher Bagdon, Carina Silberer, Roman Klinger

Emotion Experience, Expression, and Perception: Emotion Analysis on Multimodal Social Media Posts

Read the original on arXiv Computation and Language →

The paper introduces the Mult2EMo dataset, which gathers annotations from both authors and readers on multimodal social media posts and the real‑world events that triggered them. It investigates how well readers can reconstruct the authors’ emotional experience from the post content, emphasizing the importance of both text and image modalities. The study finds that accurate emotion reconstruction is possible but remains challenging, especially when images dominate the expression and when understanding the triggering event is essential.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

multimodal

arXiv Computer Vision

Sep 22

Beyond Emotion Prompts: Fine-Grained Text-to-Image Generation Driven by Valence-Arousal-Dominance

arXiv:2609.24215v1 Announce Type: new Abstract: Although text-to-image models can accurately depict subjects and scenes, creators still struggle to specify the fine-grained emotions an image should c...

By Minglang Li, Yueyue Fang, Xieping Gao

diffusion safety

arXiv Computation and Language

Sep 17

Donate or Create? Comparing Data Collection Strategies for Emotion-labeled Multimodal Social Media Posts

arXiv:2505.24427v2 Announce Type: replace Abstract: Accurate modeling of subjective phenomena such as emotion expression requires data annotated with authors' intentions. Commonly such data is collec...

By Christopher Bagdon, Aidan Combs, Carina Silberer, Roman Klinger

multimodal safety

arXiv AI

Jun 6

Emotion-Aware Image Generation from Korean Diary Text via LLM-based Prompt Translation and LoRA Fine-Tuning

arXiv:2606. 05816v1 Announce Type: cross Abstract: T2I models cannot effectively capture sentiment from various types of text, including diaries, as they primarily focus on visual object-related patterns rather than contextual emotional understanding.

By Jihun Cho, Soo-Yeon Jeong, Sun-Young Ihm

llms diffusion fine-tuning benchmarks

arXiv AI

Oct 28

CLEAR: Coupling Local Evidence with Affective Representations for Multimodal Emotion Recognition in Conversation

The paper introduces CLEAR, a framework for Multimodal Emotion Recognition in Conversation that couples contextual representations with local discriminative cues. It replaces emotion label generation with continuous internal representations from a vision‑language model and trains a classifier on these representations. Sample‑adaptive residual coupling is used to integrate textual and acoustic evidence from the target utterance into the contextual representation, improving emotion recognition performance on IEMOCAP and MELD datasets.

By Linan Zhu, Zihao Zhai, Mengfei Xu, Xiao Han, Yuqian Fu, Xiangfan Chen, Zihang Zhang

llms multimodal

arXiv Machine Learning

Sep 24

Small Cues, Big Consequences: Learning Pivotal Cues for Multimodal Meme Classification

arXiv:2609.26907v1 Announce Type: cross Abstract: Memes often derive their harmful, hateful, or sarcastic meaning from small but decisive visual, textual, or cross-modal cues. Existing multimodal cla...

By Akshit Sharma, Prashant W. Patil

multimodal benchmarks

arXiv Machine Learning

Jul 23

Emotion Collider: Dual Hyperbolic Mirror Manifolds for Sentiment Recovery via Anti Emotion Reflection

arXiv:2602. 16161v4 Announce Type: replace-cross Abstract: Emotional expression underpins natural communication and effective human-computer interaction.

By Rong Fu, Ziming Wang, Shuo Yin, Haiyun Wei, Kun Liu, Xianda Li, Simon Fong

rag multimodal benchmarks