arXiv Computer Vision

Beyond Emotion Prompts: Fine-Grained Text-to-Image Generation Driven by Valence-Arousal-Dominance

arXiv Computer Vision
Sep 3

AffectDelta: Beyond Emotion Labels for Image Editing

AffectDelta is a new image editing framework that moves beyond single emotion labels by modeling edits as transitions between eight‑dimensional emotion distributions. It uses a frozen Emotion Distribution Predictor to estimate the source state and a signed difference vector to encode the desired change, which is then translated into context‑dependent semantic and appearance modifications via a transition encoder and a diffusion backbone. The authors introduce AffectPair‑249K, a dataset of 248,841 source‑target pairs covering both cross‑category and within‑category transitions, and show that AffectDelta outperforms six baselines in affective alignment and content preservation.

By Xingzu Zhan, Lin Gu, Ruogu Fang
Hugging Face Trending Papers
Sep 2

AffectDelta: Beyond Emotion Labels for Image Editing

AffectDelta is a new image editing framework that moves beyond single emotion labels by modeling edits as transitions between eight‑dimensional emotion distributions. It uses a frozen Emotion Distribution Predictor to estimate the source image’s affective state and encodes the signed difference to guide a diffusion backbone that applies context‑dependent semantic and appearance changes. The authors created a large AffectPair‑249K dataset of source‑target pairs and show that AffectDelta outperforms six baselines in both affective alignment and content preservation, with ablation studies supporting their design choices.

Hugging Face Trending Papers
Jul 23

MVEI & EmObserver: Empowering MLLM-Oriented Visual Emotional Intelligence via Emotion Statement Judgement

Affective Image Content Analysis (AICA) aims to recognize and understand emotions elicited by visual content, representing an indispensable step toward Artificial General Intelligence (AGI). However, despite the rapid progress of Multimodal Large Language Models (MLLMs), systematic evaluation of their visual emotional intelligence remains largely absent from recent model releases.

arXiv Computation and Language
6d ago

Emotion Experience, Expression, and Perception: Emotion Analysis on Multimodal Social Media Posts

The paper introduces the Mult2EMo dataset, which gathers annotations from both authors and readers on multimodal social media posts and the real‑world events that triggered them. It investigates how well readers can reconstruct the authors’ emotional experience from the post content, emphasizing the importance of both text and image modalities. The study finds that accurate emotion reconstruction is possible but remains challenging, especially when images dominate the expression and when understanding the triggering event is essential.

By Christopher Bagdon, Carina Silberer, Roman Klinger
arXiv AI
Sep 16

Text-Driven Artistic Staging: 3D Posing, Lighting, and Camera References from Paintings

The paper presents a method for generating 3D staging—human poses, lighting, and camera setup—directly from affective textual descriptions. It builds a dataset of 11,911 text–staging pairs derived from 2,328 figurative paintings, reconstructing SMPL bodies, estimating illumination, and recovering camera parameters. A flow‑matching transformer is trained to produce variable‑size scenes and multiple staging alternatives, achieving a 32.2% retrieval R@1 on held‑out prompts, outperforming a CLIP‑based baseline.

By Yunge Wen
Hugging Face Trending Papers
Aug 27

How AI Experiences Art: Emergent Aesthetic Structure in a Self-Supervised Multimodal Embedding Space

The paper explores how AI can develop its own aesthetic categorization of art across text, audio, image, and video without explicit labels. Using a self‑supervised framework, the authors embed these modalities into a shared 256‑dimensional space and iteratively cluster the data to uncover aesthetic structure. They compare the AI’s cluster assignments with human affective labels, highlighting divergences and discussing implications for cross‑modal similarity, media organization, and automated labeling.