arXiv AI

Efficient and Interpretable Body-Based Emotion Recognition with Lightweight Temporal Convolutional Networks

arXiv:2607. 20820v1 Announce Type: new Abstract: Body-based emotion recognition is important for real-time affective systems, but graph-based skeleton models can be computationally expensive.

arXiv Machine Learning
Sep 21

From Stress to Affect: Multimodal Deep Learning for Physiological Emotion Recognition Across Wearable Sensor Modalities

The study compares temporal deep learning models—Bidirectional LSTM, Temporal Convolutional Network, and Transformer—for physiological emotion recognition using two multimodal wearable datasets, WESAD and EmoWear. Experiments evaluate wrist-only, chest-only, and multimodal sensor configurations with participant-independent leave-one-subject-out cross-validation, and also explore ensembles, sensor ablation, sampling frequency, and saliency analysis. Results show that the best architecture varies by dataset, multimodal sensing consistently outperforms single-site configurations, and a 4 Hz sampling rate offers a cost-effective operating point.

By Desta Haileselassie Hagos, Saurav Keshari Aryal, Legand L. Burge
arXiv Computer Vision
Sep 11

Single-Stream Multi-Feature Fusion with Temporal Robustness for Gait Emotion Recognition

The paper introduces SV-GCN, a single-stream multi-feature fusion framework for 3D skeleton-based gait emotion recognition that incorporates temporal invariance. It uses intra-frame relative motion features to remove frame-rate sensitivity and embeds heterogeneous cues at shallow layers for early fusion, avoiding multi-stream complexity. A global mask-guided valid-frame spatio-temporal graph convolution module further enhances robustness to variable-length sequences and differing frame rates, achieving state‑of‑the‑art performance on the E‑Gait dataset and strong generalization across sequence lengths.

By Shirong Lyu, Silu Quan, Yixuan Ding, Chengpeng Wang
arXiv Machine Learning
Sep 15

Bridging the Gap in ECG-Based Emotion Recognition: A Unified Evaluation of Deep Learning Models

The paper evaluates deep learning models for electrocardiogram‑based emotion recognition, focusing on generalization across datasets rather than dataset‑specific performance. It introduces two open‑source tools—ARRC for standardized benchmarking and ARDT for inter‑dataset training—to merge three public AER datasets (CUADS, ASCERTAIN, DREAMER) into a more variable benchmark. Using these tools, the authors compare three prominent deep learning architectures and two CNN baselines with hyperparameter tuning and 10‑fold cross‑validation, revealing trade‑offs between accuracy and model complexity and providing a reproducible benchmark for future research.

By Timothy C Sweeney-Fanelli, Ajan Ahmed, Masudul Imtiaz
arXiv Machine Learning
Sep 16

EMODY Flow: Emotion-Aware Audio-Driven Full-Body Motion Generation

EMODY Flow is a lightweight flow‑matching framework that generates synchronized full‑body motion and facial expressions conditioned on speech and emotion. It attaches to a frozen Qwen‑3 Omni model, reusing its audio codecs to drive two parallel DiT generators for SMPL‑X body pose and FLAME facial expressions. An auxiliary emotion classifier at training time restores emotion sensitivity, enabling EMODY Flow to achieve state‑of‑the‑art gesture quality on BEAT2 and zero‑shot facial animation on TFHP, with significant improvements in FGD, Beat Correlation, and Diversity metrics.

By Harsh Kumar Agarwal, Xavier Alameda-Pineda, Olivier Perrotin
arXiv Computer Vision
Aug 31

MSCGC-KAN: Multi-scale Causal Graph Convolution and KAN-inspired Analytic-basis Mapping for EEG Emotion Recognition

The paper introduces MSCGC-KAN, a new EEG emotion recognition approach that builds on a pre‑trained CBraMod backbone. It incorporates a structured task head featuring multi‑scale causal graph convolution and Kolmogorov–Arnold feature mapping to better capture multi‑scale emotional dynamics, inter‑channel connectivity, and nonlinear discriminative patterns. Experiments on FACED and SEED‑VII show significant performance gains over a linear baseline, achieving balanced accuracies of 60.66% and 33.27% respectively.

By Haoliang Gong, Qingshan She, Jiale Xu, Yunyuan Gao, Xugang Xi