arXiv Machine Learning

EmoNet: A Lightweight Attention-Based CNN for Speech Emotion Recognition

EmoNet is a lightweight attention‑based CNN framework designed for speech emotion recognition across seven categories. It combines a four‑block depthwise separable CNN encoder with squeeze‑and‑excitation attention, residual connections, a Bidirectional LSTM, and multi‑head attention pooling, using a 134‑channel acoustic feature set and data augmentation to enhance robustness. On a combined TESS, RAVDESS, and SAVEE dataset, EmoNet achieves 96.75% test accuracy with only 4.11 million parameters, outperforming a reproduced baseline and competing with larger state‑of‑the‑art models.

arXiv Machine Learning
Sep 15

Bridging the Gap in ECG-Based Emotion Recognition: A Unified Evaluation of Deep Learning Models

The paper evaluates deep learning models for electrocardiogram‑based emotion recognition, focusing on generalization across datasets rather than dataset‑specific performance. It introduces two open‑source tools—ARRC for standardized benchmarking and ARDT for inter‑dataset training—to merge three public AER datasets (CUADS, ASCERTAIN, DREAMER) into a more variable benchmark. Using these tools, the authors compare three prominent deep learning architectures and two CNN baselines with hyperparameter tuning and 10‑fold cross‑validation, revealing trade‑offs between accuracy and model complexity and providing a reproducible benchmark for future research.

By Timothy C Sweeney-Fanelli, Ajan Ahmed, Masudul Imtiaz
arXiv Machine Learning
Oct 8

Speech Emotion Recognition Using CNN and Its Use Case in Digital Healthcare

The paper presents a convolutional neural network (CNN) model for speech emotion recognition (SER), aiming to classify emotions from audio recordings. It evaluates the model using precision, recall, and F1 score, and explores how various input and output parameters influence performance. The study applies the SER system to digital healthcare, proposing it as a bridge between human emotional states and artificial intelligence.

By Nishargo Nigar
arXiv AI
Sep 7

Enhancing Multimodal Emotion Recognition via Multi-Feature Encoding and Attention-Based Fusion

The paper introduces a multimodal emotion recognition framework that combines audio and visual feature extraction with an attention-based fusion strategy. Audio features include Wav2Vec2 embeddings, MFCCs, and statistical acoustic descriptors, fused via a BiLSTM, while video features are extracted using a ResNet50-BiLSTM architecture. A multi-head attention mechanism fuses these modalities, and experiments on MELD and IEMOCAP show significant accuracy and robustness gains, especially in unbalanced data settings.

By Xu Lin, Ke Wang, Hui Kang, Xinying Wang
arXiv Computation and Language
Sep 4

SISER: Speaker-Invariant Speech Emotion Recognition with Entropy-Based Adversarial Training

SISER is a speaker‑invariant speech emotion recognition framework that combines wav2vec 2.0 for feature extraction with an ECAPA‑TDNN speaker discriminator in an entropy‑based adversarial training scheme. By leveraging self‑supervised representations, SISER reduces reliance on large labeled datasets and suppresses speaker identity more effectively than shallow classifiers. On the IEMOCAP benchmark, SISER achieves a UA of 60.63%, surpassing both the baseline (51.15%) and wav2vec 2.0 without speaker suppression (56.46%).

By Eunseo Choi, Hyunku Kang, Chanwoo Kim