arXiv AI By Fotini Kiriakopoulou, Vassilis Lyberatos, Spyridon Kantarelis, Athanasios Voulodimos, Giorgos Stamou

Interpretable Singing Emotion Recognition Using Acoustic and Vocal Technique Features

Read the original on arXiv AI →

The paper introduces an interpretable framework for singing emotion recognition that uses a compact set of singing-specific descriptors covering prosody, spectral features, phonetics, and vocal technique. By applying SHAP and GRAD-CAM, the authors link model predictions to measurable acoustic phenomena, showing that vocal technique descriptors reduce cross-singer variability and provide interpretable insights. Out‑of‑domain tests on VocalSet reveal that vibrato and pharyngeal techniques are key emotional cues, with vibrato’s importance depending on articulation rate.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 5

Towards Unified Music Emotion Recognition across Dimensional and Categorical Models

The paper introduces a unified multitask learning framework for Music Emotion Recognition that simultaneously handles categorical and dimensional emotion labels, enabling training across multiple datasets. It leverages musical features such as key and chords, MERT embeddings, and employs knowledge distillation from teacher models to a student model to improve generalization. Experiments on MTG‑Jamendo, DEAM, PMEmo, and EmoMusic show that this approach outperforms state‑of‑the‑art models, including the top MediaEval 2021 entry.

By Jaeyong Kang, Dorien Herremans