arXiv AI By Danbinaerin Han, Wonil Kim, Seah Hong, Dongjoo Moon, Jaeok Lee, Jongpil Lee, Chaewon Kim, Juhan Nam

Gugak-VocalSet: A Multi-Genre Studio-Quality Dataset of Korean Traditional Singing with Sigimsae Annotations

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv AI
Oct 26

Interpretable Singing Emotion Recognition Using Acoustic and Vocal Technique Features

The paper introduces an interpretable framework for singing emotion recognition that uses a compact set of singing-specific descriptors covering prosody, spectral features, phonetics, and vocal technique. By applying SHAP and GRAD-CAM, the authors link model predictions to measurable acoustic phenomena, showing that vocal technique descriptors reduce cross-singer variability and provide interpretable insights. Out‑of‑domain tests on VocalSet reveal that vibrato and pharyngeal techniques are key emotional cues, with vibrato’s importance depending on articulation rate.

By Fotini Kiriakopoulou, Vassilis Lyberatos, Spyridon Kantarelis, Athanasios Voulodimos, Giorgos Stamou
arXiv AI
Sep 15

DuoTok: Source-Aware Dual-Track Music Tokenization for Vocal-Accompaniment Generation

DuoTok is a source‑aware dual‑track music tokenizer designed for vocal‑accompaniment generation. It first learns a semantic audio representation via self‑supervised pretraining, then refines source‑aware structure with feature‑replacement noise and multi‑task supervision (spectral reconstruction, source separation regularization, and an ASR head for lyric alignment). The encoder is frozen and hard‑routed codebooks for vocals and accompaniment are learned, while a diffusion decoder restores fine acoustic detail from the discrete tokens, achieving a favorable predictability‑fidelity trade‑off at ultra‑low bitrate across public benchmarks.

By Rui Lin, Zhiyue Wu, Jiahe Lei, Kangdi Wang, Weixiong Chen, Junyu Dai, Tao Jiang