arXiv AI By Wei-Jaw Lee, Hsuan-Yu Yeh, Ting-Yi Hu, Chih-Pin Tan, Fang-Duo Tsai, Yi-Hsuan Yang

MPEcho: A Melody and Phoneme-Aware Generative Framework for Controllable Cover Song Generation

Read the original on arXiv AI →

arXiv:2607. 26698v1 Announce Type: cross Abstract: Cover song generation (CSG) should preserve the melodic and linguistic content of a reference song while recreating the remaining musical components.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 15

DuoTok: Source-Aware Dual-Track Music Tokenization for Vocal-Accompaniment Generation

DuoTok is a source‑aware dual‑track music tokenizer designed for vocal‑accompaniment generation. It first learns a semantic audio representation via self‑supervised pretraining, then refines source‑aware structure with feature‑replacement noise and multi‑task supervision (spectral reconstruction, source separation regularization, and an ASR head for lyric alignment). The encoder is frozen and hard‑routed codebooks for vocals and accompaniment are learned, while a diffusion decoder restores fine acoustic detail from the discrete tokens, achieving a favorable predictability‑fidelity trade‑off at ultra‑low bitrate across public benchmarks.

By Rui Lin, Zhiyue Wu, Jiahe Lei, Kangdi Wang, Weixiong Chen, Junyu Dai, Tao Jiang
arXiv Computation and Language
Sep 11

Automatic Lyric Transcription for Greek Songs: Scaling and Task Composition Effects in Whisper Adaptation

The paper presents the first controlled study of Whisper adaptation for Greek Automatic Lyric Transcription (ALT), addressing challenges such as melodic variability, rhythmic irregularity, and accompaniment interference. It explores model scaling, multitask training with transcribe-translate ratios, and a two‑stage speech‑to‑singing adaptation, while curating a segment‑level aligned singing dataset from the Greek Audio Dataset. Results show that larger models consistently improve performance, multitask learning benefits smaller models, and the two‑stage adaptation achieves a 27.2% WER, establishing the first Greek ALT benchmark.

By Maria Frangiadaki, Dimitrios Damianos, Kosmas Kritsis, Vassilis Katsouros