arXiv Computer Vision By Eliseo Fuentes-Martinez, Antonio Hidalgo-Centeno, Jorge Calvo-Zaragoza, Antonio Javier Gallego

Parameter-Efficient Fine-Tuning of Transformer Encoders for Audio-Image-Symbolic Music Retrieval

Read the original on arXiv Computer Vision →

The paper studies parameter‑efficient fine‑tuning (PEFT) methods—LoRA and QLoRA—on pretrained music encoders for audio, sheet‑music images, and symbolic scores. It compares full fine‑tuning with PEFT across nine encoders on TriScore and the Musical Theme Dataset, finding that LoRA/QLoRA often match or surpass full fine‑tuning while using far fewer parameters. However, gains in unimodal discrimination do not consistently translate to improved multimodal retrieval, though the adapted-and-projected representations achieve strong piece‑level retrieval performance on TriScore.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Machine Learning
Jul 17

MIDI-RAE-JEPA: Hierarchical Representation Learning and Generation for Symbolic Music

arXiv:2607. 14537v1 Announce Type: cross Abstract: Rich internal representations of musical structure are essential for music understanding tasks such as machine-assisted music co-writing, yet self-supervised approaches for symbolic music representation remain underexplored, particularly those that encode the hierarchical multiscale nature of musical structures.

By Scott H. Hawley
arXiv AI
Sep 16

MUUNRiver-Bench: Diagnosing Relation-Dependent Music Retrieval with Multimodal Instructions

MUUNRiver-Bench is a diagnostic benchmark for music retrieval that uses natural‑language instructions to define relevance for reference‑audio queries. It contains 3,440 tracks across 13 genres and 116 sub‑genres and covers seven tasks such as similar‑music, style‑preserving lyric‑rewriting, cover, and segment retrieval. Experiments with six models in eight configurations show that acoustic encoders favor local identity while text‑aligned encoders favor semantic relations, and that instruction‑aware and audio‑text fusion systems do not consistently outperform their backbones.

By Zhancheng Guo, Congren Dai, Shangda Wu, Jianhuai Hu, Danni Zhao, Xiaobing Li, Maosong Sun
arXiv Machine Learning
Oct 16

DuET: Note-Frame Dual Encoding for Piano Performance-to-Score Transcription

DuET is a Dual-Encoder Transformer that jointly learns note-level piano performance-to-score transcription and frame-level beat/downbeat tracking. It uses bidirectional cross‑attention between note and frame encoders and an autoregressive decoder that alternates between their representations to predict structured score attributes. The model introduces TimeRoPE and Time‑Pitch Rotary Positional Encoding (TPRoPE) to share a performance‑time reference and encode relative temporal and pitch relationships, achieving significant error reductions on ASAP and Gangqinpu datasets.

By Wei Zeng, Ye Wang
arXiv AI
Aug 25

ONOTE: Hypergraph-Grounded Omnimodal Reasoning for Computational Music Science

ONOTE is a unified framework that treats music as a scientifically structured domain of measurable cross-representation correspondences, focusing on omnimodal notation processing centered on sheet music. It introduces a test-only benchmark drawing from diverse musical sources—including staff, Jianpu, and tablature—across varied genres, instruments, and structural conditions, with aligned multimodal derivatives. The framework supports four complementary tasks—score understanding, notation conversion, audio transcription, and symbolic generation—while constructing a provenance-bearing proposition hypergraph from external music-theory materials for evidence retrieval and deterministic validity checks.

By Menghe Ma, Siqing Wei, Yuecheng Xing, Ziyue Zhu, Zhenghong Lin, Yaheng Wang, Fanhong Meng, Peijun Han, Luu Anh Tuan, Haoran Luo