arXiv AI

ONOTE: Hypergraph-Grounded Omnimodal Reasoning for Computational Music Science

ONOTE is a unified framework that treats music as a scientifically structured domain of measurable cross-representation correspondences, focusing on omnimodal notation processing centered on sheet music. It introduces a test-only benchmark drawing from diverse musical sources—including staff, Jianpu, and tablature—across varied genres, instruments, and structural conditions, with aligned multimodal derivatives. The framework supports four complementary tasks—score understanding, notation conversion, audio transcription, and symbolic generation—while constructing a provenance-bearing proposition hypergraph from external music-theory materials for evidence retrieval and deterministic validity checks.

arXiv AI
Jul 8

From Textural Counterpoint to Feature Encoding: A Multi-Dimensional Machine Representation Study of Haydn's "The Lark" Integrating Electroacoustic Analysis

arXiv:2607. 05902v1 Announce Type: cross Abstract: Chamber music, as a highly precise multi-part interactive system, contains a logic of "role assignment and dynamic interaction" that provides an extremely valuable blueprint for exploring human-computer collaborative composition paradigms.

By Yakun Liu, Zhiyu Jin, Hai Luan, Dong Liu, Xiaonan Li
arXiv Machine Learning
Jul 17

MIDI-RAE-JEPA: Hierarchical Representation Learning and Generation for Symbolic Music

arXiv:2607. 14537v1 Announce Type: cross Abstract: Rich internal representations of musical structure are essential for music understanding tasks such as machine-assisted music co-writing, yet self-supervised approaches for symbolic music representation remain underexplored, particularly those that encode the hierarchical multiscale nature of musical structures.

By Scott H. Hawley
arXiv AI
Sep 2

On the Human and Computer Alignment of Attribute-Based Music Matches

The paper introduces the MATCHA dataset, comprising 1,105 perceptual assessments from 83 experts on attribute-based music matches across five musical attributes—melody, harmony, rhythm, voice, and timbre. A triplet-based forced-choice experiment with 300 cases, including plagiarism, cover songs, and AI-generated music, was used to gather these judgments. Results show measurable agreement among participants and partial alignment with computational similarity measures, highlighting the need for perceptually grounded evaluation in generative AI for music.

By Roser Batlle-Roca, Woosung Choi, Joan Serr\`a, Fabio Morreale, Wei-Hsiang Liao, Xavier Serra, Emilia G\'omez, Yuki Mitsufuji
arXiv Computer Vision
2d ago

Parameter-Efficient Fine-Tuning of Transformer Encoders for Audio-Image-Symbolic Music Retrieval

The paper studies parameter‑efficient fine‑tuning (PEFT) methods—LoRA and QLoRA—on pretrained music encoders for audio, sheet‑music images, and symbolic scores. It compares full fine‑tuning with PEFT across nine encoders on TriScore and the Musical Theme Dataset, finding that LoRA/QLoRA often match or surpass full fine‑tuning while using far fewer parameters. However, gains in unimodal discrimination do not consistently translate to improved multimodal retrieval, though the adapted-and-projected representations achieve strong piece‑level retrieval performance on TriScore.

By Eliseo Fuentes-Martinez, Antonio Hidalgo-Centeno, Jorge Calvo-Zaragoza, Antonio Javier Gallego
arXiv Machine Learning
Oct 28

Does Notation Matter? MusicXML Tokenisation for Symbolic Music Generation and Understanding

The paper introduces the first general-purpose tokenisation framework for MusicXML and evaluates its impact on deep learning models for symbolic music. By training 26 autoregressive and masked language models, the authors compare MusicXML tokenisation against MIDI and ABC-based representations, exploring different tokenisation strategies and music-grammar-aware approaches. The study demonstrates that MusicXML-tokenised models outperform MIDI and text-based counterparts on both music understanding tasks (composer classification, difficulty estimation, accompaniment suggestion) and generative tasks, as shown by objective metrics and a human preference study.

By Andrea Poltronieri, Matteo Spanio, Simone Chieppa, Xavier Serra, Mart\'in Rocamora
arXiv AI
4d ago

A Tutorial on Generative Models for Music Audio

A tutorial monograph on generative models for music audio covers a wide range of applications—from instrumental clips and full songs with vocals to edits of existing recordings and real‑time accompaniment systems. It explains neural audio codecs, autoencoders, autoregressive and masked token models, diffusion and flow matching, sampling acceleration, and preference optimization, linking training objectives to published systems through worked examples. The book also discusses musical requirements for different tasks, compares representations and methods, and addresses evaluation, data provenance, memorization, attribution, and legal implications.

By Mateusz Modrzejewski, Joanna Kurkowska, Dorien Herremans
arXiv AI
Jul 16

From Prediction to Collaboration: Interactive Symbolic Music Analysis

arXiv:2607. 13587v1 Announce Type: cross Abstract: Automatic symbolic music analysis has made substantial progress, yet existing systems are typically designed for a single mode of use, such as full-score prediction, and therefore do not match the broader range of operations that arise in analysis workflows, including partial completion, local correction, and iterative refinement.

By Emmanouil Karystinaios, Johannes Hentschel, Markus Neuwirth, Gerhard Widmer
arXiv AI
Oct 27

Gangqinpu: A Multi-Genre, Multi-Task Piano Dataset with Aligned Audio, MIDI, and Musical Scores

Gangqinpu is a large, multi‑genre piano dataset that provides aligned audio, MIDI, and musical scores for 18,786 pieces, covering pop, classical, jazz, folk/traditional, rock, and blues. The dataset includes automatic note‑level alignments, beat/downbeat annotations, genre labels, and a binary classifier to filter non‑expressive performances. It is designed to reduce data leakage with ASAP splits and has shown cross‑dataset improvements in beat tracking and in‑domain gains for transcription and expressive performance rendering.

By Wei Zeng, Anvay Mathur, Ye Wang