arXiv AI By Guang Yang, Brian Siyuan Zheng, Victoria Ebert, Noah A. Smith

LEGATO 2: Toward Multimodal Sheet Music Recognition and Understanding

Read the original on arXiv AI →

arXiv:2607. 05769v1 Announce Type: cross Abstract: We propose a novel pipeline, Legato 2, for extracting symbolic notation and semantic knowledge from images of sheet music.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Sep 17

Instrument Classification of Solo Sheet Music Images

This paper investigates instrument classification using solo sheet music images rather than audio. It converts images into sequences of musical words via bootleg score representation and treats the task as text classification, training AWD‑LSTM, GPT‑2, and RoBERTa models on IMSLP data for eight instruments. Pretraining on unlabeled data and fine‑tuning improves RoBERTa’s accuracy from 34.5% to 42.9%, and two proposed data‑augmentation methods raise accuracy by an additional 15%.

By Kevin Ji, Daniel Yang, TJ Tsai