arXiv Computer Vision
Data-Driven Glyph Positioning for Handwritten Music Synthesis
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv AI
Sep 10
Full-Page Optical Music Recognition of Handwritten Monophonic Scores
arXiv:2609.05662v1 Announce Type: cross Abstract: Full-page end-to-end Optical Music Recognition seeks to transcribe entire music pages directly into symbolic notation, avoiding the limitations of tr...
Hugging Face Trending Papers
Jun 8
Optical Music Recognition for Real-World Manuscripts with Synthetic Data
Optical Music Recognition (OMR) has seen major progress in model design, with end-to-end methods now capable of recognising notation at all levels of complexity. However, the impact of this progress has been limited by the visual domains of available training datasets, which are largely born-digital.
arXiv AI
Jul 8
LEGATO 2: Toward Multimodal Sheet Music Recognition and Understanding
arXiv:2607. 05769v1 Announce Type: cross Abstract: We propose a novel pipeline, Legato 2, for extracting symbolic notation and semantic knowledge from images of sheet music.
arXiv Machine Learning
Oct 16
DuET: Note-Frame Dual Encoding for Piano Performance-to-Score Transcription
DuET is a Dual-Encoder Transformer that jointly learns note-level piano performance-to-score transcription and frame-level beat/downbeat tracking. It uses bidirectional cross‑attention between note and frame encoders and an autoregressive decoder that alternates between their representations to predict structured score attributes. The model introduces TimeRoPE and Time‑Pitch Rotary Positional Encoding (TPRoPE) to share a performance‑time reference and encode relative temporal and pitch relationships, achieving significant error reductions on ASAP and Gangqinpu datasets.
arXiv Machine Learning
Jun 3
SketchSong: Hierarchical Song Generation with Sketch Planning and Fine-Grained Multi-Track Modeling
arXiv:2606. 03169v1 Announce Type: cross Abstract: Recent song generation systems can synthesize realistic audio, yet generating complete songs remains challenging for two reasons.
arXiv AI
Oct 16
InkSight: Offline-to-Online Handwriting Conversion by Teaching Vision-Language Models to Read and Write
InkSight is a system that converts offline handwritten notes captured in photos into digital ink, enabling seamless transition from pen-and-paper to editable, vectorized formats. Unlike prior methods that rely heavily on geometric image properties, InkSight integrates reading and writing priors, allowing it to learn from limited paired data. The model successfully derenders handwritten text in diverse photos and even simple sketches, with human evaluations showing 87% of outputs as valid tracings and 67% resembling human pen trajectories.