The paper investigates how much original audio information remains in frozen representations from various pretrained audio encoders by attempting to reconstruct five‑second, 44.1‑kHz stereo music clips. Using a shared Stable Audio Open latent diffusion decoder, the authors reconstruct audio from embeddings produced by supervised classifiers (VGGish, ConvNeXt), an audio‑text contrastive model (CLAP), and a waveform‑reconstruction model (EnCodec). Results on the Million Song Dataset reveal that reconstructability varies across encoder families and that embeddings exposing finer temporal or spectral detail enable better recovery of source content, even for compressed, task‑oriented embeddings.
By Marios Glytsos, Brian McFee
arXiv:2607. 08545v1 Announce Type: cross Abstract: End-to-end neural audio models achieve high-fidelity compression and generation.
By Nicole Cosme-Clifford
The paper introduces CPR, a piano rendering framework that combines continuous autoregressive modeling with local flow matching and full‑sequence refinement. It predicts continuous hidden states, generates 24 kHz acoustic latents, and upsamples to 48 kHz, while new techniques BREPA and MT‑RoPE enhance musical semantics and cross‑modal alignment.
By Chong Jing, Junan Zhang, Zhizheng Wu
arXiv:2606. 14791v1 Announce Type: cross Abstract: Self-supervised learning advances audio representation for multimedia analysis.
By Fengrui Liu, Ruiyang Huang, Qijian Zheng, Yuanfang Wang, Feng Liu
arXiv:2608. 14916v1 Announce Type: cross Abstract: AI-generated music detectors are commonly evaluated against original songs, but real-world uploads are often remixed, re-encoded, pitch-shifted, or otherwise edited.
By Alexandru-Stefan Morosanu, Valerian Cecan, Stefan-Daniel Achirei, Laura Erhan
arXiv:2608. 15690v1 Announce Type: cross Abstract: Text-to-audio-video (T2AV) generation models produce a video and its soundtrack from a textual description, but offer no control over whose voice speaks in the output.
By Ivan Mikheev, Viacheslav Vasilev, Anna Dmitrienko, Alexey Letunovskiy, Ivan Kirillov, Kirill Chernyshev, Denis Dimitrov