arXiv AI By Esteban Guti\'errez, Lonce Wyse, Frederic Font, Xavier Serra

SCAPES: Semantically Conditioned Autoregressive Prior for Environmental Sounds

Read the original on arXiv AI →

SCAPES is a lightweight, resource‑efficient generative model that synthesizes high‑fidelity environmental sounds with high‑level semantic control. It operates on the continuous latent manifold of a neural audio codec, using a segmentation strategy and a Continuous Normalizing Flow to model latent trajectories. A 36‑million‑parameter instance can be trained on limited, uncurated data with a single consumer‑grade GPU, achieving convergence in roughly twice the source audio duration and enabling smooth semantic interpolation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 7

WorldSonus: Bringing Sound to Worlds

arXiv:2610.08760v1 Announce Type: cross Abstract: Recent advances in world models have enabled increasingly realistic visual synthesis. However, these generated environments remain largely silent. Br...

By Pengjun Fang, Jingyi Fa, Kam Man Wu, Jiaming Wang, Haoyuan Huang, Yaguang Wu, Xiangjun Huang, Ziyang Ma, Weijia Chen, Hongyu Liu, Zeyue Tian, Qifeng Chen
arXiv Machine Learning
Oct 22

SAGE: Semantic Audio Generative Encoder

SAGE, a 105‑million‑parameter semantic audio generative encoder, compresses music waveforms into compact latent representations by distilling embeddings from a pretrained audio‑text model. It achieves a three‑way balance—high reconstruction quality, rich semantic latent structure, and fast inference—running three times faster than Stable Audio Open while matching or surpassing larger models in listening‑test quality and objective metrics. Across all nineteen latent‑semantics probing tasks, SAGE sets new state‑of‑the‑art performance both within and outside its training domain.

By Francesco Brigante, Luca Cerovaz, Davide Marincione, Giorgio Strano, Luca Zhou, Emanuele Rodol\`a, Michele Mancusi