arXiv:2610.07966v1 Announce Type: cross Abstract: Neural audio synthesis models like the Realtime Audio Variational autoEncoder (RAVE) achieve impressive genera tion quality, yet how their internal r...
arXiv:2607. 08545v1 Announce Type: cross Abstract: End-to-end neural audio models achieve high-fidelity compression and generation.
arXiv:2607. 11801v1 Announce Type: cross Abstract: Large audio-language models (LALMs) often underperform on fine-grained, non-semantic attributes of speech, such as a speaker's emotion, despite strong performance on speech content.
arXiv:2509. 24039v2 Announce Type: replace-cross Abstract: If topography is a fundamental feature of the brain, it should influence both how neurons are arranged in space (i.
arXiv:2607. 03806v1 Announce Type: cross Abstract: Audio foundation models are widely adopted as general-purpose feature extractors, yet the internal structure of their learned representations remains insufficiently understood.
The paper investigates whether audio‑language models capture paralinguistic cues beyond spoken content. Using the Expresso dataset and four open‑source models, the authors trace how speaking style information is encoded in the late layers of the audio encoder but is degraded before reaching the final output. They find that some models are content‑driven while others are acoustic‑driven, revealing a gap between what is encoded and what is utilized in current audio‑language models.
SAGE, a 105‑million‑parameter semantic audio generative encoder, compresses music waveforms into compact latent representations by distilling embeddings from a pretrained audio‑text model. It achieves a three‑way balance—high reconstruction quality, rich semantic latent structure, and fast inference—running three times faster than Stable Audio Open while matching or surpassing larger models in listening‑test quality and objective metrics. Across all nineteen latent‑semantics probing tasks, SAGE sets new state‑of‑the‑art performance both within and outside its training domain.
PitchFlower is a flow‑based neural audio codec that offers explicit pitch controllability by flattening and randomly shifting F0 contours during training while conditioning on the true F0 to reconstruct the original audio. A vector‑quantization bottleneck blocks pitch recovery, and a flow‑based decoder produces high‑quality audio. Experiments demonstrate that PitchFlower matches DSP baselines in pitch accuracy, surpasses state‑of‑the‑art neural codecs in audio quality, and remains robust even when trained on WORLD‑transformed audio, effectively removing vocoder artifacts.
arXiv:2608. 03742v1 Announce Type: cross Abstract: Sound effects play a crucial role in conveying actions, events, and environmental cues across digital applications, often requiring a high degree of variation and contextual adaptability.
Synth-JEPA introduces a renderer‑free approach to synthesizer parameter search by learning mutually predictive audio and parameter representations from paired synthesizer data. During inference, candidate parameters are scored directly in this learned space, avoiding the need to render each candidate and shaping audio geometry through parameter correspondences. Evaluations on Surge XT and out‑of‑domain datasets show Synth‑JEPA outperforms inverse models, direct search, and learned proxy objectives, with listeners preferring its matches in 85% of pairwise tests.
arXiv:2511. 05350v3 Announce Type: replace-cross Abstract: We argue that training autoencoders to reconstruct inputs from noised versions of their encodings, when combined with perceptually motivated losses, yields encodings that are structured according to a perceptual hierarchy.
arXiv:2608. 04378v1 Announce Type: cross Abstract: Collaborative music agents need internal representations rich enough to support both understanding and generation, yet flexible enough for a workflow where the human retains agency.