arXiv Machine Learning
Feature Encoding in VAE-based Audio Decoders: Effects of Input, Depth and Distribution
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
Hugging Face Trending Papers
Oct 6
Feature Encoding in VAE-based Audio Decoders: Effects of Input, Depth and Distribution
Neural audio synthesis models like the Realtime Audio Variational autoEncoder (RAVE) achieve impressive genera tion quality, yet how their internal representations encode musical features remains poor...
arXiv AI
Jul 14
Encoder-Side Neuron Identification and Amplification for Acoustic Perception in Large Audio-Language Models
arXiv:2607. 11801v1 Announce Type: cross Abstract: Large audio-language models (LALMs) often underperform on fine-grained, non-semantic attributes of speech, such as a speaker's emotion, despite strong performance on speech content.
arXiv Machine Learning
Jul 10
Structural Bottlenecks on Frequency Representation in End-to-End Audio Models
arXiv:2607. 08545v1 Announce Type: cross Abstract: End-to-end neural audio models achieve high-fidelity compression and generation.
arXiv AI
Aug 11
Topographic Constraints Shape Brain-Like Component Structure in Auditory Models
arXiv:2509. 24039v2 Announce Type: replace-cross Abstract: If topography is a fundamental feature of the brain, it should influence both how neurons are arranged in space (i.
arXiv AI
Jul 7
Probing Low-Level Acoustic Attribute Encoding in CLAP Audio Embeddings
arXiv:2607. 03806v1 Announce Type: cross Abstract: Audio foundation models are widely adopted as general-purpose feature extractors, yet the internal structure of their learned representations remains insufficiently understood.
arXiv AI
Sep 2
Heard but Not Heeded: Paralinguistic Information Encoding and Loss in Audio-Language Models
The paper investigates whether audio‑language models capture paralinguistic cues beyond spoken content. Using the Expresso dataset and four open‑source models, the authors trace how speaking style information is encoded in the late layers of the audio encoder but is degraded before reaching the final output. They find that some models are content‑driven while others are acoustic‑driven, revealing a gap between what is encoded and what is utilized in current audio‑language models.