arXiv Machine Learning
HRTF Upsampling and Personalization via Neural Operators
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Jun 16
HRIR-Former: Grid-Free Time-Domain Reconstruction of Head-Related Impulse Responses with a Spatially Encoded Transformer
arXiv:2603. 27998v2 Announce Type: replace-cross Abstract: Individualized head-related impulse responses (HRIRs) enable binaural rendering, but dense per-listener measurements are costly.
arXiv AI
Jun 2
HRTFformer: A Spatially-Aware Transformer for Individual HRTF Upsampling in Immersive Audio Rendering
arXiv:2510. 01891v2 Announce Type: replace-cross Abstract: Individual Head-Related Transfer Functions (HRTFs) are starting to be introduced in many commercial immersive audio applications and are crucial for realistic spatial audio rendering.
arXiv Machine Learning
Oct 22
NeuroCodec: EEG-Guided Latent-Domain Generative Model for High-Fidelity Target Speaker Extraction
NeuroCodec is a novel generative framework that uses EEG signals to guide target speaker extraction in multi‑talker environments. It operates in the latent space of a neural audio codec, modeling EEG spatial dependencies with graph convolutions and fusing EEG and speech representations via attention and Mamba‑based temporal modeling. A six‑phase training curriculum and a causal streaming version enable high‑fidelity, 44.1 kHz audio reconstruction up to 20 kHz, outperforming baselines on Cocktail Party and KUL datasets and receiving higher perceptual scores in a listening test.
arXiv AI
Jul 8
Perceptually Aligning Representations of Music via Noise-Augmented Autoencoders
arXiv:2511. 05350v3 Announce Type: replace-cross Abstract: We argue that training autoencoders to reconstruct inputs from noised versions of their encodings, when combined with perceptually motivated losses, yields encodings that are structured according to a perceptual hierarchy.
arXiv AI
Sep 30
Long-Term Memory-Guided Enhancement for Target Perception in Audio-Language Models
arXiv:2609.36577v1 Announce Type: cross Abstract: Audio large language models (ALLMs) can reason about the content of audio recordings to perform complex tasks. However, these capabilities usually co...
arXiv Machine Learning
Oct 23
Muting Tokens: Exploring Token Sparsification for Efficient Audio Transformers
The paper investigates token sparsification for audio transformers, evaluating various pruning and merging methods across multiple datasets and model sizes. It introduces a new approach that blends attention scores with spectral cues from token embeddings, showing that frequency-aware techniques outperform attention-only methods. The study finds that spectrogram patch intensity-based sparsification is particularly effective for longer audio inputs, underscoring the benefit of incorporating frequency-domain information into sparsification strategies.