AudioWorldSim: Realistic Binaural Audio Datasets For World Models

BinauralVAE: Spatial Audio Reconstruction For World Models

BinauralVAE is an open‑source pipeline that reconstructs spatial audio using various Variational Autoencoder architectures, including complex‑valued variants, to learn latent representations of binaural signals. The project builds on realistic acoustic data from a simulated robot navigating an environment, providing a foundation for audio‑centric world models. It aims to map the causal link between navigational actions and their acoustic outcomes, positioning sound as a complementary modality for spatial awareness.

SsgCaps: A controlled dataset for the evaluation of sound scene generation algorithms

SsgCaps is a publicly available dataset of human-engineered sound scenes, each paired with a precisely structured prompt that guides the sampling process. The prompts are drawn from a predefined action-based typology, enabling extensive yet plausible sampling. A comparative quantitative analysis shows only small differences between the open and private versions, supporting the recommendation of the open version for benchmarking sound scene generation algorithms.

Audible World Models: Spatially Aware Sound Generation for 3D Worlds

arXiv:2609.38444v1 Announce Type: new Abstract: Text- and image-conditioned world generators can create visually rich 3D environments, yet these worlds often remain silent or rely on soundtracks synt...

Supervising Sound Localization by In-the-wild Egomotion

The paper introduces a method for learning binaural sound localization by using egomotion as a supervisory signal. By tracking how a camera’s direction changes relative to a sound source during a video, the authors train an audio model to predict sound directions that align with visual estimates of camera motion derived from multi‑view geometry. They evaluate this approach on a newly proposed dataset of real‑world audio‑visual videos with egomotion, demonstrating that the model can learn from real data and perform well on sound localization tasks.

Explicit Context-Driven Neural Acoustic Modeling for High-Fidelity RIR Generation

arXiv:2509. 15210v2 Announce Type: replace-cross Abstract: Realistic sound simulation plays a critical role in many applications.

A Complete Guide to Audio Datasets

WorldSonus: Bringing Sound to Worlds

arXiv:2610.08760v1 Announce Type: cross Abstract: Recent advances in world models have enabled increasingly realistic visual synthesis. However, these generated environments remain largely silent. Br...

SonicWorld: Source-Centric Latent Dynamics for Spatial Audio Reasoning

arXiv:2610.17131v2 Announce Type: cross Abstract: Dynamic spatial audio reasoning requires a model to associate changing acoustic observations with the correct source and recover its spatial state at...

TORUS: A Unified Closed-Loop Benchmark for Unified Audio Models

The paper introduces TORUS, a closed‑loop benchmark designed to evaluate unified audio models on their ability to understand the audio they generate or edit. TORUS contains 1,053 questions across 21 tasks and 8 audio domain settings, covering all three audio types. The authors evaluate both unified models and cascades of specialized models, finding that the best unified models answer only about 52.4% of questions about their own outputs, while GPT‑Audio achieves 53.6%.

SynSFX: Multi-Model Sound Effects Synthesis Dataset for Deepfake Detection and Evaluation

arXiv:2607. 04848v1 Announce Type: cross Abstract: While audio deepfake detection has advanced significantly, representative detectors show limited generalization to synthetic sound effects.

CoarseSoundNet: Building a reliable model for ecological soundscape analysis

CoarseSoundNet is a deep learning framework designed to classify ecological soundscapes into biophony, geophony, and anthropophony under realistic passive acoustic monitoring conditions. The study systematically explores model architectures, training data composition, and evaluation strategies, finding that adding more domain‑similar data, a silence class, and post‑hoc calibration improves performance. An ecological case study shows that pre‑filtering recordings with CoarseSoundNet produces acoustic index trends similar to ground‑truth filtering, though the impact on avian alpha‑diversity relationships is modest.

RealDESED: A Real-World Domestic Sound Event Detection Benchmark

arXiv:2607. 16736v1 Announce Type: cross Abstract: This paper presents RealDESED, a real-world domestic sound event detection (SED) benchmark comprising 5,710 audio recordings collected by 652 participants in their homes.