arXiv AI
PhyAVBench: A Challenging Audio Physics-Sensitivity Benchmark for Physically Grounded Text-to-Audio-Video Generation
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Sep 7
PRISM-Bench: An Audio-Centric Diagnostic Benchmark for Text-to-Audio-Video Generation
PRISM‑Bench is an audio‑centric diagnostic benchmark for text‑to‑audio‑video generation, built from 900 human‑verified samples. It evaluates audio along two axes—audio type (speech, music, sound) and sound‑source visibility (on‑screen vs. off‑screen)—across four perceptual dimensions (audio‑visual coherence, audio quality, audio expressiveness, and prompt following) using 35 fine‑grained criteria. The benchmark employs an enhanced MLLM‑as‑a‑Judge protocol that aligns strongly with human raters, revealing a performance gap between frontier and open‑source T2AV models and highlighting overfitting to perceptual fidelity while struggling with complex grounding and control tasks, especially for music and synchronized on‑screen audio.
arXiv AI
Jun 2
Do Joint Audio-Video Generation Models Understand Physics?
arXiv:2605. 07061v2 Announce Type: replace-cross Abstract: Joint audio-video generation models are rapidly approaching professional production quality, raising a central question: do they understand audio-visual physics, or merely generate plausible sounds and frames that violate real-world consistency?
arXiv Computer Vision
6d ago
Semantic-Critical Regions for Video-to-Audio Generation
The paper introduces SCR-V2A, a video-to-audio generation framework that focuses on Semantic-Critical Regions (SCRs)—localized visual cues directly related to sound events. SCR-V2A first identifies these regions via sound-related visual localization, then encodes them with an adapter-based dual visual encoder to produce a control representation that captures both global context and fine-grained sound evidence. This representation conditions an audio generation model, and experiments on in-domain and out-of-domain benchmarks show improved distribution matching and audio quality with few trainable parameters.
arXiv AI
Sep 15
PIVOT: Physics-Grounded Verification for AI-Generated Audio-Video Detection
arXiv:2609.15562v1 Announce Type: cross Abstract: As generative models continue to advance, AI-generated content (AIGC) is becoming increasingly realistic, weakening the artifact cues commonly exploi...
arXiv AI
Jun 16
BRITE: A Benchmark for Reliable and Interpretable T2V Evaluation on Implausible Scenarios
arXiv:2605. 00873v2 Announce Type: replace-cross Abstract: The rapid advancement of photorealistic Text-to-Video (T2V) generation brings in an urgent need for up-to-date evaluation methods.
arXiv AI
Aug 6
AudioScape-TTA: A Structured Soundscape Benchmark for Fine-Grained Text-to-Audio Evaluation
arXiv:2608. 04479v1 Announce Type: cross Abstract: Text-to-audio (TTA) generation has recently achieved remarkable progress in synthesizing realistic audio from natural language descriptions.