arXiv AI June 2, 2026 By Zijun Cui, Xiulong Liu, Hao Fang, Mingwei Xu, Jiageng Liu, Zexin Xu, Weiguo Pian, Shijian Deng, Feiyu Du, Chenming Ge, Yapeng Tian

Do Joint Audio-Video Generation Models Understand Physics?

Read the original on arXiv AI →

arXiv:2605. 07061v2 Announce Type: replace-cross Abstract: Joint audio-video generation models are rapidly approaching professional production quality, raising a central question: do they understand audio-visual physics, or merely generate plausible sounds and frames that violate real-world consistency?

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv AI.

arXiv AI

Jun 16

BRITE: A Benchmark for Reliable and Interpretable T2V Evaluation on Implausible Scenarios

arXiv:2605. 00873v2 Announce Type: replace-cross Abstract: The rapid advancement of photorealistic Text-to-Video (T2V) generation brings in an urgent need for up-to-date evaluation methods.

By Advait Tilak, Jiwon Choi, Nazifa Mouli, Wei Le

llms diffusion multimodal benchmarks safety

arXiv AI

Jul 14

BackgroundMellow: A Multi-Modal Cohesive Framework for Narrative-Driven Rich Cinematic Soundscape Generation

arXiv:2607. 11364v1 Announce Type: cross Abstract: Generating immersive, synchronized and cinematic audio for long-form textual narratives remains a significant challenge in multi-modal AI.

By Ajitesh Jamulkar, Aritra Hazra

agents diffusion nlp multimodal safety

arXiv AI

Jun 9

AVI-Bench: Toward Human-like Audio-Visual Intelligence of Omni-MLLMs

arXiv:2606. 07643v1 Announce Type: cross Abstract: Recent advances in Omni-Multimodal Large Language Models (Omni-MLLMs) have enabled strong integration of vision, audio, and language.

By Yaoting Wang, Ziyi Zhang, Wenming Tu, Shaoxuan Xu, Wenjie Du, Cheng Liang, Weijun Wang, Yuanchao Li, Guangyao Li, Hao Fei, Yuanchun Li, Henghui Ding, Yunxin Liu

llms multimodal benchmarks

arXiv AI

Aug 6

AudioScape-TTA: A Structured Soundscape Benchmark for Fine-Grained Text-to-Audio Evaluation

arXiv:2608. 04479v1 Announce Type: cross Abstract: Text-to-audio (TTA) generation has recently achieved remarkable progress in synthesizing realistic audio from natural language descriptions.

By Jinting Wang, Yuguang Yang, Shengyu Li, Yan Rong, Shan Yang, Xiaoda Yang, Li Liu

benchmarks safety

arXiv AI

Jul 21

RealDESED: A Real-World Domestic Sound Event Detection Benchmark

arXiv:2607. 16736v1 Announce Type: cross Abstract: This paper presents RealDESED, a real-world domestic sound event detection (SED) benchmark comprising 5,710 audio recordings collected by 652 participants in their homes.

By Florian Schmid, Paul Primus, Alexander Fichtinger, Tara Jadidi, Tobias Morocutti, Gerhard Widmer

llms benchmarks

arXiv AI

Jun 3

AVTrack: Audio-Visual Tracking in Human-centric Complex Scenes

arXiv:2606. 02724v1 Announce Type: cross Abstract: Audio-visual speaker tracking aims to localize and track active speakers by leveraging auditory and visual cues, enabling fine-grained, human-centric scene understanding.

By Yaoting Wang, Yun Zhou, Zipei Zhang, Henghui Ding

computer-vision multimodal benchmarks safety

Related stories

BRITE: A Benchmark for Reliable and Interpretable T2V Evaluation on Implausible Scenarios

BackgroundMellow: A Multi-Modal Cohesive Framework for Narrative-Driven Rich Cinematic Soundscape Generation

AVI-Bench: Toward Human-like Audio-Visual Intelligence of Omni-MLLMs

AudioScape-TTA: A Structured Soundscape Benchmark for Fine-Grained Text-to-Audio Evaluation

RealDESED: A Real-World Domestic Sound Event Detection Benchmark

AVTrack: Audio-Visual Tracking in Human-centric Complex Scenes