arXiv Machine Learning

MAVOS-DD: Multilingual Audio-Video Open-Set Deepfake Detection Benchmark

arXiv:2505. 11109v2 Announce Type: replace-cross Abstract: We present the first large-scale open-set benchmark for multilingual audio-video deepfake detection.

arXiv AI
Jun 29

Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook

arXiv:2411. 19537v2 Announce Type: replace-cross Abstract: We survey deepfake generation and detection techniques, covering all deepfake media types: image, video, audio and multimodal content.

By Florinel-Alin Croitoru, Andrei-Iulian Hiji, Vlad Hondru, Nicolae Catalin Ristea, Paul Irofti, Marius Popescu, Cristian Rusu, Radu Tudor Ionescu, Fahad Shahbaz Khan, Mubarak Shah
arXiv Computer Vision
Oct 9

BabelFake: A Multilingual Audio-Visual DeepFake Benchmark

BabelFake is a multilingual audio‑visual DeepFake benchmark featuring 399,000 clips from 496 consenting participants across five languages (English, German, Italian, French, Spanish). The dataset pairs 11 modern video manipulation methods with 4 voice‑cloning engines, covering both visual‑only and joint audio‑visual attacks. Experiments show that detection difficulty varies with the audio‑visual pairing, with significant performance drops when authentic audio is retained, and that cross‑language and demographic factors influence detector performance.

By Carlotta Segna, Joel Tschesche, Anna Rohrbach
arXiv AI
Jun 4

DetectZoo: A Unified Toolkit for AI-Generated Content Detection Across Text, Audio, and Image Modalities

arXiv:2606. 04205v1 Announce Type: cross Abstract: The growing popularity and capacity of generative models have eroded the distinction between human and machine-generated content, motivating a growing body of work on detection across text, images, and audio.

By Sajad Ebrahimi, Nima Jamali, Bardia Shirsalimian, Kelly McConvey, Wentao Zhang, Jalehsadat Mahdavimoghaddam, Maksym Taranukhin, Maura Grossman, Vered Shwartz, Yuntian Deng, Ebrahim Bagheri
arXiv Computation and Language
3d ago

Omnilingual-MsASR: Benchmarking Multimodal, Multilingual, Long-Form Multi-Speaker ASR of Omni Large Language Models

arXiv:2610.29455v1 Announce Type: new Abstract: Omni-modal large language models (LLMs) have achieved remarkable progress in audio and video understanding. However, existing models struggle with long...

By Yuan Ge, Pei Zhang, Xize Cheng, Lingzhou Mu, Mingyang Wang, Jin Xu, Baosong Yang, Shengxiang Gao, Jingbo Zhu, Zhengtao Yu, Tong Xiao
arXiv Computer Vision
Oct 7

Scaling Laws for Deepfake Detection

arXiv:2510.16320v2 Announce Type: replace Abstract: This paper presents a systematic study of scaling laws for the deepfake detection task. Specifically, we analyze the model performance against the...

By Wenhao Wang, Jusheng Zhang, Longqi Cai, Taihong Xiao, Yuxiao Wang, Ming-Hsuan Yang
arXiv AI
Oct 2

SONIC-O1: A Real-World Benchmark for Evaluating Multimodal Large Language Models on Audio-Video Understanding

SONIC‑O1 is a new benchmark designed to evaluate multimodal large language models on audio‑video understanding. It contains 60 hours of 231 clips across 13 real‑world conversational domains, with 4,958 human‑verified annotations and demographic metadata. The benchmark tests open‑ended summarization, multiple‑choice question answering, and temporally grounded reasoning, revealing performance gaps between model families and across demographic groups.

By Ahmed Y. Radwan, Christos Emmanouilidis, Hina Tabassum, Deval Pandya, Shaina Raza