arXiv AI

Do Compact SSL Backbones Matter for Audio Deepfake Detection? A Controlled Study with RAPTOR

arXiv AI
Sep 18

CoRELoop: Parameter-Efficient Controlled Recurrent Refinement for Audio Deepfake Detection

CoRELoop introduces a parameter‑efficient refinement framework for audio deepfake detection that operates on a pre‑trained SSL‑based detector without altering its original parameters. By adapting recurrent inputs, controlling state updates, and aligning refined outputs with the frozen classifier, CoRELoop adds lightweight refinement modules and low‑rank adapters, achieving a pooled equal error rate reduction from 4.85% to 3.74% on 14 cross‑domain test sets with only about 10 M trainable parameters. An optional halting head further optimizes performance, reaching 3.73% pooled EER with an average of 1.18 passes.

By Kunyu Feng, Yuxiang Wang, Li Wang, Wan Lin, Zhizheng Wu
arXiv AI
Sep 21

CoReLoop: Parameter-Efficient Controlled Recurrent Refinement for Audio Deepfake Detection

CoReLoop introduces a parameter‑efficient refinement strategy for audio deepfake detection that reuses a frozen SSL‑based detector’s encoder outputs without altering its original parameters. By adapting recurrent inputs, controlling state updates, and aligning refined outputs with the frozen classifier, the method adds lightweight refinement modules and low‑rank adapters trained on the original data. On 14 cross‑domain test sets, the 24‑layer model reduces pooled equal error rate from 4.85% to 3.74% with two passes, and an optional halting head further improves performance to 3.73% with an average of 1.18 passes.

By Kunyu Feng, Yuxiang Wang, Li Wang, Wan Lin, Zhizheng Wu
arXiv AI
Oct 1

UniAE-MoE: A Unified Audio Encoder via Mixture of Experts

UniAE-MoE is a unified audio encoder that uses a Mixture-of-Experts architecture to model cross‑domain audio representations. It integrates encoder components from Qwen2‑Audio and Audio‑Flamingo 3, enhances them with SwiGLU and shared experts, and applies a two‑stage instruction‑tuning strategy along with task‑specific data scaling. The model achieves state‑of‑the‑art results on the XARES‑LLM benchmark (0.802) and tops the Interspeech 2026 Audio Encoder Capability Challenge, demonstrating strong generalization across speech, music, and general audio tasks.

By Shengbo Cai, Zhisheng Zhang, Zichao Nie, Jing Peng, Jingran Xie, Zhiyong Wu