arXiv Computation and Language

WaveScat: Wavelet Scattering Front-Ends with Self-Supervised Features for Speech Deepfake Detection

WaveScat introduces a new family of feature extractors for speech deepfake detection that merges wavelet scattering transform (WST) with self‑supervised learning. By cascading wavelet convolutions with modulus nonlinearities, WaveScat produces deformation‑stable, multi‑scale features that capture both low‑level spectral details and higher‑level information. Experiments on Deepfake‑Eval‑2024 and cross‑dataset tests (SpoofCeleb, In‑the‑Wild, ASVspoof 5) demonstrate that WaveScat significantly outperforms existing front‑ends, with a small averaging scale and high‑frequency directional resolution proving crucial for detecting subtle artifacts.

arXiv AI
Sep 25

WST-Graph: Topology-Preserving Wavelet Scattering Front-End for Speech Deepfake Detection

The paper introduces WST-Graph, a topology-preserving wavelet scattering front-end designed for speech deepfake detection. It reconstructs wavelet scattering paths into a sparse modulation‑carrier grid that feeds an AASIST graph backend, employing modulation‑level normalization and adaptive local attention pooling to produce fixed relative‑time representations while keeping acoustic axes intact. The resulting waveform‑to‑graph interface uses about 60% fewer trainable parameters than AASIST yet remains competitive, showing clear improvements on selected out‑of‑domain benchmarks.

By Kwok-Ho Ng, Tingting Song, Bingwen Feng, Zhihua Xia
arXiv AI
Sep 10

AudioFuse: Unified Spectral-Temporal Learning via a Hybrid ViT-1D CNN Architecture for Robust Phonocardiogram Classification

AudioFuse is a hybrid architecture that jointly learns from spectrograms and raw waveforms to classify phonocardiograms. It combines a wide-and-shallow Vision Transformer for spectral features with a shallow 1D CNN for temporal waveforms, reducing overfitting while capturing complementary information. On the PhysioNet 2016 dataset, AudioFuse achieves a state‑of‑the‑art ROC‑AUC of 0.8608 and shows superior robustness to domain shift on the PASCAL dataset, outperforming both spectrogram‑only and waveform‑only baselines.

By Md. Saiful Bari Siddiqui, Utsab Saha
arXiv AI
Aug 11

MADBench: A Benchmark for Modality-Aware Audio Deepfake Detection

arXiv:2608. 09593v1 Announce Type: cross Abstract: Recent advances in speech synthesis and audio generation have made high-fidelity acoustic forgery low-cost and difficult to attribute, enabling a realistic attack scenario in which speech and background audio are independently manipulated over otherwise authentic video.

By Yanqiu Li, Yang Xiao, Jisheng Bai, Bin Chen, Hong Jia, Ting Dang
arXiv AI
Aug 17

Teffic-Audio: Tell Fact from Fiction

arXiv:2607. 28351v2 Announce Type: replace-cross Abstract: Speech deepfake detection has expanded in scope with increasingly heterogeneous spoofing mechanisms, including speech synthesis, voice conversion, vocoder reconstruction, and neural-codec resynthesis.

By Wan Lin, Li Wang, Jindong Wang, Kunyu Feng, Zhizheng Wu
arXiv AI
Jun 10

What Do Deepfake Speech Detectors Actually Hear?

arXiv:2606. 10912v1 Announce Type: cross Abstract: Deepfake speech detectors often output a single score without explaining why an audio sample is flagged, where in the signal the evidence lies, or what cues drive the decision.

By Vojt\v{e}ch Stan\v{e}k, Veronika Jirmusov\'a, Anton Firc, Kamil Malinka, Jakub Re\v{s}, Martin Pere\v{s}\'ini
arXiv AI
Jun 10

Linguistically Augmented Audio Speech Data (LinguAS)

arXiv:2606. 10246v1 Announce Type: cross Abstract: Maliciously-created fake speech, including deepfaked and spoofed audio, is proliferating at an alarming rate, and detection models are racing to stay ahead of the curve.

By Ashley R. Keaton, Zahra Khanjani, Christine Mallinson, Vandana P. Janeja