A Training-Free Proactive Defense Against Partial Speech Manipulation via Self-Embedding Steganography
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The paper introduces a training‑free proactive defense for detecting partial deepfake speech by using self‑embedding steganography. It embeds a compressed version of the clean audio within itself, allowing post‑hoc extraction of reference content and enabling detection of spoofed segments via codec‑based restoration. Experiments on a benchmark dataset show that this method complements passive detectors and operates without any training, offering a robust, data‑efficient alternative for partial deepfake detection.
Partial manipulation of speech recordings, where only localized segments of an utterance are altered, poses a significant challenge for content integrity verification, as reliable detection and locali...
arXiv:2608. 09593v1 Announce Type: cross Abstract: Recent advances in speech synthesis and audio generation have made high-fidelity acoustic forgery low-cost and difficult to attribute, enabling a realistic attack scenario in which speech and background audio are independently manipulated over otherwise authentic video.
CRAW is a codec‑robust audio watermarking framework designed to embed imperceptible signals into synthetic speech, enabling provenance verification. It improves robustness against neural re‑synthesis, codecs, denoisers, and vocoders while preserving perceptual quality through distortion‑aware training, attention‑based pooling, perceptual masking, and error‑correcting codes. Experiments show CRAW outperforms existing post‑hoc watermarking methods in robustness without compromising audio quality.
Audio watermarking aims to embed identifiable information into audio while remaining imperceptible. Existing methods adopt high-fidelity, low-energy designs to preserve perceptual quality, but the resulting watermarks lack robustness under suppression by speech reconstruction models.
The paper introduces CRAW, a codec‑robust audio watermarking framework designed to embed imperceptible signals into synthetic speech. CRAW enhances robustness against neural re‑synthesis, codecs, denoisers, and vocoders while preserving high perceptual quality through distortion‑aware training, attention‑based pooling, perceptual masking, and error‑correcting codes. Experiments show CRAW outperforms existing post‑hoc watermarking methods in robustness without compromising audio quality.