arXiv AI

Where Does the Audio Jailbreak Live? A Controlled Frequency-Depth Audit of AdvWave-P on Qwen2-Audio

The study audits the frequency and decoder‑depth claims of the audio jailbreak AdvWave‑P on the Qwen2‑Audio model. Using a protocol that masks frequency components in the short‑time Fourier transform domain, the authors evaluate attack success across 520 prompts, finding that 76.7% of adversarial inputs are labeled as jailbreaks. Detailed analyses show that masking specific frequency bands can sharply reduce attack success, with finer 16‑band partitions revealing that a narrow 7520‑7960 Hz band is critical, while global rescaling and re‑optimization experiments further illuminate the role of frequency partitioning and energy distribution in jailbreak effectiveness.

arXiv Machine Learning
Sep 10

Clean Accuracy Does Not Guarantee Provenance Robustness: A Prospective Codec-Stress Evaluation of Audio Attribution

The study evaluates audio provenance attribution systems, showing that high clean‑benchmark accuracy does not translate to robustness after codec compression. Using a prospectively registered protocol, the authors measured closed‑set attribution performance on two corpora after single‑stage codec transport, finding significant degradation—up to 70.3 Macro‑F1 points for WavLM‑Base+ and 61.0 for W2V2‑BERT 2.0—depending on codec settings and representation. The results demonstrate that clean accuracy alone cannot guarantee deployment robustness across different codecs and representations.

By Gang Shi (Independent Researcher)
arXiv AI
Oct 12

Does Location Matter? A Black-Box Causal Audit Reveals Model-Dependent Audio Grounding in LALM Hallucination

The paper investigates how large audio‑language models (LALMs) hallucinate objects by affirming sounds that are not present. Using a black‑box causal test, the authors isolate and remove the claimed evidence region via spectral gating and compare the effect against a random‑window control across a 2×2×2 grid on three LALMs. The study finds that localization of evidence improves detection over random removal, that raw detection values are model‑dependent, and that contrastive decoding combining blank and language‑prior contrasts can significantly boost accuracy, but a unified causal‑grounding profile does not transfer between models.

By Mohammad Khalooei, Mohammad Sabokrou
Hugging Face Trending Papers
Oct 9

Does Location Matter? A Black-Box Causal Audit Reveals Model-Dependent Audio Grounding in LALM Hallucination

The paper investigates how large audio‑language models (LALMs) hallucinate objects by affirming sounds that are not present. Using a black‑box causal test, the authors isolate evidence regions via CLAP similarity, remove them with spectral gating, and compare against random windows across a 2×2×2 grid on three LALMs. The study finds that evidence localization improves detection over random removal, that raw detection scores are model‑dependent, and that a contrastive decoding strategy combining blank and language‑prior cues boosts Qwen2‑Audio accuracy from 57.1 % to 71.9 %, outperforming Audio‑Aware Decoding alone.

arXiv Machine Learning
Sep 1

Data Diversity, Not Frequency Invariance: A Controlled and Self-Audited Study of Compression-Robust Deepfake Detection

The study challenges the prevailing belief that frequency-based features and compression-invariant learning are essential for robust deepfake detection. Using a controlled, pre‑registered protocol, a simple EfficientNet‑B0 trained on diverse multi‑quality data outperformed the more complex CAFRL model across all compression levels, with a 3.66 AUC point advantage at CRF 40. After identifying and correcting four experimental defects, the authors found that frequency features added no marginal benefit, while data diversity—particularly real constant‑rate‑factor variants—proved to be the key factor for robustness against H.264 re‑encoding.

By Abbas Aliyev, Samir Rustamov
arXiv Machine Learning
Oct 9

Controlled Acquisition and Abstention in Three-Channel Score Conflicts

The paper introduces a controlled benchmark for deciding whether to acquire a third modality or abstain when audio, video, and text scores conflict. A threshold policy that observes two signed scores can request the third at a cost and abstain, achieving higher targeted decision accuracy and utility than always-answer fusion under certain reward settings. Experiments on synthetic and real data show that the policy’s advantage depends on the ambiguity mechanism, budget constraints, and the ranking of observed pairs, highlighting the trade‑off between full-modality accuracy and pre‑request selection value.

By Mengzhe Geng