arXiv Computation and Language By San Kim, JinYeong Bak

Evidence-Consistent Generative Detection under Scenario-Level Distribution Shift

Read the original on arXiv Computation and Language →

The paper introduces a new evaluation setting called scenario‑level out‑of‑distribution (SL‑OOD) detection for SMS and voice phishing, where entire attack scenarios are omitted from training while the label space stays fixed. It shows that high in‑distribution performance does not guarantee robustness to unseen scenarios, attributing this to scenario memorization. The authors propose ECoG, an evidence‑consistent generative framework that uses evidence‑span supervision and a rationale‑label consistency objective, achieving notable improvements in Macro‑F1, reduced prediction‑rationale inconsistency, and higher token‑level overlap with reference evidence.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Sep 10

CogniDir: Combating Cognitive Malicious Comments via Adaptive Distributional Learning for Robust Fake News Detection

CogniDir is an adaptive distributional learning framework designed to improve fake news detection against new psychologically grounded malicious comments generated by Large Language Models. It reframes robust detection as a dynamic data mixture optimization problem, using cognitive psychology to formalize adversarial paradigms and an information‑theoretic score to guide adaptive sampling of training data. Experiments on three benchmarks show that CogniDir achieves state‑of‑the‑art robustness, boosting F1 scores by up to 17.9% over existing baselines under heterogeneous AI‑generated attacks.

By Zhao Tong, Chunlin Gong, Yimeng Gu, Haichao Shi, Qiang Liu, Shu Wu, Xingcheng Xu, Xiao-Yu Zhang
arXiv AI
Sep 24

Beyond Unsafe Detection: Counterfactually Anchored Evidence Attribution for Multi-Turn LLM Safety Failures

The paper introduces a counterfactually anchored evidence attribution approach for multi‑turn large language model safety failures. It presents a new dataset of 1,762 conversations, including adversarial, benign twins, and high‑risk vocabulary variants, and trains a lightweight hierarchical model that accurately predicts safety violations and attributes them to specific user turns and token spans. The model achieves high detection performance (F1 = 0.988) and significantly reduces adversarial confidence when top‑attributed tokens are removed, while maintaining low false‑positive rates on benign conversations.

By Srinivasan Subramanian, Kazi Aminul Islam, Md. Abdullah Al Hafiz Khan
arXiv Computation and Language
Aug 31

Beyond Global Scalars: Synergizing Token-Level Statistics and Deep Semantics for Adversarial AIGC Text Detection

The paper introduces MOSAIC, a large adversarial benchmark for detecting AI-generated text, and presents NeuroStat, a new framework that combines token‑level probabilistic logits with deep semantic hidden states from a single language model. NeuroStat fuses these signals via Macro‑State Residual Modulation and uses orthogonal and contrastive losses to learn complementary representations. Experiments show that NeuroStat outperforms existing methods on MOSAIC, achieving superior robustness against adversarial attacks.

By Peiming Li, Yifan Wang, Zhiyuan Hu, Shiyu Li, Zheng Wei, Yang Tang
arXiv AI
Aug 24

Truth Lies Deep: Countering Semantic Camouflage via Latent Intent Verification

The paper identifies a vulnerability in large language models where harmful intent can be hidden within benign narratives, a phenomenon termed Semantic Camouflage. By examining latent activation patterns across several small language model families, the authors discover an "Intent Horizon"—a layer depth where harmful intent representations collapse. They propose Latent Intent Verification (LIV), a lightweight probing defense that detects harmful intent in early layers and outperforms existing guardrails on the PKU-SafeRLHF dataset.

By Md. Hasib Ur Rahman
arXiv Computation and Language
Oct 12

SharP: Soft and Hard Prompt-Guided Augmentation with LLM for Low Resource Fake News Detection

SharP is a text‑generation framework that uses both hard and soft prompts to guide large language models in creating task‑specific synthetic news samples for low‑resource fake news detection. The method combines structured factual constraints with learned semantic patterns, and employs a boundary‑aware strategy that focuses on classifier‑uncertain areas to refine decision boundaries. Dual objective optimization balances semantic alignment with source data and classifier feedback, aiming to improve robustness and generalization when labeled data are scarce.

By Ziyu Luo, Wei Li, Haoping Huang, Kecheng Liu, Min Gao