arXiv Computation and Language

TeleAntiFraud 2.0: A Refreshable, Profile-Grounded, and Audio-Based Benchmark for Telecom Fraud Detection

TeleAntiFraud 2.0 is a monthly‑frozen, audio‑based benchmark for telecom fraud detection that incorporates newly observed scam patterns while preserving earlier test sets. It uses a Mixed‑Tree Anti‑Fraud Generation Pipeline to create profile‑grounded scenarios, expands them into mixed‑tree dialogues, and renders validated speech for 900 Chinese calls (600 fraud, 300 near‑domain non‑fraud) each month. Experiments show that classifiers perform well against unrelated negatives but drop significantly against near‑domain negatives, highlighting the need for near‑domain construction and collapse‑aware reporting in realistic evaluation settings.

arXiv Computation and Language
1d ago

Before the Warning Comes Too Late: Incremental Phone-Scam Detection from Speech

The paper introduces StreamFraudNet, a weakly supervised model that detects phone scams from raw telephone audio in an incremental fashion. It processes audio through overlapping windows with a frozen self‑supervised encoder, uses recurrent temporal modeling, and aggregates window scores to update predictions every two seconds. On an English benchmark, the model achieves a ROC‑AUC of 0.9953, outperforming baselines while producing its first prediction after 10 seconds and running faster than real time.

By Khang Nhat Hoang Vo, Anh Trac Duc Dinh, Tai Tien Ta, Tho Quan
arXiv Computation and Language
2d ago

FRAUDSkill: Structured Frozen-Weight Skill Optimization for Audio Anti-Fraud Detection

FRAUDSkill is a structured frozen‑weight adaptation framework for audio anti‑fraud detection that keeps the underlying audio‑language model unchanged while optimizing external skill programs, route‑specific policies, and decision rules. It combines structured output control with validation‑guided multi‑path inference to produce protocol‑compliant predictions. On the TeleAntiFraud benchmark, FRAUDSkill achieves a 73.50% Macro‑F1 score, outperforming the shared frozen‑model baseline by 31.96% and reducing invalid outputs to 1.94%.

By Chengxian Hu, Zhiming Ma, Mingjun Pan, Yifan Wang, Shun Zhang, Qifan Wang, Zhilei Zhao, Yijin Zhou, Yuxi Zhao, Huiyuan Liu, Peidong Wang, Peng Chen
arXiv Machine Learning
Aug 26

Anatomy of a Scam Call: What 10,000 real scam and spam calls reveal about how phone scammers operate

The study analyzes 10,211 real scam and spam calls collected by an AI voice‑agent honeypot, revealing that scammers operate on a templated, office‑hour schedule and use disposable numbers to recycle scripts. Callers predominantly seek identity anchors such as home addresses and dates of birth, and the amount of conversation increases with the target’s age, though the requested information remains unchanged. Early detection is feasible, with escalation predictability reaching 0.87 ROC‑AUC by the eighth line using simple bag‑of‑words models.

By Ethan Traister, Ankit Raj, Jiaqi Gan, Xingyu Shen, Tyler Wu, Yuchen Zhou, Tommy Duong, Kidus Zewde, Siying Chen, Simiao Ren
arXiv AI
Sep 2

Incremental Risk Assessment of Progressive Elder Financial Scams via Instruction-Tuned Small Language Models

The paper presents a cumulative turn‑based risk assessment framework for detecting financial scams targeting older adults, which aggregates conversational turns and updates risk estimates at each step. A multi‑turn dialogue dataset covering investment, charity, and tech support scams is created, with annotations for risk level, score, rationale, and safety recommendation at every cumulative stage. Four small language models (Phi‑4, LLaMA‑3.2, DeepSeek‑R1, Qwen3) are fine‑tuned; Phi‑4 and LLaMA‑3.2 outperform others in turn‑aware risk estimation, demonstrating that compact models can effectively support incremental scam detection in resource‑constrained, privacy‑aware deployments.

By Parviz Ghafariasl, Weimin Fu, Xiaolong Guo, Shing I. Chang
arXiv Computation and Language
Aug 24

Evidence-Consistent Generative Detection under Scenario-Level Distribution Shift

The paper introduces a new evaluation setting called scenario‑level out‑of‑distribution (SL‑OOD) detection for SMS and voice phishing, where entire attack scenarios are omitted from training while the label space stays fixed. It shows that high in‑distribution performance does not guarantee robustness to unseen scenarios, attributing this to scenario memorization. The authors propose ECoG, an evidence‑consistent generative framework that uses evidence‑span supervision and a rationale‑label consistency objective, achieving notable improvements in Macro‑F1, reduced prediction‑rationale inconsistency, and higher token‑level overlap with reference evidence.

By San Kim, JinYeong Bak
arXiv Computation and Language
Sep 7

Auditing Bias and Safety in Voice AI Customer Care

The paper introduces a validation‑gated audit framework for voice AI customer‑care systems, treating them as stateful, multi‑turn, tool‑mediated interactions where bias and safety can manifest as added burdens before a final decision. The framework distinguishes between native speech‑to‑speech, cascaded ASR‑to‑LM‑to‑TTS, and hybrid architectures, and applies matched service facts across controlled caller presentation conditions to validate fact invariance, presentation cues, artifacts, and acoustic measurements. It outlines seven validation gates, a six‑family metric set, and demonstrates the approach with a synthetic refund‑dispute audit example, while noting that production results are withheld until the protocol is satisfied.

By Vignesh Ethiraj, Ashwath David