arXiv AI By Ali \c{S}enol, Garima Agrawal, Huan Liu

Joint Detection of Fraud and Concept Drift inOnline Conversations with LLM-Assisted Judgment

Read the original on arXiv AI →

The paper presents a two‑stage framework for detecting fraud in online conversations. First, an ensemble classifier flags suspicious dialogues, then a One Class Drift Detector isolates concept drift within those flagged exchanges. A large language model evaluates whether detected drift signals fraudulent manipulation or a legitimate topic shift, improving accuracy and interpretability compared to a Dual LLM baseline.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Sep 25

A Corpus of Real Scam- and Spam-Call Conversations from an Active Voice-Agent Honeypot

The paper introduces a dataset of 10,015 real scam and spam phone calls collected over 53 days using an active voice‑agent honeypot. Each call is recorded, transcribed, and automatically labeled, yielding 328,869 turn‑level transcripts and 895 hours of audio from 5,665 distinct numbers. The corpus distinguishes between predatory‑but‑legal lead generation and outright scams, with labels validated by human review and technical checks on realism.

By Ethan Traister, Dennis Tsang Ng, Siyu Zhang, Huaiyu Guo, Tommy Duong, Tyler Wu, Yuchen Zhou, Xingyu Shen, Jiaqi Wu, Simiao Ren
arXiv Computation and Language
Aug 24

Evidence-Consistent Generative Detection under Scenario-Level Distribution Shift

The paper introduces a new evaluation setting called scenario‑level out‑of‑distribution (SL‑OOD) detection for SMS and voice phishing, where entire attack scenarios are omitted from training while the label space stays fixed. It shows that high in‑distribution performance does not guarantee robustness to unseen scenarios, attributing this to scenario memorization. The authors propose ECoG, an evidence‑consistent generative framework that uses evidence‑span supervision and a rationale‑label consistency objective, achieving notable improvements in Macro‑F1, reduced prediction‑rationale inconsistency, and higher token‑level overlap with reference evidence.

By San Kim, JinYeong Bak
arXiv AI
Aug 6

Temporal Context Awareness: A Defense Framework Against Multi-turn Manipulation Attacks on Large Language Models

arXiv:2503. 15560v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly vulnerable to sophisticated multi-turn manipulation attacks, where adversaries strategically build context through seemingly benign conversational turns to circumvent safety measures and elicit harmful or unauthorized responses.

By Prashant Kulkarni, Assaf Namer
arXiv Machine Learning
Aug 26

Anatomy of a Scam Call: What 10,000 real scam and spam calls reveal about how phone scammers operate

The study analyzes 10,211 real scam and spam calls collected by an AI voice‑agent honeypot, revealing that scammers operate on a templated, office‑hour schedule and use disposable numbers to recycle scripts. Callers predominantly seek identity anchors such as home addresses and dates of birth, and the amount of conversation increases with the target’s age, though the requested information remains unchanged. Early detection is feasible, with escalation predictability reaching 0.87 ROC‑AUC by the eighth line using simple bag‑of‑words models.

By Ethan Traister, Ankit Raj, Jiaqi Gan, Xingyu Shen, Tyler Wu, Yuchen Zhou, Tommy Duong, Kidus Zewde, Siying Chen, Simiao Ren