DeepMind Blog

Google DeepMind and Singapore Government collaborate to build fine-tuned AI model for scam detection

Google DeepMind and GovTech Singapore are partnering to develop a fine‑tuned AI model that uses lightweight on‑device Gemma models to detect conversational scams in private chats. The system intercepts scam attempts without sending any data to the cloud, ensuring zero data egress. This collaboration aims to protect users from scams while preserving privacy.

arXiv Computation and Language
Oct 9

Black-Box Forensics for Conversational LLM Agents

The paper presents methods for black-box forensic analysis of conversational large language model (LLM) agents, focusing on two tasks: attribution—identifying the base model powering a chatbot—and fingerprinting—detecting identical system prompts across different endpoints. Attribution classifiers achieve 98% accuracy using only a few non‑adversarial conversation turns, while a cross‑encoder fingerprinting approach attains an AUC of 0.768 and an F1 of 0.703 on unseen prompts, improving to 0.943 AUC when aggregating 50 interactions. These techniques enable investigators to trace AI‑enabled scams back to their underlying models and link related scams through shared system prompts.

By Isadora White, Yasaman Jafari, Taylor Berg-Kirkpatrick