DeepMind Blog

Advancing Private AI Compute with secure, server-side memory

DeepMind introduces private, server‑side memory to its Private AI Compute platform, enabling personal AI applications to operate with secure, isolated memory on the server side. This enhancement focuses on protecting user data while allowing AI models to run efficiently in a private environment. The update expands the capabilities of Private AI Compute by adding a new layer of security and privacy for personal AI use cases.

OpenAI Blog
May 16, 2018

AI and compute

We’re releasing an analysis showing that since 2012, the amount of compute used in the largest AI training runs has been increasing exponentially with a 3. 4-month doubling time (by comparison, Moore’s Law had a 2-year doubling period)[^footnote-correction].

arXiv Machine Learning
Sep 14

AIM: A Privacy-Aware Interoperable Memory Framework for Multi-Agent Multi-User LLM Systems

The paper introduces AIM, a privacy‑aware memory framework that lets multi‑agent, multi‑user large language models manage both private and shared memory. AIM classifies data as private (user‑specific) or public (shared) and enforces index‑level access controls to protect sensitive information while enabling shared knowledge to improve coordination. The authors also present MUMBench, a new dataset for evaluating memory operations in multi‑user settings, and report high accuracy metrics for AIM on this benchmark.

By Zachary Johnson, Nigel Boachie Kumankumah, Somya Chatterjee, Tejas Sathyamurthi, Min Chen, Xinyi Alice Li, Xiao Wang, Emily Morgan Gelchie, Jessica Lin, Sadid A. Hasan, Sulaiman Vesal
arXiv AI
Sep 15

SpliTEE: Improving LLM Inference on Trusted Hardware with Differentially Private GPU Outsourcing

SpliTEE extends the split‑inference architecture of Slalom to large language models by protecting intermediate GPU computations with differential privacy rather than encryption. The authors show that masking intermediate representations is essential, as a prompt‑reconstruction attack can recover prompts with about 80% accuracy. Their global sensitivity analysis bounds the noise needed, and they demonstrate that SpliTEE on Intel TDX achieves near‑double the speed of fully CPU‑based inference and outperforms encryption‑based Slalom while maintaining higher accuracy.

By Shashie Dilhara Batan Arachchige, Robin Carpentier, Hassan Jameel Asghar, Dali Kaafar
arXiv AI
Jun 2

Agyn: An Open-Source Platform for AI Agents with Scalable On-Demand Execution, Agent Definition as a Code, and Zero-Trust Access

arXiv:2605. 27575v2 Announce Type: replace Abstract: As organizations move toward production deployments of AI agents, which execute non-deterministic workflows, maintain stateful sessions, and often operate with privileged access to internal services, the engineering challenge shifts from building individual agents to operating them at scale with proper isolation, governance, and security.

By Nikita Benkovich, Vitalii Valkov
arXiv AI
Jul 9

Security and Privacy in Agentic AI: Grand Challenges and Future Directions

arXiv:2607. 06608v1 Announce Type: cross Abstract: We present key challenges and future research directions in the security and privacy of agentic AI, based on a horizon-scanning exercise that brought together thirty leading international experts from academia, industry, and government to engage in focused discussions and collaborative exercises on the emerging risks associated with the growing agency of AI.

By Adam Jenkins, Agnieszka Kitkowska, Caterina Maidhof, Diego Paracuellos, Francesco Sovrano, Gonzalo Gabriel Mendez, Guillermo Suarez-Tangil, Hana Kopecka, Isabel Wagner, Isabel Barbera, Javier Carnerero-Cano, Jide Edu, Jose Luis Martin-Navarro, Jose Such, Josep Domingo-Ferrer, Juan Carlos Carrillo, Kopo Marvin Ramokapane, Mark Cote, Pablo Vellosillo, Ramon Ruiz-Dolz, Rongjun Ma, Ruba Abu-Salma, Sameer Patil, William Seymour, Xiao Zhan
Import AI
Aug 24

Import AI 470: No rights for machines; automating environment generation with SPADE; and building better GPU kernels with Hawkeye

The article discusses several recent developments in AI and computing, including the lack of legal rights for machines, the use of SPADE to automate environment generation, and the creation of improved GPU kernels with Hawkeye. It also touches on the differential acceleration of cyber, math, and AI technologies. These topics illustrate ongoing progress in AI infrastructure and performance optimization.

By Jack Clark
arXiv Machine Learning
Jun 5

Advanced AI Service Provisioning in O-RAN through LLM Engine Integration

arXiv:2605. 23809v2 Announce Type: replace-cross Abstract: The Open Radio Access Network (O-RAN) architecture allows AI to be embedded directly into the RAN through modular xApps and rApps, yet creating these applications collecting data, training models, writing code, and deploying them safely remains slow and largely manual.

By Seyed Bagher Hashemi Natanzi, Pranshav Gajjar, Bo Tang, Vijay K. Shah