arXiv AI September 15, 2026 By Shashie Dilhara Batan Arachchige, Robin Carpentier, Hassan Jameel Asghar, Dali Kaafar

SpliTEE: Improving LLM Inference on Trusted Hardware with Differentially Private GPU Outsourcing

SpliTEE extends the split‑inference architecture of Slalom to large language models by protecting intermediate GPU computations with differential privacy rather than encryption. The authors show that masking intermediate representations is essential, as a prompt‑reconstruction attack can recover prompts with about 80% accuracy. Their global sensitivity analysis bounds the noise needed, and they demonstrate that SpliTEE on Intel TDX achieves near‑double the speed of fully CPU‑based inference and outperforms encryption‑based Slalom while maintaining higher accuracy.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Hugging Face Trending Papers

Sep 9

Maverick: Private and Verifiable LLM Inference Made Practical via Matrix-Vector Multiplication Delegation

Open-source large language models (LLMs) are increasingly competitive with closed-source models while offering transparency and the ability to run inference without exposing user inputs to a service p...

llms efficiency safety

arXiv AI

Jun 16

Communication-Efficient Verifiable Attention for LLM Inference

arXiv:2606. 16352v1 Announce Type: cross Abstract: Computation integrity of remote large language model (LLM) serving can be questionable.

By Ziqun Chen, Ming Wu, Michael Heinrich, Jason Zeng, Huiying Lan, Tianwei Zhang, Rui Tan

llms

arXiv Machine Learning

Jul 7

GDBR: Label Recovery Attack Against Partial Gradient Encryption in Federated Learning

arXiv:2412. 12640v2 Announce Type: replace Abstract: The increasing demand for data privacy, alongside the benefits of aggregating data from networked devices, has catalyzed the emergence of federated learning (FL).

By Rui Zhang, Ka-Ho Chow

llms safety

arXiv Machine Learning

Jul 16

Securing LLMs in the Wild: Privacy and Security Challenges at the Edge

arXiv:2607. 13088v1 Announce Type: cross Abstract: Large Language Models (LLMs) are rapidly moving from research settings into the wild, deployed on enterprise infrastructure, personal devices, and edge platforms.

By Ren-Yi Huang, Mingchen Li, Dumindu Samaraweera, Morris Chang

llms efficiency safety

arXiv AI

Jul 16

Efficient and Privacy Aware Edge Cloud Collaborative Inference for Large Language Models

arXiv:2607. 13093v1 Announce Type: cross Abstract: On-device LLM inference faces a trilemma of response latency, limited hardware resources and user privacy.

By Yi Li, Chen Li, Jiexiong Liu

llms rag efficiency safety

arXiv AI

Jun 9

FuseFSS: Efficient Secure LLM Inference with Function Secret Sharing

arXiv:2606. 09551v1 Announce Type: cross Abstract: Two-server secure inference allows a client to query a hosted large language model (LLM) without revealing prompts or embeddings.

By Yuhan Ma, Yong Li, Stefan Schmid

llms rag benchmarks

One email a morning, machine-written

Related stories

Maverick: Private and Verifiable LLM Inference Made Practical via Matrix-Vector Multiplication Delegation

Communication-Efficient Verifiable Attention for LLM Inference

GDBR: Label Recovery Attack Against Partial Gradient Encryption in Federated Learning

Securing LLMs in the Wild: Privacy and Security Challenges at the Edge

Efficient and Privacy Aware Edge Cloud Collaborative Inference for Large Language Models

FuseFSS: Efficient Secure LLM Inference with Function Secret Sharing