arXiv Machine Learning

OptiPrime: Optimizing Private Inference through Protocol-Hardware Co-design

arXiv AI
6d ago

Pacifo: An Efficient Fully Homomorphic Encryption-based Lightweight ResNet for Trustworthy Machine Learning as a Service

Pacifo is a framework that adapts fine‑tuning strategies to efficiently run the ResNet20 model using Fully Homomorphic Encryption (FHE). It introduces a public‑private layer partitioning scheme and an efficient ReLU approximation, reducing private layers and costly FHE operations during inference. Compared to state‑of‑the‑art FHE implementations, Pacifo achieves a 3.7–21.7× speedup while preserving 95–99 % of the original plaintext model accuracy.

By Yang Li, Gang He, Ruichen Zhang, Guangyuan Liu, Yinqiu Liu
arXiv Machine Learning
Oct 19

Practical and Private Hybrid ML Inference with Fully Homomorphic Encryption

arXiv:2509.01253v2 Announce Type: replace-cross Abstract: In contemporary cloud-based services, protecting users' sensitive data and ensuring the confidentiality of the server's model are critical. F...

By Sayan Biswas, Philippe Chartier, Akash Dhasade, Tom Jurien, David Kerriou, Anne-Marie Kerrmarec, Mohammed Lemou, Franklin Tranie, Martijn de Vos, Milos Vujasinovic
arXiv AI
Sep 3

HEAT: Faster Fully Homomorphic Inference via Approximations-Weights Co-Adaptation

HEAT introduces a fine‑tuning method that treats the number of iterations used to approximate nonlinearities in fully homomorphic encryption (FHE) as learnable parameters, allowing them to co‑adapt with model weights. By optimizing iteration counts per nonlinearity, HEAT reduces the required iterations, bootstraps, and overall latency for encrypted GPT‑2 decoding while improving decode agreement. The approach achieves a 3.1× reduction in iterations, a 1.6× reduction in bootstraps, and a 1.4× speed‑up in end‑to‑end latency without changing the model architecture or requiring retraining from scratch.

By Alessandro Zirilli, Davide Marincione, Evgenios M. Kornaropoulos, Giuseppe Ateniese, Emanuele Rodol\`a
arXiv AI
Sep 15

SpliTEE: Improving LLM Inference on Trusted Hardware with Differentially Private GPU Outsourcing

SpliTEE extends the split‑inference architecture of Slalom to large language models by protecting intermediate GPU computations with differential privacy rather than encryption. The authors show that masking intermediate representations is essential, as a prompt‑reconstruction attack can recover prompts with about 80% accuracy. Their global sensitivity analysis bounds the noise needed, and they demonstrate that SpliTEE on Intel TDX achieves near‑double the speed of fully CPU‑based inference and outperforms encryption‑based Slalom while maintaining higher accuracy.

By Shashie Dilhara Batan Arachchige, Robin Carpentier, Hassan Jameel Asghar, Dali Kaafar
arXiv Machine Learning
Oct 21

LightSplit: Practical Privacy-Preserving Split Learning via Orthogonal Projections (Full Version)

LightSplit introduces a lightweight orthogonal random projection at the split learning cut layer to reduce communication overhead and limit information exposure. By sending low‑dimensional projections instead of raw activations, the method preserves end‑to‑end differentiability while discarding irreversibly part of the representation, thereby mitigating reconstruction attacks. Experiments on seven benchmarks show up to 32× compression with minimal accuracy loss and strong resistance to state‑of‑the‑art inversion attacks.

By Mert Cihangiroglu, Alessandro Pegoraro, Phillip Rieger, Antonino Nocera, Ahmad-Reza Sadeghi