arXiv Machine Learning
OptiPrime: Optimizing Private Inference through Protocol-Hardware Co-design
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Jun 16
FEnc$^2$: Unifying Data Packing for Efficient Private Inference via Convolution and Architecture-Aware Fragment Encoding
arXiv:2606. 16359v1 Announce Type: cross Abstract: Fully Homomorphic Encryption (FHE) enables privacy-preserving machine learning but incurs extreme computational and memory overhead.
arXiv AI
6d ago
Pacifo: An Efficient Fully Homomorphic Encryption-based Lightweight ResNet for Trustworthy Machine Learning as a Service
Pacifo is a framework that adapts fine‑tuning strategies to efficiently run the ResNet20 model using Fully Homomorphic Encryption (FHE). It introduces a public‑private layer partitioning scheme and an efficient ReLU approximation, reducing private layers and costly FHE operations during inference. Compared to state‑of‑the‑art FHE implementations, Pacifo achieves a 3.7–21.7× speedup while preserving 95–99 % of the original plaintext model accuracy.
arXiv Machine Learning
Oct 19
Practical and Private Hybrid ML Inference with Fully Homomorphic Encryption
arXiv:2509.01253v2 Announce Type: replace-cross Abstract: In contemporary cloud-based services, protecting users' sensitive data and ensuring the confidentiality of the server's model are critical. F...
arXiv AI
Sep 3
HEAT: Faster Fully Homomorphic Inference via Approximations-Weights Co-Adaptation
HEAT introduces a fine‑tuning method that treats the number of iterations used to approximate nonlinearities in fully homomorphic encryption (FHE) as learnable parameters, allowing them to co‑adapt with model weights. By optimizing iteration counts per nonlinearity, HEAT reduces the required iterations, bootstraps, and overall latency for encrypted GPT‑2 decoding while improving decode agreement. The approach achieves a 3.1× reduction in iterations, a 1.6× reduction in bootstraps, and a 1.4× speed‑up in end‑to‑end latency without changing the model architecture or requiring retraining from scratch.
arXiv AI
Oct 7
SpliTEE: Fast and Private LLM Inference by Coupling GPU-Assisted Trusted Execution Environments with Differential Privacy
arXiv:2609.15039v3 Announce Type: replace-cross Abstract: User prompts provided to large language models (LLMs) may contain private information. One way to protect them is to execute the LLM inside a...
arXiv Machine Learning
Sep 15
EI-DDLGN: Efficient Encrypted Inference with Deep Differentiable Logic Gate Networks under TFHE
arXiv:2609.13636v1 Announce Type: cross Abstract: Privacy-preserving inference via Torus Fully Homomorphic Encryption (TFHE) provides strong protection for sensitive data in outsourced deep learning...