arXiv AI By Zhengzhe Xiang, Yinlin Chen, Fuli Ying, Binbin Zhou, Hailiang Zhao, Schahram Dustdar

LipCache: A Local Inference Proxy with Certified Caching for Edge Image Classification Service

Read the original on arXiv AI →

arXiv:2608. 13144v1 Announce Type: cross Abstract: As edge-side vision services continue to expand toward low-latency, high-throughput scenarios, reducing the inference cost of vision models without sacrificing reliability has become a central concern.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv AI.