arXiv Computer Vision By Rahul Singh, Devdeep Ray, Connor Smith, Sarita Adve

SemanticXR: Low Power and Real-time Queryable Semantic Mapping with an Object-Level Device-Cloud Architecture

Read the original on arXiv Computer Vision →

SemanticXR is a device‑cloud system that enables real‑time, open‑vocabulary semantic mapping and querying for XR applications while respecting power, bandwidth, and memory limits. By treating semantically identifiable objects as first‑class units, the system coordinates communication, execution, and memory across device and server, achieving a 2.2× faster server‑side mapping latency and keeping upstream bandwidth below 2.5 Mbps. On the device, an object‑level sparse local map with incremental updates delivers sub‑100 ms query latency for up to 10,000 objects, supports tens of thousands of objects within a 500 MB footprint, and adds only about 2 % to idle power.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Aug 18

From LLM Inference to Agentic Workloads: Characterization and Implications for Serving Systems

arXiv:2608. 15127v1 Announce Type: cross Abstract: Agentic applications are shifting AI serving from isolated model inference to long-running workloads in which LLMs coordinate tools, environments, and persistent state.

By Chaokun Chang, Yukun Zhou, Kaihua Fu, Dakai An, Tianyu Feng, Hanfeng Lu, Sheng Yao, Pu Guo, Yinghao Yu, Yizhou Shan, Bo Li, Binhang Yuan, Wei Wang
arXiv AI
Aug 10

Intelligence per Watt: Measuring Intelligence Efficiency of Local AI

arXiv:2511. 07885v5 Announce Type: replace-cross Abstract: Large language model (LLM) queries are predominantly processed by frontier models in centralized cloud infrastructure.

By Jon Saad-Falcon, Avanika Narayan, Hakki Orhun Akengin, J. Wes Griffin, Herumb Shandilya, Adrian Gamarra Lafuente, Medhya Goel, Rebecca Joseph, Shlok Natarajan, Etash Kumar Guha, Shang Zhu, Ben Athiwaratkun, John Hennessy, Azalia Mirhoseini, Christopher R\'e
arXiv AI
Sep 15

MAPS: Memory-Aware Predictive Scheduling Framework for Large Language Model Serving

MAPS is a Memory-Aware Predictive Scheduling framework designed for disaggregated large language model (LLM) serving. It uses device-assisted speculative output length prediction and uncertainty-aware calibration to establish safe output-length upper bounds, which inform a hierarchical global-local scheduling strategy that reduces queue buildup and head-of-line blocking. Experiments on real-world workloads and two LLMs demonstrate that MAPS lowers average end-to-end latency by 42.6% and tail latency by up to 84.8% compared to three state-of-the-art systems.

By Tiancheng Zhang, Yulin Chen, Yunfeng Zhao, Shaoyuan Huang, Cheng Zhang, Xiaofei Wang