arXiv AI
SchemaWeaver: Accelerating On-Device Mobile Agentic AI via Schema-Guided Parallel LLM Decoding
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jul 15
PalmClaw: A Native On-Device Agent Framework for Mobile Phones
arXiv:2607. 13027v1 Announce Type: cross Abstract: Large Language Model (LLM) agents have moved beyond generating responses to executing multi-step tasks by calling tools, observing the results, and iteratively deciding the next action.
arXiv Machine Learning
Jun 4
Efficient Reasoning on the Edge
arXiv:2603. 16867v2 Announce Type: replace Abstract: Large language models (LLMs) with chain-of-thought reasoning achieve state-of-the-art performance across complex problem-solving tasks, but their verbose reasoning traces and large context requirements make them impractical for edge deployment.
arXiv Machine Learning
Jun 15
Efficient On-Device Diffusion LLM Inference with Mobile NPU
arXiv:2606. 13740v1 Announce Type: new Abstract: Diffusion large language models (dLLMs) accelerate generation by denoising multiple tokens in parallel, making them attractive for latency-sensitive mobile inference.
arXiv AI
Oct 27
Multi-Agentic AI for Fairness-Aware and Accelerated Multi-modal Large Model Inference in Real-world Mobile Edge Networks
The paper proposes a Multi-Agentic AI framework to enable fairness‑aware and accelerated inference of large, heterogeneous multi‑modal language models on mobile edge networks. It introduces a Global Planning Agent, a Prompt Scheduling Agent, and multiple on‑node LM Deployment Agents that jointly optimize prompt routing and model deployment using natural language reasoning over telemetry and historical data. Experiments on a city‑wide testbed show a 42.9% reduction in end‑to‑end latency versus a state‑of‑the‑art baseline and an 80.6% reduction versus a full‑activation baseline, while preserving high fairness (Jain's index 0.925).
arXiv AI
Sep 24
MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research
MobileGym is a browser-hosted, lightweight simulation platform designed for mobile GUI agent research. It offers verifiable outcome signals via deterministic, JSON-based state judging and supports scalable online reinforcement learning with hundreds of parallel instances on a single server. The platform includes a declarative task-definition framework, a structured AnswerSheet protocol, and a benchmark of 416 parameterized tasks across 28 apps, demonstrating strong sim-to-real transfer in a case study.
arXiv AI
Jul 8
Is Your NPU Ready for LLMs? Dissecting the Hidden Efficiency Bottlenecks in Mobile LLM Inference
arXiv:2607. 05475v1 Announce Type: cross Abstract: Deploying Large Language Models (LLMs) on mobile devices enhances privacy and reduces latency, but is severely bottlenecked by hardware inefficiency.