arXiv Machine Learning June 4, 2026 By Yelysei Bondarenko, Thomas Hehn, Rob Hesselink, Romain Lepert, Fabio Valerio Massoli, Evgeny Mironov, Leyla Mirvakhabova, Tribhuvanesh Orekondy, Spyridon Stasis, Andrey Kuzmin, Anna Kuzina, Markus Nagel, Ankita Nayak, Corrado Rainone, Ork de Rooij, Paul N Whatmough, Arash Behboodi, Babak Ehteshami Bejnordi

Efficient Reasoning on the Edge

Read the original on arXiv Machine Learning →

arXiv:2603. 16867v2 Announce Type: replace Abstract: Large language models (LLMs) with chain-of-thought reasoning achieve state-of-the-art performance across complex problem-solving tasks, but their verbose reasoning traces and large context requirements make them impractical for edge deployment.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 11

Resource-Aware LLM Reasoning for Mobile Edge General Intelligence

arXiv:2509. 23248v3 Announce Type: replace Abstract: The rapid advancement of large language models (LLMs) has enabled an emergence of agentic artificial intelligence (AI) with powerful reasoning and autonomous decision-making capabilities.

By Mingyi Luo, Ruichen Zhang, Xiangwang Hou, Jun Du, Chunxiao Jiang, Yong Ren, Shiwen Mao

llms agents safety

arXiv AI

Jul 17

SmartRAG: Native Graph-Based RAG for Mobile Device

arXiv:2607. 14661v1 Announce Type: new Abstract: Deploying large language models (LLMs) as personal assistants on mobile devices demands privacy, low latency, and offline availability, yet the computational cost of giant models clashes with strict edge-hardware budgets.

By Zhihan Jiang, Meng Li, Shenghao Liu, Keran Li, Ruiben Zhou, Xianjun Deng, Shuai Wang, Haipeng Dai

llms rag efficiency benchmarks safety

arXiv AI

Jul 28

Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization

arXiv:2607. 22583v1 Announce Type: new Abstract: Large Language Models (LLMs) have achieved widespread adoption because of their strong reasoning and query-response capabilities.

By Muhammad Junaid Ali, Smail Niar, El-Ghazali Talbi

llms efficiency

arXiv Machine Learning

Jul 14

Device-Cloud Collaborative LLM Inference with Multi-Modal, Multi-Task, Multi-Turn Conversations

arXiv:2502. 11007v5 Announce Type: replace Abstract: Compared to traditional machine learning models, recent large language models (LLMs) can exhibit multi-task-solving capabilities through multi-modal data sources and multi-turn conversations.

By Liangqi Yuan, Dong-Jun Han, Shiqiang Wang, Christopher G. Brinton

llms reinforcement-learning multimodal

arXiv Machine Learning

Jun 11

MobileFineTuner: A Mobile-Native Framework for On-Device LLM Fine-Tuning in Real-World Embedded AI Applications

arXiv:2512. 08211v2 Announce Type: replace Abstract: Large language models (LLMs) are moving from cloud-centric services toward on-device embedded AI, where models interact with private, longitudinal signals sensed from users and their physical environments.

By Jiaxiang Geng, Lunyu Zhao, Yiyi Lu, Bing Luo

llms agents fine-tuning

arXiv Machine Learning

Jun 15

Efficient On-Device Diffusion LLM Inference with Mobile NPU

arXiv:2606. 13740v1 Announce Type: new Abstract: Diffusion large language models (dLLMs) accelerate generation by denoising multiple tokens in parallel, making them attractive for latency-sensitive mobile inference.

By Tuowei Wang, Yanfan Sun, Ju Ren

llms diffusion efficiency

Related stories

Resource-Aware LLM Reasoning for Mobile Edge General Intelligence

SmartRAG: Native Graph-Based RAG for Mobile Device

Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization

Device-Cloud Collaborative LLM Inference with Multi-Modal, Multi-Task, Multi-Turn Conversations

MobileFineTuner: A Mobile-Native Framework for On-Device LLM Fine-Tuning in Real-World Embedded AI Applications

Efficient On-Device Diffusion LLM Inference with Mobile NPU