← Back to all news
arXiv AI By Xu Zheng, Wei Cheng, Zhuomin Chen, Dongkuan Xu, Mo Sha, Jingchao Ni, Dongsheng Luo

First-Order LoRA Training with Phone NPUs

Read the original on arXiv AI →

The paper introduces a system that enables first‑order LoRA training on phone NPUs by running all frozen‑weight multiplications on the NPU while keeping adapters and the optimizer on the CPU. It reuses weight tiles for input‑gradient computation, selects precision based on gradient sensitivity, and fuses remaining CPU operations to overlap with NPU execution. The approach is evaluated on Qualcomm Snapdragon devices with Qwen and Llama LLMs, demonstrating background training for nightly personalization and benchmark workloads.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv Machine Learning
Oct 16

ZenFlow: Enabling Stall-Free Offloading for LLM Training

ZenFlow is an offloaded training framework for large language models that reduces GPU stalls by prioritizing important gradients. It updates critical gradients in-place on the GPU while offloading less important ones to the CPU, overlapping CPU work with GPU computation. The approach leverages spatio‑temporal locality of important gradients to keep identification lightweight, achieving up to 5× speedup, 2× less PCIe traffic, 85% fewer GPU stalls, and lower cloud GPU costs without sacrificing accuracy.

By Tingfeng Lan, Yusen Wu, Bin Ma, Zhaoyuan Su, Rui Yang, Tekin Bicer, Masahiro Tanaka, Olatunji Ruwase, Dong Li, Yue Cheng
llmsfine-tuning
More like this →
arXiv AI
Jun 12

LoRA-Muon: Spectral Steepest Descent on the Low-Rank Manifold

arXiv:2606. 12921v1 Announce Type: cross Abstract: Low-Rank Adaptation (LoRA) significantly reduces compute and memory costs for finetuning Deep Learning models but is often harder to tune than dense training: when using factor-wise optimizers such as AdamW, it is sensitive to initialization choices, its optimal learning rates transfer poorly across ranks, and it often fails to beat dense baselines.

By Franz Louis Cesista, Katherine Crowson, C\'edric Simal, Stella Biderman
fine-tuning
More like this →
arXiv AI
Jul 21

Sparsity-Aware Low-Rank Representation for Efficient Fine-Tuning of Large Language Models

arXiv:2601. 16991v3 Announce Type: replace-cross Abstract: Adapting large pre-trained language models to downstream tasks often entails fine-tuning millions of parameters or deploying costly dense weight updates, which hinders their use in resource-constrained environments.

By Longteng Zhang, Sen Wu, Shuai Hou, Zhengyu Qing, Zhuo Zheng, Danning Ke, Qihong Lin, Qiang Wang, Shaohuai Shi, Xiaowen Chu
llmsfine-tuningefficiencybenchmarks
More like this →