arXiv Machine Learning July 21, 2026 By Bas Meuwissen, Vasileios Tsouvalas, Nirvana Meratnia

AutoEncoder-Compressed Parallel Split Learning for Pre-trained Model Fine-Tuning

Read the original on arXiv Machine Learning →

arXiv:2607. 17913v1 Announce Type: cross Abstract: Distributed Fine-Tuning (DFT) of large-scale Foundation Models (FMs) on resource-constrained edge devices is limited by local compute constraints and communication overhead.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jul 9

Protocol Models: Scaling Decentralized Training with Communication-Efficient Model Parallelism

arXiv:2506. 01260v2 Announce Type: replace Abstract: Scaling models has led to significant advancements in deep learning, but training these models in decentralized settings remains challenging due to communication bottlenecks.

By Sameera Ramasinghe, Thalaiyasingam Ajanthan, Gil Avraham, Yan Zuo, Alexander Long

llms

arXiv Machine Learning

Jul 10

Subspace Networks: Scaling Decentralized Training with Communication-Efficient Model Parallelism

arXiv:2506. 01260v3 Announce Type: replace Abstract: Scaling models has led to significant advancements in deep learning, but training these models in decentralized settings remains challenging due to communication bottlenecks.

By Sameera Ramasinghe, Thalaiyasingam Ajanthan, Gil Avraham, Yan Zuo, Alexander Long

llms

arXiv Machine Learning

Aug 4

GAPSL: A Gradient-Aligned Parallel Split Learning over Data-Heterogeneous Edge Computing Systems

arXiv:2603. 18540v2 Announce Type: replace Abstract: The increasing complexity of neural networks poses significant challenges for democratizing federated learning (FL) on resource-constrained edge devices.

By Zheng Lin, Ons Aouedi, Zihan Fang, Wei Ni, Yue Gao, Symeon Chatzinotas, Xianhao Chen

benchmarks safety

arXiv AI

Aug 25

SplitLite: Low-Rank Residual Compression for Split Learning

arXiv:2608.23018v1 Announce Type: cross Abstract: Federated fine-tuning of on-device large language models (LLMs) faces a significant computing burden. To overcome this limitation, split learning (SL...

By Tao Li, Yulin Tang, Qi Guo, Xianhao Chen

llms fine-tuning efficiency benchmarks

arXiv Machine Learning

Jun 2

Learning Fine-grained Parameter Sharing via Sparse Tensor Decomposition

arXiv:2411. 09816v5 Announce Type: replace Abstract: Large neural networks achieve state-of-the-art performance on many tasks, yet their sheer size hinders deployment on resource-constrained devices.

By Cem \"Uy\"uk, Mike Lasby, Mohamed Yassin, Utku Evci, Yani Ioannou

llms fine-tuning efficiency benchmarks

arXiv AI

Jun 9

Joint Structural Pruning and Mixed-Precision Quantization for LLM Compression

arXiv:2606. 07819v1 Announce Type: new Abstract: Recently, the efficiency of Large Language Models (LLMs) deployment has become a critical concern in practical applications.

By Hoang-Loc La, Truong-Thanh Le, Amir Taherkordi, Phuong Hoai Ha

llms efficiency benchmarks

One email a morning, machine-written

Related stories

Protocol Models: Scaling Decentralized Training with Communication-Efficient Model Parallelism

Subspace Networks: Scaling Decentralized Training with Communication-Efficient Model Parallelism

GAPSL: A Gradient-Aligned Parallel Split Learning over Data-Heterogeneous Edge Computing Systems

SplitLite: Low-Rank Residual Compression for Split Learning

Learning Fine-grained Parameter Sharing via Sparse Tensor Decomposition

Joint Structural Pruning and Mixed-Precision Quantization for LLM Compression