arXiv Machine Learning

GQ-FSL: Green Quantized Federated Split Learning Framework for Wireless Edge Networks

The paper introduces GQ-FSL, a green quantized federated split learning framework designed for wireless edge networks. It uses stochastic quantization for both local training and wireless transmissions, allowing asymmetric precision between client and server submodels to balance device energy limits with global convergence. The authors develop energy models and a convergence bound for heterogeneous data, then formulate an optimization problem to set the DNN split point and precision levels, achieving lower energy consumption while meeting latency and accuracy targets.

arXiv Machine Learning
Sep 24

RAMP: Robust Adaptive Mixed-Precision Quantization for Edge CPU Vision Models

The paper introduces RAMP, a method for robust adaptive mixed‑precision quantization of vision models on edge CPUs. It evaluates 13 sensitivity metrics across four neural networks, finding that Jensen‑Shannon Divergence consistently identifies layers that can be safely quantized. Using K‑Means clustering on these metrics, RAMP achieves near‑lossless accuracy with an average 1.81× speed‑up, while cautioning against excluding low‑speed‑up layers that can fragment the computational graph.

By David Poblaci\'on-Criado, Dario Garcia-Gasulla, Eduardo Quinones
arXiv Machine Learning
Jun 26

Quantization in Federated Learning: Methods, Challenges and Future Directions

arXiv:2606. 26822v1 Announce Type: new Abstract: Federated Learning (FL) has become a foundational paradigm for privacy-preserving distributed intelligence, yet its scalability remains fundamentally constrained by communication bottlenecks, device heterogeneity, and the challenges of training under statistically non-IID data.

By Farwa Ikram, Dipanwita Thakur, Antonella Guzzo, Giancarlo Fortino
arXiv Machine Learning
Aug 4

Cluster-Aware Over-the-Air Federated Learning with Energy-Harvesting Devices: From Global Training to Model Personalization

arXiv:2608. 01426v1 Announce Type: new Abstract: Federated learning (FL) enables distributed optimization and learning across decentralized edge devices while preserving data privacy, but its performance is fundamentally constrained by heterogeneous data distributions, limited communication resources, and energy availability.

By Furkan Bagci, Busra Tegin, Mohammad Kazemi, Tolga M. Duman
arXiv Computation and Language
1d ago

ProQuant: Progressive Quantization-aware Training for Edge MLLMs

ProQuant introduces a progressive quantization‑aware training framework for low‑bit multi‑modal large language models (MLLMs), addressing the performance drop seen with post‑training quantization at low bit‑widths. The method includes a self‑relabeling scheme to align fine‑tuning data with pre‑training distributions and a progressive block activation mechanism that prioritizes multi‑modal understanding, guided by a vision‑sensitive factor to identify critical layers. Experiments on 2B–8B models show ProQuant outperforms existing techniques, achieving up to a 6.6% accuracy gain in W4A8 Qwen3‑VL‑2B‑Instruct with only ~1% drop from full precision.

By Yufei Xue, Yushi Huang, Jiawei Shao, Pingcheng Dong, Yonghao Tan, Shiyao Li, Kwang-Ting Cheng, Jun Zhang
arXiv AI
Oct 19

LeanTTA: A Backpropagation-Free and Stateless Approach to Quantized Test-Time Adaptation on Edge Devices

LeanTTA is a backpropagation-free, stateless framework for quantized test-time adaptation designed for edge devices. It updates normalization statistics on the fly, avoiding large batches and historical data, and combines partial adaptation with quantized module fusion to reduce computational costs. Experiments across sensor modalities show a 15.7% error reduction, peak memory usage of only 11.2 MB for ResNet18, and fast adaptation within an order of magnitude of normal inference speeds on-device.

By Cynthia Dong, Hong Jia, Young D. Kwon, Georgios Rizos, Cecilia Mascolo