arXiv:2610.08164v1 Announce Type: new
Abstract: Low-rank quantization error compensation (LQEC) recovers the accuracy lost under aggressive weight quantization by attaching a closed-form rank-$r$ ada...
By Seobin Song, Geonho Lee, Janghwan Lee, Jungwook Choi
arXiv:2606. 00494v1 Announce Type: new Abstract: Post-Training Quantization (PTQ) and Low-Rank Adaptation (LoRA) constitute the standard pipeline for efficient Large Language Model (LLM) deployment.
By Wneya Yu, Chao Zhang, Li Wang, Samson Lasaulce, Merouane Debbah
As large language model inference shifts toward lower precision, post-training quantization (PTQ) becomes increasingly brittle, making quantization-aware training (QAT) essential for preserving model...
arXiv:2608. 13966v1 Announce Type: new Abstract: As large language model inference shifts toward lower precision, post-training quantization (PTQ) becomes increasingly brittle, making quantization-aware training (QAT) essential for preserving model quality.
By Vincent Counathe, Ben Athiwaratkun, Christopher De Sa, Tianyi Zhang
arXiv:2608. 14149v1 Announce Type: new Abstract: Recent training-free post-training quantization methods restore model accuracy through closed-form residual compensation.
By Lin-Fa Lee, Yi-Yu Chang, Kuo-Hei Yeh
arXiv:2606. 01412v1 Announce Type: new Abstract: Post-training quantization is widely used for compressing large neural networks, but aggressive low-bit quantization can significantly degrade model quality.
By Shihao Zhang, Rayan Saab