arXiv Machine Learning By Jiale Chen, Torsten Hoefler, Dan Alistarh

GPTQ-2D: Cubic-Time Two-Sided Adaptive Rounding

Read the original on arXiv Machine Learning →

arXiv:2607. 27042v1 Announce Type: cross Abstract: Adaptive rounding methods such as GPTQ, or equivalently Babai's nearest plane algorithm, round a real matrix to integers under a quadratic metric.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI
Jun 4

Model-Preserving Adaptive Rounding

arXiv:2505. 22988v3 Announce Type: replace-cross Abstract: The goal of quantization is to produce a compressed model whose output distribution is as close to the original model's as possible.

By Albert Tseng, Zhaofeng Sun, Christopher De Sa
arXiv Machine Learning
Jun 2

Stochastic Rounding Increases Small Singular Values

arXiv:2606. 00312v1 Announce Type: cross Abstract: Over the past half-dozen years, stochastic rounding (SR) has regained significant attention as a quantization scheme for low-precision floating-point arithmetic, with applications spanning numerical analysis and modern machine learning systems.

By Linkai Ma, Tingzhou Yu, Petros Drineas