The paper introduces Quantizer‑Aligned Recalibration (QuAR), a single‑pass test‑time adaptation technique for quantized vision transformers that does not require backpropagation or parameter updates. QuAR recalibrates activations at the input of frozen quantizers by aligning per‑channel statistics with the source calibration, thereby correcting the distorted code distribution caused by distribution shift. On ImageNet‑C, QuAR outperforms state‑of‑the‑art backprop‑free methods across 3‑, 4‑, 6‑, and 8‑bit precisions, achieving higher accuracy, lower latency, and minimal memory overhead while maintaining performance across diverse shift scenarios.
By Hyeongheon Cha, Young D. Kwon, Sung-Ju Lee
arXiv:2610.16368v1 Announce Type: cross
Abstract: Looped Language Models (LoopLMs) improve parameter efficiency by recursively reusing shared Transformer modules, yet their repeated computation over...
By Zhixiong Zhao, Zukang Xu, Xing Hu, Lifeng Liu, Guangyu Sun, Dawei Yang
arXiv:2606. 18114v1 Announce Type: cross Abstract: State Space Models (SSMs) such as Mamba-2 offer linear-time inference but their memory footprint limits edge deployment.
By Ramprasath Ganesaraja, Sahil Dilip Panse, Swathika N
arXiv:2605.16343v2 Announce Type: replace-cross
Abstract: Looped language models (LoopLMs) increase effective computational depth by repeatedly applying shared Transformer blocks without increasing t...
By Rui Fang, Hsi-Wen Chen, Chia-Ming Cheng, Ming-Syan Chen
arXiv:2610.15139v2 Announce Type: replace
Abstract: Linear-attention and state-space LLMs carry long context in a fixed-size recurrent state, and quantizing that state is the natural way to cut its c...
By Yuhang Jiang
The paper investigates how to quantize recurrent language models, which use linear recurrences instead of softmax attention. It distinguishes between extra‑state quantization (weights and activations outside the recurrent state) and intra‑state quantization (the recurrent state itself during decoding). The authors introduce LoReS, a quantization pipeline that applies value‑axis scale grouping, decay‑based mixed precision, and stochastic rounding, enabling robust 8‑bit state quantization for large models such as Qwen‑3.5, Nemotron‑H, and Kimi‑Linear, and achieving decode speedups when integrated into vLLM.
By Philipp Nazari, Neehal Tumma, Daniela Rus, T. Konstantin Rusch
arXiv:2610.05265v2 Announce Type: replace
Abstract: Looped language models provide a parameter-efficient way to scale iterative test-time computation by repeatedly executing a shared recurrent core....
By Zeyu Li, Yipu Zhang, Jintao Cheng, Xin Li, Wei Zhnag
arXiv:2609.26173v1 Announce Type: new
Abstract: Many post-training quantization (PTQ) methods use layer-wise reconstruction, second-order proxy objectives, or activation-aware transformations to redu...
By Kasun Dewage, Marianna Pensky, Suranadi De Silva
The paper introduces TTS‑Q, a perception‑guided post‑training quantization method for zero‑shot text‑to‑speech diffusion transformers. It identifies that 4‑bit weight‑and‑activation quantization erodes speaker timbre, and addresses this by selecting hard‑to‑quantize items and applying a mixed‑precision schedule that gives higher precision to late‑step feed‑forward activations. The resulting approach restores timbre while preserving intelligibility and reduces GPU memory usage for resource‑constrained deployment.
By Xiaoqin Feng, Yuqi Li, Weilun Feng, Yi-Cheng Lin, Kai Li, Xianglong Wang, Kuo Yang, Chuanguang Yang, Yingli Tian, Wei Li, Zhongwei Cheng, Lin Chen
arXiv:2606. 09012v1 Announce Type: cross Abstract: Post-training quantization (PTQ) converts a trained full-precision model into low-bit weights without task-level retraining, while quantization-aware training (QAT) incorporates quantization into the training loop.
By Hanyang Li, Jianhao Ma, Ying Cui
ResidualQuant introduces a 2‑bit residual quantization scheme for KV caches in looped Transformers, leveraging the similarity of KV states across loops. By using the final‑loop KV states as a reference and applying least‑square scaling, rotations, and loop‑wise mixed precision, the method achieves accurate quantization down to INT2. Experiments on various looped Transformer models show that ResidualQuant improves the accuracy‑memory tradeoff, retaining near BF16 accuracy while reducing KV storage by 80.7% and boosting decode throughput and batch size on an RTX 5090.
By Heejun Kim, Junyoung Lee, SangLyul Cho, Dongsu Han, Insu Han, Sehoon Kim
arXiv:2609.39223v2 Announce Type: new
Abstract: Large language model (LLM) inference is increasingly moving toward lower precision to realize the throughput of hardware accelerators, but aggressive p...
By Weili Xu, Jisen Li, Yuqing Jian, Chenxi Li, Zhizhou Sha, Yifan Yu, Qingyang Wu, Chenfeng Xu, Zhongzhu Zhou, Tianyi Zhang, Ben Athiwaratkun