arXiv Machine Learning July 17, 2026 By Saima Afrin, Md. Zahidul Haque, Antonio Mastropaolo

Quantize with Confidence? An Empirical Study of Quantization for Code Generation

Read the original on arXiv Machine Learning →

arXiv:2607. 14181v1 Announce Type: cross Abstract: The growing adoption of local inference frameworks such as Ollama has made it increasingly common for developers to run large code models on laptops and other resource-constrained hardware.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

4d ago

Behavioral Capacity Certificates for Quantized Language Models

arXiv:2609.37887v1 Announce Type: new Abstract: Activation and key-value cache precision change what a quantized language model computes without altering its stored weights. Direct weight-code bounds...

By Arian Eamaz, Mojtaba Soltanalian

llms efficiency

arXiv AI

Jun 16

DualGauge: Automated Joint Security-Functionality Benchmarking of Specification-Only Code Generation by LLMs and Coding Agents

arXiv:2511. 20709v2 Announce Type: replace-cross Abstract: Large language models (LLMs) and LLM-based coding agents are now used to generate code from natural-language specifications, yet ensuring such code is both functionally correct and secure remains a challenge.

By Rupam Patir, Keyan Guo, Suvadra Barua, Abhijeet Pathak, Dinesh Gudimetla, Jiawei Guo, Hongxin Hu, Haipeng Cai

llms agents fine-tuning efficiency benchmarks

arXiv Machine Learning

Sep 1

Fine-Tuning Low-Bit Models with Gradient in Quantized Code Space

arXiv:2608.30908v1 Announce Type: new Abstract: Fine-tuning Low-bit models aims to adapt a quantized model while keeping the final deployed checkpoint in the same low-bit form. This setting is practi...

By Shiguang Wu, Zhouchen Lin, Quanming Yao

fine-tuning efficiency

arXiv Machine Learning

Jun 8

AAAC: Activation-Aware Adaptive Codebooks for 4-bit LLM Weight Quantization

arXiv:2605. 08692v2 Announce Type: replace Abstract: Post-training weight-only quantization to 4 bits is widely used to reduce the memory and compute costs of large language model inference.

By Beshr IslamBouli, David Jin

llms efficiency

Hugging Face Trending Papers

Aug 25

Quantization Effects on Bangla Language Understanding in Large Language Models: A Systematic Evaluation

Post-training quantization lowers the memory footprint of Large Language Models (LLMs) and speeds up inference, which is why it is now common for on-device deployment. Most of what we know about its e...

llms efficiency benchmarks

arXiv Machine Learning

Jul 3

QTALE: Quantization-Robust Token-Adaptive Layer Execution for LLMs

arXiv:2602. 10431v4 Announce Type: replace Abstract: Large language models (LLMs) demand substantial computational and memory resources, posing challenges for efficient deployment.

By Kanghyun Noh, Jinheon Choi, Yulhwa Kim

llms fine-tuning efficiency benchmarks

One email a morning, machine-written

Related stories

Behavioral Capacity Certificates for Quantized Language Models

DualGauge: Automated Joint Security-Functionality Benchmarking of Specification-Only Code Generation by LLMs and Coding Agents

Fine-Tuning Low-Bit Models with Gradient in Quantized Code Space

AAAC: Activation-Aware Adaptive Codebooks for 4-bit LLM Weight Quantization

Quantization Effects on Bangla Language Understanding in Large Language Models: A Systematic Evaluation

QTALE: Quantization-Robust Token-Adaptive Layer Execution for LLMs