arXiv Machine Learning By Oguzhan Buyuksolak, Osman Erman Okman, Mehmet Gorkem Ulkar

ShiftQAT: Quantization-Aware Training for the Numerical Contract of a Fixed-Function Edge CNN Accelerator

Read the original on arXiv Machine Learning →

ShiftQAT is a quantization‑aware training workflow designed for the MAX7800x family of fixed‑function CNN accelerators. It enforces the accelerator’s numerical contract—power‑of‑two, per‑tensor symmetric scales, 8‑bit activations and biases, integer‑only arithmetic, and a single statically configured shift per layer—by training weights and biases on a joint power‑of‑two grid and resolving dependencies so that activation scales propagate statically. Compared to other methods, ShiftQAT uniquely satisfies all contract constraints while matching the accuracy of less constrained QAT approaches, achieving ImageNet performance within 2.9 percentage points of FP32 at W4A8 and enabling fast, energy‑efficient inference on MAX78002 silicon.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 24

RAMP: Robust Adaptive Mixed-Precision Quantization for Edge CPU Vision Models

The paper introduces RAMP, a method for robust adaptive mixed‑precision quantization of vision models on edge CPUs. It evaluates 13 sensitivity metrics across four neural networks, finding that Jensen‑Shannon Divergence consistently identifies layers that can be safely quantized. Using K‑Means clustering on these metrics, RAMP achieves near‑lossless accuracy with an average 1.81× speed‑up, while cautioning against excluding low‑speed‑up layers that can fragment the computational graph.

By David Poblaci\'on-Criado, Dario Garcia-Gasulla, Eduardo Quinones