arXiv AI By Guangyi Zou, Roman Vershynin

On the Subgaussianity of Quantized Linear Maps: An AI-Assisted Note

Read the original on arXiv AI →

arXiv:2605. 27563v2 Announce Type: replace-cross Abstract: We prove an elementary bounded-differences inequality for functions of non-isotropic Gaussian vectors.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv AI.

arXiv Machine Learning
Jun 26

Gradient Testing and Estimation by Comparisons

arXiv:2405. 11454v3 Announce Type: replace Abstract: We study gradient testing and gradient estimation of smooth functions using only a comparison oracle that, given two points, indicates which one has the larger function value.

By Xiwen Tao, Chenyi Zhang, Helin Wang, Yexin Zhang, Tongyang Li
arXiv AI
Jun 10

Minimum Distortion Quantization with Specified Output Distribution

arXiv:2606. 10458v1 Announce Type: cross Abstract: We derive the optimal quantizer of a real-valued random variable $W$ with distribution $P_W$ such that 1) the distribution of the quantization output $X$ that can take $k$ values follows any specified distribution $P_X$ over $\{1,\ldots,k\}$, and 2) the minimum mean squared error (MMSE) of estimating $W$ from $X$ is minimized.

By Aolin Xu
arXiv AI
Jun 30

Spectral Perturbation of the Empirical Fisher Information Matrix under Weight Quantization

arXiv:2606. 28432v1 Announce Type: cross Abstract: We study the spectral perturbation of the empirical Fisher Information Matrix (FIM) of a parametric statistical model under two structured perturbations: departure of the input from a reference (in-distribution) ensemble, and finite-precision (quantized) perturbation of the model's parameters.

By Rahid Zahid Alekberli, Hikmat Karimov