arXiv Machine Learning By David S. Berman, Ying-Jer Kao, Roger G. Melko, Alexander G. Stapleton

Do Quantum Models Scale Like LLMs?

Read the original on arXiv Machine Learning →

The paper investigates neural scaling laws for RydbergGPT, an autoregressive transformer trained on qubit measurement data from Rydberg atom arrays. Near a critical point in the quantum system, the transformer’s loss scales with dataset size following a power‑law with a loss‑floor correction, whereas this relationship weakens away from criticality. By comparing entropy‑normalized mutual‑information two‑point functions of Rydberg data and natural‑language corpora, the authors find that near‑critical statistics resemble natural language more closely, suggesting that multi‑scale dependence underlies stable neural scaling and that scaling behaviour depends on the model–data pair.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Jul 7

Deriving Neural Scaling Laws from the statistics of natural language

arXiv:2602. 07488v3 Announce Type: replace-cross Abstract: Despite the fact that experimental neural scaling laws have substantially guided empirical progress in large-scale machine learning, no existing theory can quantitatively predict the exponents of these important laws for any modern LLM trained on any natural language dataset.

By Francesco Cagnetta, Allan Ravent\'os, Surya Ganguli, Matthieu Wyart