arXiv Machine Learning By Deniz Yunus G\"o\u{g}\"u\c{s}

Trainable Quantum-Native Language Models: Dissipative Memory, Capacity Limits, and Hardware Validation

Read the original on arXiv Machine Learning →

The paper introduces byte‑level autoregressive language models that use a small quantum register as hidden state, with token‑conditioned quantum channels and Born‑rule measurements providing next‑byte probabilities. Unitary dynamics alone fail to retain memory beyond one token, but adding learned dissipative gating improves test negative log‑likelihood and key‑value recall up to a limited capacity. Experiments on IBM Heron hardware show measurable quantum memory signals and autoregressive byte generation, though the models remain classically simulable and do not outperform classical n‑gram baselines.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 22

Watching Quantum Models Think: Hilbert-Space Interpretability in Quantum Transformer Blocks

The paper demonstrates that quantum transformer blocks can be intrinsically interpretable by tracking quantum mutual information, entanglement entropy, and state fidelity across layers. Experiments on four synthetic tasks show that learned mutual information aligns with task structure, entanglement is essential for accuracy, and mutual information predicts prediction correctness. These findings are validated on IBM Quantum hardware, illustrating that quantum computation’s physics can provide observable interpretability signals.

By Diego Iacopetta, Andrea Gasparini