Variational Quantum Transformer Architecture for Synthetic Language Generation
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The paper introduces a compact, NISQ‑compatible quantum transformer for synthetic QNLP sequence modelling. It replaces classical attention and feed‑forward layers with variational quantum encoder blocks, connector circuits, decoder blocks, and a two‑qubit measurement readout, while preserving the autoregressive next‑token interface. The authors evaluate several variants on deterministic and lexicographic grammar‑generation tasks, finding that the quantum models can learn nontrivial grammar structure but are less accurate and stable than a compact classical transformer baseline.
Quantum circuit optimization for fault-tolerant computing requires exact functional equivalence while minimizing expensive non-Clifford resources such as T gates. We study this problem using a compact 44.
arXiv:2609.24657v1 Announce Type: cross Abstract: Language models can be adapted by changing the computations applied to individual tokens. Quantum circuits offer one such approach, but evaluating wi...
arXiv:2606. 24932v1 Announce Type: cross Abstract: Recent advances in quantum computing and machine learning have motivated the development of quantum models for sequential data processing.
QTrans is a quantum transformer designed for small‑scale binary sentiment classification. It constructs query, key, and value features using parameterized quantum circuits and derives attention coefficients from Gaussian distances between quantum measurements. The model incorporates a quantum feed‑forward network, residual connections, and layer normalization, achieving higher accuracies on MR, CR, and MPQA datasets compared to classical baselines.
arXiv:2607. 12780v1 Announce Type: cross Abstract: Quantum circuit optimization for fault-tolerant computing requires exact functional equivalence while minimizing expensive non-Clifford resources such as T gates.