arXiv Computation and Language

Parameter-Efficient Quantum NLP for Paraphrase Detection: Performance, Robustness, and Entanglement

arXiv Machine Learning
Aug 19

SPSA Hyperparameter Tuning for Variational Quantum Natural Language Inference

The paper investigates how to tune the hyperparameters of simultaneous perturbation stochastic approximation (SPSA) for training a 6‑qubit, 60‑parameter variational quantum natural language inference (QNLI) classifier. By exploring a broad grid of perturbation scales, learning rates, and gain‑decay schedules, the authors found that an AdamW‑style SPSA configuration (c₀=0.01, η=0.10, γ=0.10) achieved 55 % ± 11 % test accuracy, improving over the default SPSA but still 16–19 percentage points below parameter‑shift baselines. Classical‑gain SPSA and Bures‑preconditioned SPSA performed worse, with accuracies of 51 % and 46 % respectively, indicating that two‑sample SPSA gradients suffer from high variance when optimizing many parameters over limited epochs.

By Nayan D'Souza, Christopher J. Agostino
arXiv AI
Sep 25

R-DEIM Net: An Efficient Rationale-Augmented Dual-Expert Interaction Model for Paraphrase Detection

R-DEIM Net is a 76‑million‑parameter dual‑expert model designed for paraphrase detection that balances accuracy with computational efficiency. It combines an Interaction Expert, which captures token‑level similarity via multi‑scale 2D convolutions and attention, with a Reasoning Expert that generates human‑readable rationales using a Flan‑T5‑small decoder. On the Quora Question Pairs dataset, the model attains 90.07% accuracy and 90.16% F1‑score, matching strong transformer baselines while producing auxiliary rationales.

By Pushp, Vaibhav Prajapati, Himangshu Sarma
arXiv AI
Sep 16

QART: A Quantum-Classical Hybrid Architecture for Long-Horizon Reasoning -- Exploring a Conditional Path toward Quantum Scaling

QART is a quantum‑classical hybrid architecture that augments a language model with quantum encoding, CIM‑based QUBO optimization, and quantum decoding to improve long‑horizon reasoning. The authors claim that, under certain assumptions, QART can maintain a non‑zero probability of recovering an optimal reasoning path while traditional autoregressive LLMs see their acceptance probability drop to zero as cumulative risk grows. Experiments on six benchmarks with three backbone models show that QART outperforms the baselines in 14 of 15 pairings, with relative gains up to 84.0% on SciCode.

By Lehao Lin, Yuheng Cheng, Guolong Liu, Yao Li, Xuning Tan, Xiyuan Zhou, Ruixi Zou, Shi Wang, Huan Zhao, Wenxuan Liu, Haifeng Wu, Junhua Zhao
arXiv Machine Learning
Sep 14

QTrans: A Quantum Transformer for Sentiment Classification

QTrans is a quantum transformer designed for small‑scale binary sentiment classification. It constructs query, key, and value features using parameterized quantum circuits and derives attention coefficients from Gaussian distances between quantum measurements. The model incorporates a quantum feed‑forward network, residual connections, and layer normalization, achieving higher accuracies on MR, CR, and MPQA datasets compared to classical baselines.

By Ren-Xin Zhao, Xinjie Huang, Yahong Liu, Maoyu Ye, Jinjing Shi, Shi Wang, Yaonan Wang
arXiv Machine Learning
Jun 26

Tailor Made Embeddings for Quantum Machine Learning

arXiv:2606. 26312v1 Announce Type: cross Abstract: Autoencoders transformed classical machine learning by solving the curse of dimensionality, enabling principled weight initialization and learning compact, structured representations.

By Aldo Lamarre, Dominik \v{S}afr\'anek