CLAQS: Compact Learnable All-Quantum Token Mixer with Shared-ansatz for Text Classification
2510.06532v1
quant-ph, cs.AI
2025-10-10
Авторы:
Junhao Chen, Yifan Zhou, Hanqi Jiang, Yi Pan, Yiwei Li, Huaqin Zhao, Wei Zhang, Yingfeng Wang, Tianming Liu
Abstract
Quantum compute is scaling fast, from cloud QPUs to high throughput GPU
simulators, making it timely to prototype quantum NLP beyond toy tasks.
However, devices remain qubit limited and depth limited, training can be
unstable, and classical attention is compute and memory heavy. This motivates
compact, phase aware quantum token mixers that stabilize amplitudes and scale
to long sequences. We present CLAQS, a compact, fully quantum token mixer for
text classification that jointly learns complex-valued mixing and nonlinear
transformations within a unified quantum circuit. To enable stable end-to-end
optimization, we apply l1 normalization to regulate amplitude scaling and
introduce a two-stage parameterized quantum architecture that decouples shared
token embeddings from a window-level quantum feed-forward module. Operating
under a sliding-window regime with document-level aggregation, CLAQS requires
only eight data qubits and shallow circuits, yet achieves 91.64% accuracy on
SST-2 and 87.08% on IMDB, outperforming both classical Transformer baselines
and strong hybrid quantum-classical counterparts.
Ссылки и действия
Дополнительные ресурсы: