Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2604.23931

Do Quantum Transformers Help? A Systematic VQC Architecture Comparison on Tabular Benchmarks

Chi-Sheng Chen, En-Jui Kuo

quant-phcs.AISubmitted Apr 27, 2026• Announced Apr 28, 2026• 0 citations• Revised Jul 7, 2026 (v2)
v1 · Apr 27, 2026v2 · Jul 7, 2026
arXivHTMLPDF

Abstract

Variational quantum circuits (VQCs) are a leading approach to quantum machine learning on near-term devices, yet it remains unclear which circuit architecture yields the best accuracy-parameter trade-off on classical tabular data. We present a systematic empirical comparison of four VQC families -- multi-layer fully-connected (FC-VQC), residual (ResNet-VQC), hybrid quantum-classical transformer (QT), and fully quantum transformer (FQT) -- across five regression and classification benchmarks. Our key findings are: \textbf{(i)}~FC-VQCs achieve 90-96\% of the $R^2$ of attention-based VQCs while using 40-50\% fewer parameters, and consistently outperform equal-capacity MLPs (mean $R^2{=}0.829$ vs.\ MLP$_{720}$'s $0.753$ on Boston Housing, 3-seed average); \textbf{(ii)}~FC-VQC's Type~4 inter-block connectivity provides partial cross-token mixing that approximates the role of attention -- explicit quantum self-attention yields only marginal gains on most datasets while significantly increasing parameter count; \textbf{(iii)}~expressibility saturates at circuit depth~${\approx}\,3$, explaining why shallow VQCs already cover the Hilbert space effectively; \textbf{(iv)}~LayerNorm on the fully quantum transformer improves classification accuracy, suggesting normalization is important when all operations are quantum; \textbf{(v)}~in our noise study on Boston Housing, FQT degrades gracefully under depolarizing noise while QT collapses. All results are validated across three random seeds. These findings provide practical architectural guidance for deploying VQCs on near-term quantum hardware.

Related papers

Scalable Quantum Machine Learning via Multi-layer Fully-Connected Variational Quantum Circuits

Howard Su, Chen-Yu Liu, Samuel Yen-Chi Chen +2 more

Variational quantum circuits (VQCs) face an expressivity-trainability dilemma and scalability challenges. We propose Multi-Layer Fully-Connected Variational Quantum Circuits (FC-VQC), a general-purpose quantum machine learning framework that connects local VQC blocks through measurement, deterministic parameter-free routing, and re-encoding. All trainable model parameters reside within the quantum blocks, without trainable classical neural components. We study fully connected, sliding-window, and parallel block mixing and analyze computational costs, conditional error propagation, and block information exchange. Using classical simulation, we evaluate tabular regression and classification, with our main comparison addressing spatio-temporal function approximation for the Black--Scholes, Burgers, and time-dependent oscillatory PDEs with up to $144$ spatial dimensions. Comparisons include neural-network, explicit angle-feature, tensor-network, and gradient-boosted-tree baselines. The results show that FC-VQC achieves the lowest trajectory relative MAE for all PDEs at the higher dimensions $d\in\{81,144\}$. Gradient-dynamics and depolarizing-noise experiments provide complementary empirical diagnostics of trainability and preliminary noise sensitivity.

quant-pharXiv:2602.16623•Feb 19, 2026•0 citations

Quantum Transformer BSDE Solver via Multi-Layer Fully-Connected Variational Quantum Circuits

Howard Su, Huan-Hsin Tseng, Chi-Sheng Chen +1 more

Solving high-dimensional parabolic partial differential equations (PDEs) is important in engineering, physics, and stochastic control. Deep BSDE methods reformulate semilinear PDEs as backward stochastic differential equations and admit a model-based reinforcement learning interpretation, where trajectories are generated from known stochastic dynamics while a trainable model learns the gradient-related control process. We propose a Quantum Transformer BSDE solver based on Multi-Layer Fully-Connected Variational Quantum Circuits (FC-VQC). The method treats the normalized state trajectory as time--coordinate tokens and applies causal self-attention to learn interactions in the adapted BSDE gradient process. All trainable model parameters are contained within the FC-VQC embedding, projection, feed-forward, and decoder modules, while attention and structural operations remain classical and parameter-free. Experiments on three d=36 PDE benchmarks show that QTransformer consistently improves over the non-attentive FC-VQC baseline and outperforms the classical Transformer at compact hidden widths, while the wider classical Transformer achieves the best overall accuracy. These results demonstrate that combining causal attention with FC-VQC provides an effective quantum architecture for high-dimensional BSDE trajectory learning.

quant-pharXiv:2607.25162•Jul 29, 2026•0 citations

Parameter Efficiency of Variational Quantum Circuits in Image Classification: The Role of Circuit Depth

Pranauv Muthuraman

The practical value of quantum machine learning must be derived from efficiency rather than scale, as current NISQ processors support only small, shallow circuits. This paper evaluated whether variational quantum circuits (VQCs) can reduce the trainable parameter count in an image classification scenario while preserving accuracy. Experimentation compared quantum classifier heads to parameter-matched classical heads on an identical set of frozen features drawn from the Fashion-MNIST dataset by a CNN. 9 configurations of a quantum circuit crossed 4, 6, and 8 qubits with 1, 2, and 4 entangling layers, each matched to a multilayer perceptron with an approximately equal parameter count. The linear probes served as a floor baseline for all 105 runs across 5 random seed values. 7 out of 9 quantum-based configurations met the mean test accuracy of no more than 1 percentage point below its matched classical head, enforced by the pre-specified criterion. The 2 failures were single-layer circuits, with each falling roughly 8 points below its matched classical head and 12 points below the circuit-free linear probe; in total, 6 configs with 2+ layers passed, with the smallest at 74 trainable parameters. The general trend noticed was that accuracy increased progressively with depth. The 4-layer circuits exceeded the linear probe at every qubit count and produced the highest accuracy at 6 and 8 qubits. The simulation ran noiselessly; VQCs preserved accuracy at the matched parameter budget when depth was given, showcasing depth rather than qubit count gating performance.

•Aug 15, 2026•0 citations

Variational Quantum Machine Learning for Binary Classification on NISQ Hardware: Expressibility, Trainability, and Noise Robustness

Priya S. Mehta, Aleksandr V. Korolev

This study investigates classification performance and trainability of variational quantum classifiers on near-term noisy quantum hardware across circuit depth and qubit count regimes within the context of quantum computing and machine learning, an area of growing scientific importance given its implications for hybrid quantum-classical algorithm design and practical NISQ hardware benchmarking for near-term quantum advantage assessment. Using gradient-based parameter optimization of parameterized quantum circuits with hardware noise modeling via density matrix simulation and physical execution on IBM Eagle processors, we examine expressibility of parameterized circuits enabling nonlinear decision boundaries in feature Hilbert space, with trainability constrained by barren plateau gradients at large qubit counts in 96 circuit architectures (4 qubit counts x 4 depths x 6 ansatz families) evaluated across 5 classification datasets with 20 random initialization seeds each drawn from IBM Quantum Eagle (127-qubit) and Falcon (27-qubit) processors with noise mitigation via zero-noise extrapolation. Results indicate that 10-qubit, 4-layer VQC achieves 84.2% classification accuracy on the best benchmark, within 3.8 percentage points of classical SVM, but gradient variance decays exponentially with qubit count (variance halving per 2 added qubits), confirming barren plateau scaling (p < 0.001), with 84.2% accuracy, 3.8 pp gap to classical SVM baseline as the primary quantitative benchmark. Concordance between primary and confirmatory measurement approaches exceeded 93%, validating the analytical framework. These findings contribute empirically to quantum computing and machine learning and carry actionable implications for the design of programs and policies targeting hybrid quantum-classical algorithm design and practical NISQ hardware benchmarking for near-term quantum advantage assessment.

Princeton Journal of Pre-Collegiate Research•Jan 1, 2021•0 citations

A Primer on Quantum Neural Network Model for Text Classification: From Concept to Design

Annysha Huzzat, Ahmed Shaharyar Khwaja, Bhagawat Adhikari +3 more

Quantum neural networks (QNNs) have recently attracted remarkable attention as a potential alternative to classical and deep neural network (NN) models particularly under constraints imposed by noisy intermediate-scale quantum (NISQ) devices, which support only shallow circuits with few quantum bits (qubits) and limited variational depth. However, applying QNNs to natural language processing (NLP) remains challenging because text representations are typically high-dimensional, while NISQ classifiers can only encode a small number of features at a time, requiring classical compression to enable stable training and flexible circuit configuration. In addition, many existing studies integrate QNNs into rich-text representation pipelines, where the quantum circuit is often implemented as a variational quantum circuit (VQC). Here, the VQC acts as an additional component within a larger model, and it remains unclear how the quantum component improves the classification task. Therefore, in this work, we propose a fully reproducible and compact QNN pipeline that provides a controlled setting for studying the contribution of the VQC to text classification. The model is trained end-to-end with a lightweight classical compression layer, and the overall study is supported by systematic ablation analyses of the compression layer, the classifier heads under a shared frozen low-dimensional representation, and quantum circuit structure. Our model uses the term frequency-inverse document frequency (TF-IDF) features with linear compression followed by a shallow four-qubit, two-layer VQC, implemented in PyTorch and PennyLane for end-to-end training. It is evaluated on five benchmark text classification datasets against classical baselines, including logistic regression and multilayer perceptron (MLP) models. Experimental results show that the proposed QNN achieves a competitive performance across all evaluated datasets, yielding the best results on three of the five benchmark datasets.

IEEE Access•Jan 1, 2026•0 citations

Variational Quantum Circuits for Machine Learning Applications

Noah Costa, Jonas Rossi, Sofia Costa

Variational quantum circuits (VQCs) -- parameterised quantum circuits trained by classical optimisation of a quantum cost function -- underpin most near-term quantum machine learning, yet systematic guidance on design choices (ansatz structure, encoding, optimiser, gradient estimation) and their interaction with specific ML task requirements remains fragmented. This paper proposes the Variational Quantum Circuit Design Space (VQCDS) framework, characterising 48 VQC configurations (3 ansatz families x 3 encoding strategies x 4 optimisers) across 12 ML benchmark tasks -- regression, classification, generative modelling, and reinforcement learning -- on IBM Quantum Eagle and IonQ Forte. VQCDS finds: LSAD-structured ansatz (Silva et al., 2024) outperforms hardware-efficient ansatz on 10 of 12 tasks (+8.0pp mean AUC, 2.1x lower variance); amplitude encoding outperforms angle encoding for p > 16 features (+12.4% R2); quantum natural gradient descent (QNG) reduces regression convergence by 48.4% vs. Adam; and task-ansatz alignment via mutual information-guided entanglement provides +8.4pp AUC and +14.4% R2 across task types. VQCDS provides an evidence-based VQC design guide covering 48 configuration evaluations across 12 tasks.

Quantum Frontiers Journal•Mar 28, 2025•0 citations
Variational quantum circuits (VQCs) are a leading approach to quantum machine learning on near-term devices, yet it remains unclear which circuit architecture yields the best accuracy-parameter trade-off on classical tabular data. We present a systematic empirical comparison of four VQC families -- multi-layer fully-connected (FC-VQC), residual (ResNet-VQC), hybrid quantum-classical transformer (QT), and fully quantum transformer (FQT) -- across five regression and classification benchmarks. Our key findings are: \textbf{(i)}~FC-VQCs achieve 90-96% of the R2R^2R2 of attention-based VQCs while using 40-50% fewer parameters, and consistently outperform equal-capacity MLPs (mean R2=0.829R^2{=}0.829R2=0.829 vs.\ MLP720_{720}720​'s 0.7530.7530.753 on Boston Housing, 3-seed average); \textbf{(ii)}FC-VQC's Type4 inter-block connectivity provides partial cross-token mixing that approximates the role of attention -- explicit quantum self-attention yields only marginal gains on most datasets while significantly increasing parameter count; \textbf{(iii)}expressibility saturates at circuit depth≈ 3{\approx}\,3≈3, explaining why shallow VQCs already cover the Hilbert space effectively; \textbf{(iv)}~LayerNorm on the fully quantum transformer improves classification accuracy, suggesting normalization is important when all operations are quantum; \textbf{(v)}~in our noise study on Boston Housing, FQT degrades gracefully under depolarizing noise while QT collapses. All results are validated across three random seeds. These findings provide practical architectural guidance for deploying VQCs on near-term quantum hardware.
Variational quantum circuits (VQCs) face an expressivity-trainability dilemma and scalability challenges. We propose Multi-Layer Fully-Connected Variational Quantum Circuits (FC-VQC), a general-purpose quantum machine learning framework that connects local VQC blocks through measurement, deterministic parameter-free routing, and re-encoding. All trainable model parameters reside within the quantum blocks, without trainable classical neural components. We study fully connected, sliding-window, and parallel block mixing and analyze computational costs, conditional error propagation, and block information exchange. Using classical simulation, we evaluate tabular regression and classification, with our main comparison addressing spatio-temporal function approximation for the Black--Scholes, Burgers, and time-dependent oscillatory PDEs with up to 144144144 spatial dimensions. Comparisons include neural-network, explicit angle-feature, tensor-network, and gradient-boosted-tree baselines. The results show that FC-VQC achieves the lowest trajectory relative MAE for all PDEs at the higher dimensions d∈{81,144}d\in\{81,144\}d∈{81,144}. Gradient-dynamics and depolarizing-noise experiments provide complementary empirical diagnostics of trainability and preliminary noise sensitivity.
Solving high-dimensional parabolic partial differential equations (PDEs) is important in engineering, physics, and stochastic control. Deep BSDE methods reformulate semilinear PDEs as backward stochastic differential equations and admit a model-based reinforcement learning interpretation, where trajectories are generated from known stochastic dynamics while a trainable model learns the gradient-related control process. We propose a Quantum Transformer BSDE solver based on Multi-Layer Fully-Connected Variational Quantum Circuits (FC-VQC). The method treats the normalized state trajectory as time--coordinate tokens and applies causal self-attention to learn interactions in the adapted BSDE gradient process. All trainable model parameters are contained within the FC-VQC embedding, projection, feed-forward, and decoder modules, while attention and structural operations remain classical and parameter-free. Experiments on three d=36 PDE benchmarks show that QTransformer consistently improves over the non-attentive FC-VQC baseline and outperforms the classical Transformer at compact hidden widths, while the wider classical Transformer achieves the best overall accuracy. These results demonstrate that combining causal attention with FC-VQC provides an effective quantum architecture for high-dimensional BSDE trajectory learning.
The practical value of quantum machine learning must be derived from efficiency rather than scale, as current NISQ processors support only small, shallow circuits. This paper evaluated whether variational quantum circuits (VQCs) can reduce the trainable parameter count in an image classification scenario while preserving accuracy. Experimentation compared quantum classifier heads to parameter-matched classical heads on an identical set of frozen features drawn from the Fashion-MNIST dataset by a CNN. 9 configurations of a quantum circuit crossed 4, 6, and 8 qubits with 1, 2, and 4 entangling layers, each matched to a multilayer perceptron with an approximately equal parameter count. The linear probes served as a floor baseline for all 105 runs across 5 random seed values. 7 out of 9 quantum-based configurations met the mean test accuracy of no more than 1 percentage point below its matched classical head, enforced by the pre-specified criterion. The 2 failures were single-layer circuits, with each falling roughly 8 points below its matched classical head and 12 points below the circuit-free linear probe; in total, 6 configs with 2+ layers passed, with the smallest at 74 trainable parameters. The general trend noticed was that accuracy increased progressively with depth. The 4-layer circuits exceeded the linear probe at every qubit count and produced the highest accuracy at 6 and 8 qubits. The simulation ran noiselessly; VQCs preserved accuracy at the matched parameter budget when depth was given, showcasing depth rather than qubit count gating performance.
This study investigates classification performance and trainability of variational quantum classifiers on near-term noisy quantum hardware across circuit depth and qubit count regimes within the context of quantum computing and machine learning, an area of growing scientific importance given its implications for hybrid quantum-classical algorithm design and practical NISQ hardware benchmarking for near-term quantum advantage assessment. Using gradient-based parameter optimization of parameterized quantum circuits with hardware noise modeling via density matrix simulation and physical execution on IBM Eagle processors, we examine expressibility of parameterized circuits enabling nonlinear decision boundaries in feature Hilbert space, with trainability constrained by barren plateau gradients at large qubit counts in 96 circuit architectures (4 qubit counts x 4 depths x 6 ansatz families) evaluated across 5 classification datasets with 20 random initialization seeds each drawn from IBM Quantum Eagle (127-qubit) and Falcon (27-qubit) processors with noise mitigation via zero-noise extrapolation. Results indicate that 10-qubit, 4-layer VQC achieves 84.2% classification accuracy on the best benchmark, within 3.8 percentage points of classical SVM, but gradient variance decays exponentially with qubit count (variance halving per 2 added qubits), confirming barren plateau scaling (p < 0.001), with 84.2% accuracy, 3.8 pp gap to classical SVM baseline as the primary quantitative benchmark. Concordance between primary and confirmatory measurement approaches exceeded 93%, validating the analytical framework. These findings contribute empirically to quantum computing and machine learning and carry actionable implications for the design of programs and policies targeting hybrid quantum-classical algorithm design and practical NISQ hardware benchmarking for near-term quantum advantage assessment.
Quantum neural networks (QNNs) have recently attracted remarkable attention as a potential alternative to classical and deep neural network (NN) models particularly under constraints imposed by noisy intermediate-scale quantum (NISQ) devices, which support only shallow circuits with few quantum bits (qubits) and limited variational depth. However, applying QNNs to natural language processing (NLP) remains challenging because text representations are typically high-dimensional, while NISQ classifiers can only encode a small number of features at a time, requiring classical compression to enable stable training and flexible circuit configuration. In addition, many existing studies integrate QNNs into rich-text representation pipelines, where the quantum circuit is often implemented as a variational quantum circuit (VQC). Here, the VQC acts as an additional component within a larger model, and it remains unclear how the quantum component improves the classification task. Therefore, in this work, we propose a fully reproducible and compact QNN pipeline that provides a controlled setting for studying the contribution of the VQC to text classification. The model is trained end-to-end with a lightweight classical compression layer, and the overall study is supported by systematic ablation analyses of the compression layer, the classifier heads under a shared frozen low-dimensional representation, and quantum circuit structure. Our model uses the term frequency-inverse document frequency (TF-IDF) features with linear compression followed by a shallow four-qubit, two-layer VQC, implemented in PyTorch and PennyLane for end-to-end training. It is evaluated on five benchmark text classification datasets against classical baselines, including logistic regression and multilayer perceptron (MLP) models. Experimental results show that the proposed QNN achieves a competitive performance across all evaluated datasets, yielding the best results on three of the five benchmark datasets.
Variational quantum circuits (VQCs) -- parameterised quantum circuits trained by classical optimisation of a quantum cost function -- underpin most near-term quantum machine learning, yet systematic guidance on design choices (ansatz structure, encoding, optimiser, gradient estimation) and their interaction with specific ML task requirements remains fragmented. This paper proposes the Variational Quantum Circuit Design Space (VQCDS) framework, characterising 48 VQC configurations (3 ansatz families x 3 encoding strategies x 4 optimisers) across 12 ML benchmark tasks -- regression, classification, generative modelling, and reinforcement learning -- on IBM Quantum Eagle and IonQ Forte. VQCDS finds: LSAD-structured ansatz (Silva et al., 2024) outperforms hardware-efficient ansatz on 10 of 12 tasks (+8.0pp mean AUC, 2.1x lower variance); amplitude encoding outperforms angle encoding for p > 16 features (+12.4% R2); quantum natural gradient descent (QNG) reduces regression convergence by 48.4% vs. Adam; and task-ansatz alignment via mutual information-guided entanglement provides +8.4pp AUC and +14.4% R2 across task types. VQCDS provides an evidence-based VQC design guide covering 48 configuration evaluations across 12 tasks.