Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Barren Plateau Mitigation in Quantum Neural Networks: An Empirical and Artifact-Level Comparison of Layerwise Training and Local Cost Functions

Fahad Abdullah, Farhan Riaz, Asma Zubair

Published Aug 6, 2026• 0 citations
Publisher

Abstract

This work presents a systematic empirical study of techniques for mitigating the barren plateau phenomena in quantum neural networks (QNNs). We conduct 45 controlled experiments for binary MNIST classification of digits 3 and 6 using a computational benchmark built using TensorFlow Quantum. We compare three different training procedures: a standard baseline setup, an incremental layerwise learning curriculum and a protocol based on local cost functions. For 8 layers we see mean accuracies of 73.9% and 75.4% for layerwise and local-cost interventions (over five stochastic seeds). The baseline setting drops from about 74% at 4 and 6 layers to 52.7% at 8 layers. Statistical reconstruction of the 8-layer regime suggests that the difference of 1.5 percentage points between layerwise and local-cost methods is not statistically significant, but both strategies are statistically significantly different from the baseline (one-way ANOVA F = 138.90; Welch tests p < 1.5 × 10−5). These results also suggest that practical training degradation is possible even when gradient magnitudes are above a conventional barren plateau detection threshold, highlighting the significance of continuous indicators for trainability, rather than binary threshold-based diagnostics.

DOI
10.5281/zenodo.21818778

Related papers

Cost-Function Locality and Trainability Diagnostics for Quantum Neural Networks: An Empirical and Artifact-Level Study of Layerwise and Local-Cost Training

Fahad Abdullah, Asma Zubair, Farhan Riaz

We report an empirical study of how quantum neural networks (QNNs) train under global and local costfunctions, with layerwise training included as a third point of comparison. The main experiment is a set of 180 training runson binary MNIST (digits 3 and 6), using an 8-qubit hardware-efficient ansatz written in TensorFlow Quantum. A second,separate study measures gradient landscapes at a fixed input across 48 circuit configurations with 4 to 10 qubits. Wecompare three procedures: end-to-end training with a global product-Z readout (the baseline), a layerwise curriculum thatreuses trained parameters between stages, and training on a local averaged-Z cost. Test accuracy barely moves betweenmethods. The global baseline still reaches 87.2% at 8 layers, so we see no accuracy collapse in this regime, andmatched-seed tests at 8 layers find no significant difference (Friedman p = 0.654; every pairwise paired test isnon-significant, as are the tests at 4 and 6 layers). Gradient statistics tell the methods apart much more clearly. At depths 4,6 and 8, the local cost ends training with 1.5 to 2.4 times lower gradient variance than the global baseline (paired p <= 9.4x 10⁻³ after Holm correction; Cohen's d_z up to 2.3). It also costs far more to simulate at depth: 6.57 h per run at 8 layers,against 1.66 h for the baseline. In the landscape study, the local observable's gradient variance is 1.4 to 10 times lower thanthe global observable's over the whole configuration grid, and 4 to 10 times lower at depth 8. Layerwise training follows adifferent path, with gradient variance falling during optimization, yet it gives no

•Oct 19, 2026•0 citations

Benchmarking Barren Plateau Mitigation Strategies in Quantum Neural Networks on Standard and Medical Image Datasets

Maqsudur Rahman, Rui Liu, Anup Majumder +8 more

Barren plateaus (BPs) pose a major trainability challenge for quantum neural networks (QNNs) by causing gradients to concentrate near zero as circuit size, depth, or expressibility increases. This study presents a comparative benchmark of 10 BP mitigation strategies across six qubit settings (2, 4, 8, 12, 16, and 20) and three datasets of increasing complexity: Iris, MNIST, and MedMNIST. The evaluated methods include eight initialization-based strategies (Beta, Gaussian, Uniform Norm, CNN-based initialization, He-normal, He-uniform, Xavier-normal, and Xavier-uniform), one model-based variational encoder, and one optimization-based time-nonlocal Fourier parameterization. Experiments were implemented using PennyLane 3.10 and PyTorch 2.5 with simulator backends. We evaluate trainability using gradient variance and training loss, and we clarify that the benchmark analyzes simulated QNN optimization behavior rather than hardware-noise-resilient or noisy-label learning. Across the tested two-layer circuit configurations, the mitigation strategies maintained measurable gradient variance and stable loss reduction, suggesting that severe barren plateau behavior was not observed under the benchmark conditions. CNN-based and Beta initialization showed strong empirical behavior in variance retention and convergence speed, while Gaussian initialization was comparatively weaker in higher-dimensional settings. The study provides a reproducible benchmark structure for comparing BP mitigation behavior and identifies important limitations related to circuit depth, hardware noise, feature encoding, and classification performance that should be addressed in future QNN benchmarking.

Journal of Imaging•Jun 23, 2026•0 citations

Barren Plateau Mitigation in Quantum Neural Networks: An Empirical and Artifact-Level Comparison of Layerwise Training and Local Cost Functions

Fahad Abdullah, Asma Zubair, Farhan Riaz

•Aug 5, 2026•0 citations

Layerwise learning for quantum neural networks

Andrea Skolik, Jarrod R. McClean, Masoud Mohseni +2 more

Abstract With the increased focus on quantum circuit learning for near-term applications on quantum devices, in conjunction with unique challenges presented by cost function landscapes of parametrized quantum circuits, strategies for effective training are becoming increasingly important. In order to ameliorate some of these challenges, we investigate a layerwise learning strategy for parametrized quantum circuits. The circuit depth is incrementally grown during optimization, and only subsets of parameters are updated in each training step. We show that when considering sampling noise, this strategy can help avoid the problem of barren plateaus of the error surface due to the low depth of circuits, low number of parameters trained in one step, and larger magnitude of gradients compared to training the full circuit. These properties make our algorithm preferable for execution on noisy intermediate-scale quantum devices. We demonstrate our approach on an image-classification task on handwritten digits, and show that layerwise learning attains an 8% lower generalization error on average in comparison to standard learning schemes for training quantum circuits of the same size. Additionally, the percentage of runs that reach lower test errors is up to 40% larger compared to training the full circuit, which is susceptible to creeping onto a plateau during training.

arXiv:2006.14904•Quantum Machine Intelligence•Jan 25, 2021•321 citations

Beyond Barren Plateaus: A Scalable Quantum Convolutional Architecture for High-Fidelity Image Classification

Radhakrishnan Delhibabu

While Quantum Convolutional Neural Networks (QCNNs) offer a theoretical paradigm for quantum machine learning, their practical implementation is severely bottlenecked by barren plateaus -- the exponential vanishing of gradients -- and poor empirical accuracy compared to classical counterparts. In this work, we propose a novel QCNN architecture utilizing localized cost functions and a hardware-efficient tensor-network initialization strategy to provably mitigate barren plateaus. We evaluate our scalable QCNN on the MNIST dataset, demonstrating a significant performance leap. By resolving the gradient vanishing issue, our optimized QCNN achieves a classification accuracy of 98.7\%, a substantial improvement over the baseline QCNN accuracy of 52.32\% found in unmitigated models. Furthermore, we provide empirical evidence of a parameter-efficiency advantage, requiring $\mathcal{O}(\log N)$ fewer trainable parameters than equivalent classical CNNs to achieve $>95\%$ convergence. This work bridges the gap between theoretical quantum utility and practical application, providing a scalable framework for quantum computer vision tasks without succumbing to loss landscape concentration.

arXiv:2603.11131•Mar 11, 2026•0 citations

Modeling quantum neural network gradient with reinforcement learning

Nhan Trong Luu, Duong Trung Luu, Nam Ngoc Pham +1 more

Training quantum neural networks (QNNs) on near-term hardware remains hampered by two compounding difficulties: the exponential vanishing of gradient variance known as the barren plateau, and the $\mathcal{O}(L \cdot 2^n)$ time and memory cost of differentiating through an $n$-qubit, $L$-layer circuit. We propose RLQ-Grad, a reinforcement-learning-based optimizer in which a classical policy $π_φ$ (a spectrally-normalized PPO agent) learns to propose parameter updates directly, conditioned on the QNN's current parameters, loss, accuracy, and previous update. Because the surrogate gradient is emitted by a classical network rather than obtained by differentiating through the unitary $U(θ)$, its variance is not constrained by the barren plateau concentration bound, and its cost scales with the number of trainable parameters rather than the Hilbert-space dimension. We prove these properties formally and verify them on a hardware-efficient ansatz across four supervised benchmarks with up to $n=20$ qubits. RLQ-Grad preserves a near-flat gradient-variance curve where backpropagation, parameter-shift, and adjoint differentiation decay by 1 to 2 orders of magnitude. Accounting for the full training pipeline (PPO rollouts, actor-critic updates, and optimizer states), RLQ-Grad needs under 2 MB of memory and runs $2490\times$, $7876\times$, and $673\times$ faster per iteration than these three methods at $n=20$. It improves top-1 accuracy by up to $+10\%$ over gradient-based baselines on circuits of up to 12 qubits, and matches dedicated barren plateau mitigation methods on CIFAR-10 at 14 to 20 qubits, where evolutionary and gradient-free optimizers collapse to chance.

quant-pharXiv:2609.31066•Sep 28, 2026•1 citation
This work presents a systematic empirical study of techniques for mitigating the barren plateau phenomena in quantum neural networks (QNNs). We conduct 45 controlled experiments for binary MNIST classification of digits 3 and 6 using a computational benchmark built using TensorFlow Quantum. We compare three different training procedures: a standard baseline setup, an incremental layerwise learning curriculum and a protocol based on local cost functions. For 8 layers we see mean accuracies of 73.9% and 75.4% for layerwise and local-cost interventions (over five stochastic seeds). The baseline setting drops from about 74% at 4 and 6 layers to 52.7% at 8 layers. Statistical reconstruction of the 8-layer regime suggests that the difference of 1.5 percentage points between layerwise and local-cost methods is not statistically significant, but both strategies are statistically significantly different from the baseline (one-way ANOVA F = 138.90; Welch tests p < 1.5 × 10−5). These results also suggest that practical training degradation is possible even when gradient magnitudes are above a conventional barren plateau detection threshold, highlighting the significance of continuous indicators for trainability, rather than binary threshold-based diagnostics.
We report an empirical study of how quantum neural networks (QNNs) train under global and local costfunctions, with layerwise training included as a third point of comparison. The main experiment is a set of 180 training runson binary MNIST (digits 3 and 6), using an 8-qubit hardware-efficient ansatz written in TensorFlow Quantum. A second,separate study measures gradient landscapes at a fixed input across 48 circuit configurations with 4 to 10 qubits. Wecompare three procedures: end-to-end training with a global product-Z readout (the baseline), a layerwise curriculum thatreuses trained parameters between stages, and training on a local averaged-Z cost. Test accuracy barely moves betweenmethods. The global baseline still reaches 87.2% at 8 layers, so we see no accuracy collapse in this regime, andmatched-seed tests at 8 layers find no significant difference (Friedman p = 0.654; every pairwise paired test isnon-significant, as are the tests at 4 and 6 layers). Gradient statistics tell the methods apart much more clearly. At depths 4,6 and 8, the local cost ends training with 1.5 to 2.4 times lower gradient variance than the global baseline (paired p <= 9.4x 10⁻³ after Holm correction; Cohen's d_z up to 2.3). It also costs far more to simulate at depth: 6.57 h per run at 8 layers,against 1.66 h for the baseline. In the landscape study, the local observable's gradient variance is 1.4 to 10 times lower thanthe global observable's over the whole configuration grid, and 4 to 10 times lower at depth 8. Layerwise training follows adifferent path, with gradient variance falling during optimization, yet it gives no
Barren plateaus (BPs) pose a major trainability challenge for quantum neural networks (QNNs) by causing gradients to concentrate near zero as circuit size, depth, or expressibility increases. This study presents a comparative benchmark of 10 BP mitigation strategies across six qubit settings (2, 4, 8, 12, 16, and 20) and three datasets of increasing complexity: Iris, MNIST, and MedMNIST. The evaluated methods include eight initialization-based strategies (Beta, Gaussian, Uniform Norm, CNN-based initialization, He-normal, He-uniform, Xavier-normal, and Xavier-uniform), one model-based variational encoder, and one optimization-based time-nonlocal Fourier parameterization. Experiments were implemented using PennyLane 3.10 and PyTorch 2.5 with simulator backends. We evaluate trainability using gradient variance and training loss, and we clarify that the benchmark analyzes simulated QNN optimization behavior rather than hardware-noise-resilient or noisy-label learning. Across the tested two-layer circuit configurations, the mitigation strategies maintained measurable gradient variance and stable loss reduction, suggesting that severe barren plateau behavior was not observed under the benchmark conditions. CNN-based and Beta initialization showed strong empirical behavior in variance retention and convergence speed, while Gaussian initialization was comparatively weaker in higher-dimensional settings. The study provides a reproducible benchmark structure for comparing BP mitigation behavior and identifies important limitations related to circuit depth, hardware noise, feature encoding, and classification performance that should be addressed in future QNN benchmarking.
Abstract With the increased focus on quantum circuit learning for near-term applications on quantum devices, in conjunction with unique challenges presented by cost function landscapes of parametrized quantum circuits, strategies for effective training are becoming increasingly important. In order to ameliorate some of these challenges, we investigate a layerwise learning strategy for parametrized quantum circuits. The circuit depth is incrementally grown during optimization, and only subsets of parameters are updated in each training step. We show that when considering sampling noise, this strategy can help avoid the problem of barren plateaus of the error surface due to the low depth of circuits, low number of parameters trained in one step, and larger magnitude of gradients compared to training the full circuit. These properties make our algorithm preferable for execution on noisy intermediate-scale quantum devices. We demonstrate our approach on an image-classification task on handwritten digits, and show that layerwise learning attains an 8% lower generalization error on average in comparison to standard learning schemes for training quantum circuits of the same size. Additionally, the percentage of runs that reach lower test errors is up to 40% larger compared to training the full circuit, which is susceptible to creeping onto a plateau during training.
While Quantum Convolutional Neural Networks (QCNNs) offer a theoretical paradigm for quantum machine learning, their practical implementation is severely bottlenecked by barren plateaus -- the exponential vanishing of gradients -- and poor empirical accuracy compared to classical counterparts. In this work, we propose a novel QCNN architecture utilizing localized cost functions and a hardware-efficient tensor-network initialization strategy to provably mitigate barren plateaus. We evaluate our scalable QCNN on the MNIST dataset, demonstrating a significant performance leap. By resolving the gradient vanishing issue, our optimized QCNN achieves a classification accuracy of 98.7\%, a substantial improvement over the baseline QCNN accuracy of 52.32\% found in unmitigated models. Furthermore, we provide empirical evidence of a parameter-efficiency advantage, requiring O(log⁡N)\mathcal{O}(\log N)O(logN) fewer trainable parameters than equivalent classical CNNs to achieve >95%>95\%>95% convergence. This work bridges the gap between theoretical quantum utility and practical application, providing a scalable framework for quantum computer vision tasks without succumbing to loss landscape concentration.
Training quantum neural networks (QNNs) on near-term hardware remains hampered by two compounding difficulties: the exponential vanishing of gradient variance known as the barren plateau, and the O(L⋅2n)\mathcal{O}(L \cdot 2^n)O(L⋅2n) time and memory cost of differentiating through an nnn-qubit, LLL-layer circuit. We propose RLQ-Grad, a reinforcement-learning-based optimizer in which a classical policy πφπ_φπφ​ (a spectrally-normalized PPO agent) learns to propose parameter updates directly, conditioned on the QNN's current parameters, loss, accuracy, and previous update. Because the surrogate gradient is emitted by a classical network rather than obtained by differentiating through the unitary U(θ)U(θ)U(θ), its variance is not constrained by the barren plateau concentration bound, and its cost scales with the number of trainable parameters rather than the Hilbert-space dimension. We prove these properties formally and verify them on a hardware-efficient ansatz across four supervised benchmarks with up to n=20n=20n=20 qubits. RLQ-Grad preserves a near-flat gradient-variance curve where backpropagation, parameter-shift, and adjoint differentiation decay by 1 to 2 orders of magnitude. Accounting for the full training pipeline (PPO rollouts, actor-critic updates, and optimizer states), RLQ-Grad needs under 2 MB of memory and runs 2490×2490\times2490×, 7876×7876\times7876×, and 673×673\times673× faster per iteration than these three methods at n=20n=20n=20. It improves top-1 accuracy by up to +10%+10\%+10% over gradient-based baselines on circuits of up to 12 qubits, and matches dedicated barren plateau mitigation methods on CIFAR-10 at 14 to 20 qubits, where evolutionary and gradient-free optimizers collapse to chance.