Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Impact of Barren Plateaus on the Hessian and Higher Order Derivatives

Marco Cerezo, Patrick J. Coles

Published Aug 17, 2020• 15 citations
OpenAlex

Abstract

The Barren Plateau (BP) phenomenon is an issue for certain quantum neural networks and variational quantum algorithms, whereby the gradient vanishes exponentially in the system size $n$. The question of whether high-order derivative information such as the Hessian could help escape a BP was recently posed in the literature. Here we show that the elements of the Hessian are exponentially suppressed in a BP, so estimating the Hessian in this situation would require a precision that scales exponentially with $n$. Hence, Hessian-based approaches do not circumvent the exponential scaling associated with BPs. We also show the exponential suppression of higher order derivatives. Hence, BPs will impact optimization strategies that go beyond (first-order) gradient descent.

Related papers

Higher order derivatives of quantum neural networks with barren plateaus

Marco Cerezo, Patrick J. Coles

Abstract Quantum neural networks (QNNs) offer a powerful paradigm for programming near-term quantum computers and have the potential to speed up applications ranging from data science to chemistry to materials science. However, a possible obstacle to realizing that speed-up is the barren plateau (BP) phenomenon, whereby the gradient vanishes exponentially in the system size n for certain QNN architectures. The question of whether high-order derivative information such as the Hessian could help escape a BP was recently posed in the literature. Here we show that the elements of the Hessian are exponentially suppressed in a BP, so estimating the Hessian in this situation would require a precision that scales exponentially with n . Hence, Hessian-based approaches do not circumvent the exponential scaling associated with BPs. We also show the exponential suppression of higher order derivatives. Hence, BPs will impact optimization strategies that go beyond (first-order) gradient descent. In deriving our results, we prove novel, general formulas that can be used to analytically evaluate any high-order partial derivative on quantum hardware. These formulas will likely have independent interest and use for training QNNs (outside of the context of BPs).

arXiv:2008.07454•Quantum Science and Technology•Apr 6, 2021•118 citations

Effect of barren plateaus on gradient-free optimization

Andrew Arrasmith, M. Cerezo, Piotr Czarnik +2 more

Barren plateau landscapes correspond to gradients that vanish exponentially in the number of qubits. Such landscapes have been demonstrated for variational quantum algorithms and quantum neural networks with either deep circuits or global cost functions. For obvious reasons, it is expected that gradient-based optimizers will be significantly affected by barren plateaus. However, whether or not gradient-free optimizers are impacted is a topic of debate, with some arguing that gradient-free approaches are unaffected by barren plateaus. Here we show that, indeed, gradient-free optimizers do not solve the barren plateau problem. Our main result proves that cost function differences, which are the basis for making decisions in a gradient-free optimization, are exponentially suppressed in a barren plateau. Hence, without exponential precision, gradient-free optimizers will not make progress in the optimization. We numerically confirm this by training in a barren plateau with several gradient-free optimizers (Nelder-Mead, Powell, and COBYLA algorithms), and show that the numbers of shots required in the optimization grows exponentially with the number of qubits.

arXiv:2011.12245•Quantum•Oct 5, 2021•248 citations

From Barren Plateaus to SPSA Optimization in Variational Quantum Eigensolvers

Zhen Qin

The barren plateau (BP) phenomenon poses a fundamental challenge to the trainability of variational quantum eigensolvers (VQEs) by causing exponentially vanishing gradients as the system size increases. While extensive studies have investigated the geometric origins of BP, its impact on the optimization dynamics and complexity of practical algorithms under finite-shot measurements has received comparatively less attention. In this paper, we develop a theoretical framework that characterizes how the BP affects the optimization dynamics of the Simultaneous Perturbation Stochastic Approximation (SPSA) algorithm and quantifies the resulting iteration complexity and measurement budget. We derive non-asymptotic bias and variance bounds for the SPSA gradient estimator, introduce a signal-to-noise ratio (SNR) defined as the ratio of the gradient energy to the mean squared error of the estimator, and establish convergence guarantees for SPSA under finite-shot measurements. Our results show that, under the proposed parameter schedules, the number of iterations sufficient to guarantee a fixed relative first-order stationarity level scales polynomially with the inverse of the intrinsic gradient energy. Consequently, when this energy decays exponentially under BP, the resulting guaranteed iteration complexity and total measurement budget both grow exponentially with the number of qubits.

quant-pharXiv:2608.09810•Aug 11, 2026•0 citations

Avoiding barren plateaus with classical deep neural networks

Lucas Friedrich, Jonas Maziero

Variational quantum algorithms (VQAs) are among the most promising algorithms in the era of noisy intermediate scale quantum devices. Such algorithms are constructed using a parametrization $U(\ensuremath{\theta}$) with a classical optimizer that updates the parameters $\ensuremath{\theta}$ in order to minimize a cost function $C$. For this task, in general the gradient descent method, or one of its variants, is used. This is a method where the circuit parameters are updated iteratively using the cost function gradient. However, several works in the literature have shown that this method suffers from a phenomenon known as the barren plateaus (BPs). In this paper, we propose a method to mitigate BPs. In general, the parameters $\ensuremath{\theta}$ used in the parametrization $U$ are randomly generated. In our method they are obtained from a classical neural network (CNN). We show that this method, besides to being able to mitigate BPs during startup, is also able to mitigate the effect of BPs during the VQA training. In addition, we also show how this method behaves for different CNN architectures.

arXiv:2205.13418•Physical Review A•Oct 20, 2022•49 citations

Investigating and mitigating barren plateaus in variational quantum circuits: a survey

Jack Cunningham, Jun Zhuang

Abstract In recent years, variational quantum circuits (VQCs) have been widely explored to advance quantum circuits against classic models on various domains, such as quantum chemistry and quantum machine learning. Similar to classic machine-learning models, VQCs can be trained through various optimization approaches, such as gradient-based or gradient-free methods. However, when employing gradient-based methods, the gradient variance of VQCs may dramatically vanish as the number of qubits or layers increases. This issue, a.k.a. barren plateaus (BPs), seriously hinders the scaling of VQCs on large datasets. To mitigate the barren plateaus, extensive efforts have been devoted to tackling this issue through diverse strategies. In this survey, we conduct a systematic literature review of recent works from both investigation and mitigation perspectives. Furthermore, we propose a new taxonomy to categorize most existing mitigation strategies into five groups and introduce them in detail. Also, we compare the concurrent survey papers about BPs. Finally, we provide insightful discussion on future directions for BPs.

arXiv:2407.17706•Quantum Information Processing•Jan 31, 2025•39 citations

Barren Plateaus and Trainability of Hybrid Quantum-Classical Algorithms

Celepci-Uludag, Dilara

Realizing successful quantum algorithms on current generation of quantum hardware depends on developing appropriate parametrized quantum circuits, which are the quantum computing counterpart to classical neural networks. A key consideration in this context is the algorithm’s trainability that can be hindered by the existence of so-called barren plateaus. In this case, the algorithm suffers from exponentially vanishing gradients as the number of qubits increases, resulting in a flat optimization landscape and making an efficient training intractable. Due to its serious impact on the success of such algorithms, this problem has gained substantial attention in recent years of quantum computing research. Theoretical and heuristic approaches have been proposed to investigate, avoid and mitigate this issue. In this work, we explore this phenomenon in detail and study the underlying mathematical concepts in depth, investigating the factors that influence the structure of the optimization landscape. Using corresponding mathematical tools, we diagnose whether a given variational circuit will exhibit barren plateaus when going beyond tens of qubits. Additionally, a review of mitigation strategies will be provided. The theory will then be applied to a use case that involves image classification to evaluate whether the model is affected by this phenomenon and which hyperparameters improve or degrade the overall performance.

•Jan 1, 2025•0 citations
The Barren Plateau (BP) phenomenon is an issue for certain quantum neural networks and variational quantum algorithms, whereby the gradient vanishes exponentially in the system size nnn. The question of whether high-order derivative information such as the Hessian could help escape a BP was recently posed in the literature. Here we show that the elements of the Hessian are exponentially suppressed in a BP, so estimating the Hessian in this situation would require a precision that scales exponentially with nnn. Hence, Hessian-based approaches do not circumvent the exponential scaling associated with BPs. We also show the exponential suppression of higher order derivatives. Hence, BPs will impact optimization strategies that go beyond (first-order) gradient descent.
Abstract Quantum neural networks (QNNs) offer a powerful paradigm for programming near-term quantum computers and have the potential to speed up applications ranging from data science to chemistry to materials science. However, a possible obstacle to realizing that speed-up is the barren plateau (BP) phenomenon, whereby the gradient vanishes exponentially in the system size n for certain QNN architectures. The question of whether high-order derivative information such as the Hessian could help escape a BP was recently posed in the literature. Here we show that the elements of the Hessian are exponentially suppressed in a BP, so estimating the Hessian in this situation would require a precision that scales exponentially with n . Hence, Hessian-based approaches do not circumvent the exponential scaling associated with BPs. We also show the exponential suppression of higher order derivatives. Hence, BPs will impact optimization strategies that go beyond (first-order) gradient descent. In deriving our results, we prove novel, general formulas that can be used to analytically evaluate any high-order partial derivative on quantum hardware. These formulas will likely have independent interest and use for training QNNs (outside of the context of BPs).
Barren plateau landscapes correspond to gradients that vanish exponentially in the number of qubits. Such landscapes have been demonstrated for variational quantum algorithms and quantum neural networks with either deep circuits or global cost functions. For obvious reasons, it is expected that gradient-based optimizers will be significantly affected by barren plateaus. However, whether or not gradient-free optimizers are impacted is a topic of debate, with some arguing that gradient-free approaches are unaffected by barren plateaus. Here we show that, indeed, gradient-free optimizers do not solve the barren plateau problem. Our main result proves that cost function differences, which are the basis for making decisions in a gradient-free optimization, are exponentially suppressed in a barren plateau. Hence, without exponential precision, gradient-free optimizers will not make progress in the optimization. We numerically confirm this by training in a barren plateau with several gradient-free optimizers (Nelder-Mead, Powell, and COBYLA algorithms), and show that the numbers of shots required in the optimization grows exponentially with the number of qubits.
The barren plateau (BP) phenomenon poses a fundamental challenge to the trainability of variational quantum eigensolvers (VQEs) by causing exponentially vanishing gradients as the system size increases. While extensive studies have investigated the geometric origins of BP, its impact on the optimization dynamics and complexity of practical algorithms under finite-shot measurements has received comparatively less attention. In this paper, we develop a theoretical framework that characterizes how the BP affects the optimization dynamics of the Simultaneous Perturbation Stochastic Approximation (SPSA) algorithm and quantifies the resulting iteration complexity and measurement budget. We derive non-asymptotic bias and variance bounds for the SPSA gradient estimator, introduce a signal-to-noise ratio (SNR) defined as the ratio of the gradient energy to the mean squared error of the estimator, and establish convergence guarantees for SPSA under finite-shot measurements. Our results show that, under the proposed parameter schedules, the number of iterations sufficient to guarantee a fixed relative first-order stationarity level scales polynomially with the inverse of the intrinsic gradient energy. Consequently, when this energy decays exponentially under BP, the resulting guaranteed iteration complexity and total measurement budget both grow exponentially with the number of qubits.
Variational quantum algorithms (VQAs) are among the most promising algorithms in the era of noisy intermediate scale quantum devices. Such algorithms are constructed using a parametrization $U(\ensuremath{\theta}$) with a classical optimizer that updates the parameters $\ensuremath{\theta}$ in order to minimize a cost function CCC. For this task, in general the gradient descent method, or one of its variants, is used. This is a method where the circuit parameters are updated iteratively using the cost function gradient. However, several works in the literature have shown that this method suffers from a phenomenon known as the barren plateaus (BPs). In this paper, we propose a method to mitigate BPs. In general, the parameters $\ensuremath{\theta}$ used in the parametrization UUU are randomly generated. In our method they are obtained from a classical neural network (CNN). We show that this method, besides to being able to mitigate BPs during startup, is also able to mitigate the effect of BPs during the VQA training. In addition, we also show how this method behaves for different CNN architectures.
Abstract In recent years, variational quantum circuits (VQCs) have been widely explored to advance quantum circuits against classic models on various domains, such as quantum chemistry and quantum machine learning. Similar to classic machine-learning models, VQCs can be trained through various optimization approaches, such as gradient-based or gradient-free methods. However, when employing gradient-based methods, the gradient variance of VQCs may dramatically vanish as the number of qubits or layers increases. This issue, a.k.a. barren plateaus (BPs), seriously hinders the scaling of VQCs on large datasets. To mitigate the barren plateaus, extensive efforts have been devoted to tackling this issue through diverse strategies. In this survey, we conduct a systematic literature review of recent works from both investigation and mitigation perspectives. Furthermore, we propose a new taxonomy to categorize most existing mitigation strategies into five groups and introduce them in detail. Also, we compare the concurrent survey papers about BPs. Finally, we provide insightful discussion on future directions for BPs.
Realizing successful quantum algorithms on current generation of quantum hardware depends on developing appropriate parametrized quantum circuits, which are the quantum computing counterpart to classical neural networks. A key consideration in this context is the algorithm’s trainability that can be hindered by the existence of so-called barren plateaus. In this case, the algorithm suffers from exponentially vanishing gradients as the number of qubits increases, resulting in a flat optimization landscape and making an efficient training intractable. Due to its serious impact on the success of such algorithms, this problem has gained substantial attention in recent years of quantum computing research. Theoretical and heuristic approaches have been proposed to investigate, avoid and mitigate this issue. In this work, we explore this phenomenon in detail and study the underlying mathematical concepts in depth, investigating the factors that influence the structure of the optimization landscape. Using corresponding mathematical tools, we diagnose whether a given variational circuit will exhibit barren plateaus when going beyond tens of qubits. Additionally, a review of mitigation strategies will be provided. The theory will then be applied to a use case that involves image classification to evaluate whether the model is affected by this phenomenon and which hyperparameters improve or degrade the overall performance.