Realizing successful quantum algorithms on current generation of quantum hardware depends on developing appropriate parametrized quantum circuits, which are the quantum computing counterpart to classical neural networks. A key consideration in this context is the algorithm’s trainability that can be hindered by the existence of so-called barren plateaus. In this case, the algorithm suffers from exponentially vanishing gradients as the number of qubits increases, resulting in a flat optimization landscape and making an efficient training intractable. Due to its serious impact on the success of such algorithms, this problem has gained substantial attention in recent years of quantum computing research. Theoretical and heuristic approaches have been proposed to investigate, avoid and mitigate this issue. In this work, we explore this phenomenon in detail and study the underlying mathematical concepts in depth, investigating the factors that influence the structure of the optimization landscape. Using corresponding mathematical tools, we diagnose whether a given variational circuit will exhibit barren plateaus when going beyond tens of qubits. Additionally, a review of mitigation strategies will be provided. The theory will then be applied to a use case that involves image classification to evaluate whether the model is affected by this phenomenon and which hyperparameters improve or degrade the overall performance.
Realizing successful quantum algorithms on current generation of quantum hardware depends on developing appropriate parametrized quantum circuits, which are the quantum computing counterpart to classical neural networks. A key consideration in this context is the algorithm’s trainability that can be hindered by the existence of so-called barren plateaus. In this case, the algorithm suffers from exponentially vanishing gradients as the number of qubits increases, resulting in a flat optimization landscape and making an efficient training intractable. Due to its serious impact on the success of such algorithms, this problem has gained substantial attention in recent years of quantum computing research. Theoretical and heuristic approaches have been proposed to investigate, avoid and mitigate this issue. In this work, we explore this phenomenon in detail and study the underlying mathematical concepts in depth, investigating the factors that influence the structure of the optimization landscape. Using corresponding mathematical tools, we diagnose whether a given variational circuit will exhibit barren plateaus when going beyond tens of qubits. Additionally, a review of mitigation strategies will be provided. The theory will then be applied to a use case that involves image classification to evaluate whether the model is affected by this phenomenon and which hyperparameters improve or degrade the overall performance.
Barren Plateaus are a formidable challenge for hybrid quantum-classical algorithms that lead to flat plateaus in the loss function landscape making it difficult to take advantage of the expressive power of parameterized quantum circuits with gradient-based methods. Like in classical neural network models, parameterized quantum circuits suffer the same vanishing gradient issue due to large parameter spaces with non-convex landscapes. In this review, we present an overview of the different genesis for barren plateaus, mathematical formalisms of common themes around barren plateaus, and dives into gradients. The central objective is to provide a conceptual perspective between classical and quantum interpretations of vanishing gradients as well as dive into techniques involving cost functions, entanglement, and initialization strategies to mitigate barren plateaus. Addressing barren plateaus paves the way towards feasibility of many classically intractable applications for quantum simulation, optimization, chemistry, and quantum machine learning.
Barren plateaus, which means the training gradients become extremely small, pose a major challenge in optimizing parameterized quantum circuits, often making the learning process impractically slow or stall. This work shows why using neural networks to generate quantum circuit parameters helps overcome this difficulty. We introduce a geometric viewpoint that describes how the parameters produced by neural networks evolve during training. Our analysis shows that these parameters follow smooth and efficient paths that avoid the flat regions in the training that cause barren plateaus. This provides a computational explanation for the improved trainability observed in recent neural network-assisted quantum learning methods. Overall, our findings bridge ideas from quantum machine learning and computational optimization, offering new insight into the structure of quantum models and guiding future approaches for designing more trainable quantum circuits or parameter initialization.
Abstract In recent years, variational quantum circuits (VQCs) have been widely explored to advance quantum circuits against classic models on various domains, such as quantum chemistry and quantum machine learning. Similar to classic machine-learning models, VQCs can be trained through various optimization approaches, such as gradient-based or gradient-free methods. However, when employing gradient-based methods, the gradient variance of VQCs may dramatically vanish as the number of qubits or layers increases. This issue, a.k.a. barren plateaus (BPs), seriously hinders the scaling of VQCs on large datasets. To mitigate the barren plateaus, extensive efforts have been devoted to tackling this issue through diverse strategies. In this survey, we conduct a systematic literature review of recent works from both investigation and mitigation perspectives. Furthermore, we propose a new taxonomy to categorize most existing mitigation strategies into five groups and introduce them in detail. Also, we compare the concurrent survey papers about BPs. Finally, we provide insightful discussion on future directions for BPs.
Variational quantum algorithms (VQAs) have emerged as a leading paradigm in near-term quantum computing, yet their performance can be hindered by the so-called barren plateau problem, where gradients vanish exponentially with system size or circuit depth. While most existing VQA research employs simple Gaussian or zero-initialization schemes, classical deep learning has long benefited from sophisticated weight initialization strategies such as Xavier, He, and orthogonal initialization to improve gradient flow and expedite convergence. In this work, we systematically investigate whether these classical methods can mitigate barren plateaus in quantum circuits. We first review each initialization's theoretical grounding and outline how to adapt the notions from neural networks to VQAs. We then conduct extensive numerical experiments on various circuit architectures and optimization tasks. Our findings indicate that while the initial heuristics, inspired by classical initialization, yield moderate improvements in certain experiments, their overall benefits remain marginal. By outlining a preliminary exploration plan in this paper, we aim to offer the research community a broader perspective and accessible demonstrations. Furthermore, we propose future research directions that may be further refined by leveraging the insights gained from this work.
Abstract Combining classical optimization with parameterized quantum circuit evaluation, variational quantum algorithms (VQAs) are among the most promising algorithms in near-term quantum computing. However, the training of variational quantum circuits (VQCs) is susceptible to a phenomenon known as barren plateaus (BPs). Various approaches have been proposed to mitigate this issue, such as using neural networks to generate VQC parameters. In this paper, we improve the NN-based BP mitigation approach by refining the neural network architecture and extend its applicability to a more generalized scenario that includes random quantum inputs and VQC structures. We evaluate the effectiveness of the approach by comparing the convergence speed before and after it is utilized. Furthermore, we give an explanation for the effectiveness of the NN-based BP mitigation approach by utilizing a loss landscape visualization technique and the expressibility metric of VQC. The smoothness of the loss landscape offers an intuitive insight into the approach’s utility, while the reduction in expressibility accounts for the enhanced trainability. Our research highlights the universal applicability of the NN-based BP mitigation approach, underscoring its potential to drive progress in the development of VQAs across diverse domains.
Barren plateau landscapes correspond to gradients that vanish exponentially in the number of qubits. Such landscapes have been demonstrated for variational quantum algorithms and quantum neural networks with either deep circuits or global cost functions. For obvious reasons, it is expected that gradient-based optimizers will be significantly affected by barren plateaus. However, whether or not gradient-free optimizers are impacted is a topic of debate, with some arguing that gradient-free approaches are unaffected by barren plateaus. Here we show that, indeed, gradient-free optimizers do not solve the barren plateau problem. Our main result proves that cost function differences, which are the basis for making decisions in a gradient-free optimization, are exponentially suppressed in a barren plateau. Hence, without exponential precision, gradient-free optimizers will not make progress in the optimization. We numerically confirm this by training in a barren plateau with several gradient-free optimizers (Nelder-Mead, Powell, and COBYLA algorithms), and show that the numbers of shots required in the optimization grows exponentially with the number of qubits.