Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Intelligent Computing

Natural Evolutionary Gradient Descent Strategy for Variational Quantum Algorithms

Jianshe Xie, Chen Xu, Chenhao Yin, Yumin Dong, Zhirong Zhang

Published Jan 1, 2023• 3 citations
Publisher

Abstract

Recent research has demonstrated that parametric quantum circuits (PQCs) are affected by gradients that progressively vanish to zero as a function of the number of qubits. We show that using a combination of gradient-free natural evolutionary strategy and gradient descent can mitigate the possibility of optimizing barren plateaus in the landscape. We implemented 2 specific methods: natural evolutionary strategy stochastic gradient descent (NESSGD) and natural evolutionary strategy adapting the step size according to belief in observed gradients (NESAdaBelief) to optimize PQC parameter values. They were compared with standard stochastic gradient descent, adaptive moment estimation, and a version of adaptive moment estimation adapting the step size according to belief in observed gradients in 5 classification tasks. NESSGD and NESAdaBelief demonstrated some superiority in 4 of the tasks. NESAdaBelief showed higher accuracy than AdaBelief in all 5 tasks. In addition, we investigated the applicability of NESSGD under the parameter shift rule and demonstrated that NESSGD can adapt to this rule, which means that our proposed method could also optimize the parameters of PQCs on quantum computers.

DOI
10.34133/icomputing.0042

Related papers

Natural evolutionary strategies for variational quantum computation

Abhinav Anand, Matthias Degroote, Alán Aspuru‐Guzik

Abstract Natural evolutionary strategies (NES) are a family of gradient-free black-box optimization algorithms. This study illustrates their use for the optimization of randomly initialized parameterized quantum circuits (PQCs) in the region of vanishing gradients. We show that using the NES gradient estimator the exponential decrease in variance can be alleviated. We implement two specific approaches, the exponential and separable NES, for parameter optimization of PQCs and compare them against standard gradient descent. We apply them to two different problems of ground state energy estimation using variational quantum eigensolver and state preparation with circuits of varying depth and length. We also introduce batch optimization for circuits with larger depth to extend the use of ES to a larger number of parameters. We achieve accuracy comparable to state-of-the-art optimization techniques in all the above cases with a lower number of circuit evaluations. Our empirical results indicate that one can use NES as a hybrid tool in tandem with other gradient-based methods for optimization of deep quantum circuits in regions with vanishing gradients.

arXiv:2012.00101•Machine Learning Science and Technology•Mar 30, 2021•40 citations

Learning to learn with an evolutionary strategy applied to variational quantum algorithms

Lucas Friedrich, Jonas Maziero

Variational quantum algorithms (VQAs) employ parametrized quantum circuits optimized using classical methods to minimize a cost function. While VQAs have found broad applications, certain challenges persist. Notably, a significant computational burden arises during parameter optimization. The prevailing ``parameter shift rule'' mandates a double evaluation of the cost function for each parameter. In this paper, we introduce an optimization approach named ``learning to learn with an evolutionary strategy'' (LLES). LLES unifies ``learning to learn'' and ``evolutionary strategy'' methods. Learning to learn treats optimization as a learning problem, utilizing recurrent neural networks to iteratively propose VQA parameters. Conversely, evolutionary strategy employs gradient searches to estimate function gradients. Our optimization method is applied to two distinct tasks: determining the ground state of an Ising Hamiltonian and training a quantum neural network. The obtained results underscore the efficacy of this approach. Additionally, we identify a key hyperparameter that significantly influences gradient estimation using the evolutionary strategy method.

Physical Review A•Feb 27, 2025•4 citations

Quantum Time-Series Learning with Evolutionary Algorithms

Vignesh Anantharamakrishnan, Márcio M. Taddei

Variational quantum circuits have arisen as an important method in quantum computing. A crucial step of it is parameter optimization, which is typically tackled through gradient-descent techniques. We advantageously explore instead the use of evolutionary algorithms for such optimization, specifically for time-series forecasting. We perform a comparison, for diverse instances of real-world data, between gradient-descent parameter optimization and covariant-matrix adaptation evolutionary strategy. We observe that gradient descent becomes permanently trapped in local minima that have been avoided by evolutionary algorithms in all tested datasets, reaching up to a six-fold decrease in prediction error. Finally, the combined use of evolutionary and gradient-based techniques is explored, aiming at retaining advantages of both. The results are particularly applicable in scenarios sensitive to gains in accuracy.

arXiv:2412.17580•Dec 23, 2024•0 citations

Batched Line Search Strategy for Navigating through Barren Plateaus in Quantum Circuit Training

Jakab Nádori, Gregory Morse, Barna Fülöp Villám +3 more

Variational quantum algorithms are viewed as promising candidates for demonstrating quantum advantage on near-term devices. These approaches typically involve the training of parameterized quantum circuits through a classical optimization loop. However, they often encounter challenges attributed to the exponentially diminishing gradient components, known as the barren plateau (BP) problem. This work introduces a novel optimization approach designed to alleviate the adverse effects of BPs during circuit training. In contrast to conventional gradient descent methods with a small learning parameter, our approach relies on making a finite hops along the search direction determined on a randomly chosen subsets of the free parameters. The optimization search direction, together with the range of the search, is determined by the distant features of the cost-function landscape. This enables the optimization path to navigate around barren plateaus without the need for external control mechanisms. We have successfully applied our optimization strategy to quantum circuits comprising 21 qubits and 15000 entangling gates, demonstrating robust resistance against BPs. Additionally, we have extended our optimization strategy by incorporating an evolutionary selection framework, enhancing its ability to avoid local minima in the landscape. The modified algorithm has been successfully utilized in quantum gate synthesis applications, showcasing a significantly improved efficiency in generating highly compressed quantum circuits compared to traditional gradient-based optimization approaches.

arXiv:2402.05227•Quantum•Aug 29, 2025•1 citation

Learning to learn with an evolutionary strategy applied to variational quantum algorithms

Lucas Friedrich, Jonas Maziero

Variational Quantum Algorithms (VQAs) employ quantum circuits parameterized by $U$, optimized using classical methods to minimize a cost function. While VQAs have found broad applications, certain challenges persist. Notably, a significant computational burden arises during parameter optimization. The prevailing ``parameter shift rule'' mandates a double evaluation of the cost function for each parameter. In this article, we introduce a novel optimization approach named ``Learning to Learn with an Evolutionary Strategy'' (LLES). LLES unifies ``Learning to Learn'' and ``Evolutionary Strategy'' methods. ``Learning to Learn'' treats optimization as a learning problem, utilizing recurrent neural networks to iteratively propose VQA parameters. Conversely, ``Evolutionary Strategy'' employs gradient searches to estimate function gradients. Our optimization method is applied to two distinct tasks: determining the ground state of an Ising Hamiltonian and training a quantum neural network. Results underscore the efficacy of this novel approach. Additionally, we identify a key hyperparameter that significantly influences gradient estimation using the ``Evolutionary Strategy'' method.

arXiv:2310.17402•Oct 26, 2023•2 citations

Evolutionary Qubit Selection for Local Cost Functions in Variational Quantum Circuits

Rodica Ioana Lung, Tudor Dan Mihoc

Variational quantum circuits (VQCs) are flexible models for optimization and learning based on parameterized quantum circuits trained via cost minimization. A key challenge in their optimization is the presence of barren plateaus, where gradients vanish exponentially with the number of qubits, severely limiting trainability. Local cost functions mitigate this issue by restricting evaluation to qubit subsets, improving gradient scaling. In this work, we propose an evolutionary strategy-inspired method to automatically identify informative qubit subsets for constructing local cost functions. Operating at the level of qubit selection rather than parameter optimization, the approach enables adaptive, circuit-aware objective design. Numerical experiments using the PennyLane framework show that the method alleviates barren plateaus and improves optimization performance in the identity-gate learning problem.

Genetic and Evolutionary Computation Conference Companion (GECCO Companion)•Jul 13, 2026•0 citations
Recent research has demonstrated that parametric quantum circuits (PQCs) are affected by gradients that progressively vanish to zero as a function of the number of qubits. We show that using a combination of gradient-free natural evolutionary strategy and gradient descent can mitigate the possibility of optimizing barren plateaus in the landscape. We implemented 2 specific methods: natural evolutionary strategy stochastic gradient descent (NESSGD) and natural evolutionary strategy adapting the step size according to belief in observed gradients (NESAdaBelief) to optimize PQC parameter values. They were compared with standard stochastic gradient descent, adaptive moment estimation, and a version of adaptive moment estimation adapting the step size according to belief in observed gradients in 5 classification tasks. NESSGD and NESAdaBelief demonstrated some superiority in 4 of the tasks. NESAdaBelief showed higher accuracy than AdaBelief in all 5 tasks. In addition, we investigated the applicability of NESSGD under the parameter shift rule and demonstrated that NESSGD can adapt to this rule, which means that our proposed method could also optimize the parameters of PQCs on quantum computers.
Abstract Natural evolutionary strategies (NES) are a family of gradient-free black-box optimization algorithms. This study illustrates their use for the optimization of randomly initialized parameterized quantum circuits (PQCs) in the region of vanishing gradients. We show that using the NES gradient estimator the exponential decrease in variance can be alleviated. We implement two specific approaches, the exponential and separable NES, for parameter optimization of PQCs and compare them against standard gradient descent. We apply them to two different problems of ground state energy estimation using variational quantum eigensolver and state preparation with circuits of varying depth and length. We also introduce batch optimization for circuits with larger depth to extend the use of ES to a larger number of parameters. We achieve accuracy comparable to state-of-the-art optimization techniques in all the above cases with a lower number of circuit evaluations. Our empirical results indicate that one can use NES as a hybrid tool in tandem with other gradient-based methods for optimization of deep quantum circuits in regions with vanishing gradients.
Variational quantum algorithms (VQAs) employ parametrized quantum circuits optimized using classical methods to minimize a cost function. While VQAs have found broad applications, certain challenges persist. Notably, a significant computational burden arises during parameter optimization. The prevailing ``parameter shift rule'' mandates a double evaluation of the cost function for each parameter. In this paper, we introduce an optimization approach named ``learning to learn with an evolutionary strategy'' (LLES). LLES unifies ``learning to learn'' and ``evolutionary strategy'' methods. Learning to learn treats optimization as a learning problem, utilizing recurrent neural networks to iteratively propose VQA parameters. Conversely, evolutionary strategy employs gradient searches to estimate function gradients. Our optimization method is applied to two distinct tasks: determining the ground state of an Ising Hamiltonian and training a quantum neural network. The obtained results underscore the efficacy of this approach. Additionally, we identify a key hyperparameter that significantly influences gradient estimation using the evolutionary strategy method.
Variational quantum circuits have arisen as an important method in quantum computing. A crucial step of it is parameter optimization, which is typically tackled through gradient-descent techniques. We advantageously explore instead the use of evolutionary algorithms for such optimization, specifically for time-series forecasting. We perform a comparison, for diverse instances of real-world data, between gradient-descent parameter optimization and covariant-matrix adaptation evolutionary strategy. We observe that gradient descent becomes permanently trapped in local minima that have been avoided by evolutionary algorithms in all tested datasets, reaching up to a six-fold decrease in prediction error. Finally, the combined use of evolutionary and gradient-based techniques is explored, aiming at retaining advantages of both. The results are particularly applicable in scenarios sensitive to gains in accuracy.
Variational quantum algorithms are viewed as promising candidates for demonstrating quantum advantage on near-term devices. These approaches typically involve the training of parameterized quantum circuits through a classical optimization loop. However, they often encounter challenges attributed to the exponentially diminishing gradient components, known as the barren plateau (BP) problem. This work introduces a novel optimization approach designed to alleviate the adverse effects of BPs during circuit training. In contrast to conventional gradient descent methods with a small learning parameter, our approach relies on making a finite hops along the search direction determined on a randomly chosen subsets of the free parameters. The optimization search direction, together with the range of the search, is determined by the distant features of the cost-function landscape. This enables the optimization path to navigate around barren plateaus without the need for external control mechanisms. We have successfully applied our optimization strategy to quantum circuits comprising 21 qubits and 15000 entangling gates, demonstrating robust resistance against BPs. Additionally, we have extended our optimization strategy by incorporating an evolutionary selection framework, enhancing its ability to avoid local minima in the landscape. The modified algorithm has been successfully utilized in quantum gate synthesis applications, showcasing a significantly improved efficiency in generating highly compressed quantum circuits compared to traditional gradient-based optimization approaches.
Variational Quantum Algorithms (VQAs) employ quantum circuits parameterized by UUU, optimized using classical methods to minimize a cost function. While VQAs have found broad applications, certain challenges persist. Notably, a significant computational burden arises during parameter optimization. The prevailing ``parameter shift rule'' mandates a double evaluation of the cost function for each parameter. In this article, we introduce a novel optimization approach named ``Learning to Learn with an Evolutionary Strategy'' (LLES). LLES unifies ``Learning to Learn'' and ``Evolutionary Strategy'' methods. ``Learning to Learn'' treats optimization as a learning problem, utilizing recurrent neural networks to iteratively propose VQA parameters. Conversely, ``Evolutionary Strategy'' employs gradient searches to estimate function gradients. Our optimization method is applied to two distinct tasks: determining the ground state of an Ising Hamiltonian and training a quantum neural network. Results underscore the efficacy of this novel approach. Additionally, we identify a key hyperparameter that significantly influences gradient estimation using the ``Evolutionary Strategy'' method.
Variational quantum circuits (VQCs) are flexible models for optimization and learning based on parameterized quantum circuits trained via cost minimization. A key challenge in their optimization is the presence of barren plateaus, where gradients vanish exponentially with the number of qubits, severely limiting trainability. Local cost functions mitigate this issue by restricting evaluation to qubit subsets, improving gradient scaling. In this work, we propose an evolutionary strategy-inspired method to automatically identify informative qubit subsets for constructing local cost functions. Operating at the level of qubit selection rather than parameter optimization, the approach enables adaptive, circuit-aware objective design. Numerical experiments using the PennyLane framework show that the method alleviates barren plateaus and improves optimization performance in the identity-gate learning problem.