Variational quantum algorithms (VQAs) are hybrid approaches between classical and quantum computation, where a classical optimizer proposes parameter configurations for a quantum parametric circuit which is iteratively sampled. The overall performance of the algorithm depends on how the classical optimizer tunes the parameters of the quantum circuit. Several gradient-free and gradient-based approaches have been proposed in the literature to face this task. Estimation of distribution algorithms (EDAs) are a type of evolutionary algorithms where a probabilistic model is updated and sampled at each generation to optimize a cost function. EDAs have shown to be able to achieve good solutions in a reasonable computation time for different optimization problems, and thus, we believe that this algorithm can be a good option to overcome VQAs challenges such as the Barren plateaus phenomenon. In this paper, we study the use of three different EDAs, characterized by different probabilistic model complexities, to tune the parameters of two different VQAs to solver the Max Cut problem and to a VQA to simulate the behaviour of a molecule. Three EDA variants are compared to some state-of-the-art optimizers widely used for this task. Our results show statistical significant improvement of the EDA variants compared to different optimizers, and identify the VQAs characteristics that best fit to each EDA type. We also perform an analysis of the main EDAs hyper-parameters.
Variational quantum algorithms (VQAs) are hybrid approaches between classical and quantum computation, where a classical optimizer proposes parameter configurations for a quantum parametric circuit which is iteratively sampled. The overall performance of the algorithm depends on how the classical optimizer tunes the parameters of the quantum circuit. Several gradient-free and gradient-based approaches have been proposed in the literature to face this task. Estimation of distribution algorithms (EDAs) are a type of evolutionary algorithms where a probabilistic model is updated and sampled at each generation to optimize a cost function. EDAs have shown to be able to achieve good solutions in a reasonable computation time for different optimization problems, and thus, we believe that this algorithm can be a good option to overcome VQAs challenges such as the Barren plateaus phenomenon. In this paper, we study the use of three different EDAs, characterized by different probabilistic model complexities, to tune the parameters of two different VQAs to solver the Max Cut problem and to a VQA to simulate the behaviour of a molecule. Three EDA variants are compared to some state-of-the-art optimizers widely used for this task. Our results show statistical significant improvement of the EDA variants compared to different optimizers, and identify the VQAs characteristics that best fit to each EDA type. We also perform an analysis of the main EDAs hyper-parameters.
Variational quantum algorithms (VQAs) offer some promising characteristics for carrying out optimization tasks in noisy intermediate-scale quantum devices. These algorithms aim to minimize a cost function by optimizing the parameters of a quantum parametric circuit. Thus, the overall performance of these algorithms, heavily depends on the classical optimizer which sets the parameters. In the last years, some gradient-based and gradient-free approaches have been applied to optimize the parameters of the quantum circuit. In this work, we follow the second approach and propose the use of estimation of distribution algorithms for the parameter optimization in a specific case of VQAs, the quantum approximate optimization algorithm. Our results show an statistically significant improvement of the cost function minimization compared to traditional optimizers.
Variational quantum algorithms (VQAs) offer a promising path toward using near-term quantum hardware for applications in academic and industrial research. These algorithms aim to find approximate solutions to quantum problems by optimizing a parametrized quantum circuit using a classical optimization algorithm. A successful VQA requires fast and reliable classical optimization algorithms. Understanding and optimizing how off-the-shelf optimization methods perform in this context is important for the future of the field. In this work, we study the performance of four commonly used gradient-free optimization methods [sequential least-squares quadratic programming, constrained optimization by linear approximations, the covariance matrix adaptation evolutionary strategy (CMA-ES), and the simultaneous perturbation stochastic approximation (SPSA)] to find ground-state energies of a range of small chemistry and material science problems. We test a telescoping sampling scheme (where the accuracy of the cost-function estimate provided to the optimizer is increased as the optimization converges) for all methods, demonstrating mixed results across our range of optimizers and problems chosen. We further hyperparameter tune two of the four optimizers (CMA-ES and SPSA) across a large range of models and demonstrate that with appropriate hyperparameter tuning, CMA-ES is competitive with and sometimes outperforms SPSA (which is not observed in the absence of hyperparameter tuning). Finally, we investigate the ability of an optimizer to beat the ``sampling-noise floor'' given by the sampling noise of each cost-function estimate provided to the optimizer. Our results demonstrate the necessity for tailoring and hyperparameter tuning known optimization techniques for inherently noisy variational quantum algorithms and that the variational landscape that one finds in a VQA is highly problem and system dependent. This provides guidance for future implementations of these algorithms in experiments.
In recent years, Variational Quantum Algorithms (VQAs) have emerged as a promising approach for solving optimization problems on quantum computers in the NISQ era. However, one limitation of VQAs is their reliance on fixed-structure circuits, which may not be taylored for specific problems or hardware configurations. A leading strategy to address this issue are Adaptative VQAs, which dynamically modify the circuit structure by adding and removing gates, and optimize their parameters during the training. Several Adaptative VQAs, based on heuristics such as circuit shallowness, entanglement capability and hardware compatibility, have already been proposed in the literature, but there is still lack of a systematic comparison between the different methods. In this paper, we aim to fill this gap by analyzing three Adaptative VQAs: Evolutionary Variational Quantum Eigensolver (EVQE), Variable Ansatz (VAns), already proposed in the literature, and Random Adapt-VQE (RA-VQE), a random approach we introduce as a baseline. In order to compare these algorithms to traditional VQAs, we also include the Quantum Approximate Optimization Algorithm (QAOA) in our analysis. We apply these algorithms to QUBO problems and study their performance by examining the quality of the solutions found and the computational times required. Additionally, we investigate how the choice of the hyperparameters can impact the overall performance of the algorithms, highlighting the importance of selecting an appropriate methodology for hyperparameter tuning. Our analysis sets benchmarks for Adaptative VQAs designed for near-term quantum devices and provides valuable insights to guide future research in this area.
Variational quantum algorithms (VQAs) are promising methods that leverage noisy quantum computers and classical computing techniques for practical applications. In VQAs, the classical optimizers such as gradient-based optimizers are utilized to adjust the parameters of the quantum circuit so that the objective function is minimized. However, they often suffer from the so-called vanishing gradient or barren plateau issue. On the other hand, the normalized gradient descent (NGD) method, which employs the normalized gradient vector to update the parameters, has been successfully utilized in several optimization problems. Here, we study the performance of the NGD methods in the optimization of VQAs for the first time. Our goal is two-fold. The first is to examine the effectiveness of NGD and its variants for overcoming the vanishing gradient problems. The second is to propose a new NGD that can attain the faster convergence than the ordinary NGD. We performed numerical simulations of these gradient-based optimizers in the context of quantum chemistry where VQAs are used to find the ground state of a given Hamiltonian. The results show the effective convergence property of the NGD methods in VQAs, compared to the relevant optimizers without normalization. Moreover, we make use of some normalized gradient vectors at the past iteration steps to propose the novel historical NGD that has a theoretical guarantee to accelerate the convergence speed, which is observed in the numerical experiments as well.
The exponential runtime of quantum simulators on classical machines, along with long queue times and high costs associated with real quantum devices, presents significant challenges for the efficient optimization of Variational Quantum Algorithms (VQAs) such as the Variational Quantum Eigensolver (VQE), Quantum Approximate Optimization Algorithm (QAOA), and Quantum Neural Networks (QNNs). To address these limitations, we propose a novel approach, DyPP (Dynamic Parameter Prediction), which accelerates the convergence of VQAs by leveraging regular trends in the parameter weights to update parameters efficiently. We introduce two techniques for optimal prediction performance: Naive Prediction (NaP) and Adaptive Prediction (AdaP). Through extensive experimentation and training of multiple QNN models on various datasets, we demonstrate that DyPP achieves a speedup of approximately 2.25×compared to standard training methods, while also providing improved accuracy (up to 2.3% higher) and lower loss (up to 6.1% reduction) with minimal storage and computational overhead. We further evaluate DyPP’s effectiveness in VQE for molecular ground-state energy estimation and in QAOA for graph MaxCut. Our results show that, on average, DyPP leads to a speedup of up to 3.1× for VQE and 2.91× for QAOA compared to traditional optimization, while requiring up to 3.3× fewer shots (i.e., repeated circuit executions). Even in the presence of hardware noise, DyPP outperforms existing optimization techniques, delivering up to 3.33× speedup and requiring 2.5× fewer shots, thereby enhancing the efficiency of VQAs.
Abstract Quantum architecture search (QAS) involves optimizing both the quantum parametric circuit configuration but also its parameters for a variational quantum algorithm. Thus, the problem is known to be multi-level as the performance of a given architecture is unknown until its parameters are tuned using classical routines. Moreover, the task becomes even more complicated since well-known trainability issues, e.g., barren plateaus (BPs), can occur. In this paper, we aim to achieve two improvements in QAS: (1) to reduce the number of measurements by an online surrogate model of the evaluation process that aggressively discards architectures of poor performance; (2) to avoid training the circuits when BPs are present. To detect the presence of the BPs, we employed a recently developed metric, information content, which only requires measuring the energy values of a small set of parameters to estimate the magnitude of cost function’s gradient. The main idea of this proposal is to leverage a recently developed metric which can be used to detect the onset of vanishing gradients to ensure the overall search avoids such unfavorable regions. We experimentally validate our proposal for the variational quantum eigensolver and showcase that our algorithm is able to find solutions that have been previously proposed in the literature for the Hamiltonians; but also to outperform the state of the art when initializing the method from the set of architectures proposed in the literature. The results suggest that the proposed methodology could be used in environments where it is desired to improve the trainability of known architectures while maintaining good performance.