Abstract Variational quantum linear solvers (VQLSs) are a promising class of hybrid quantum--classical algorithms for solving linear systems on near-term quantum devices. However, the performance of VQLSs is often impeded by barren plateaus, particularly when using randomly initialized variational quantum circuits (VQCs). To mitigate this issue, we propose \textit{PVLS}, a GNN-based parameter initialization framework that improves both convergence speed and final solution quality. By reformulating the linear system
Ax=b as a graph with
A encoded in the edges and
b as node features, PVLS learns to predict effective initial VQC parameters. Our method is trained on thousands of randomly generated matrices with varying dimensions (
n∈[4,10]), using optimized VQC parameters as ground-truth labels. On unseen test instances, PVLS reduces the initial cost by an average of 81.3\% and the final loss by 71\% compared to random initialization. PVLS also accelerates convergence, reducing the number of optimization steps by more than 60\% on average. We further evaluate PVLS on ten real-world sparse matrices, demonstrating its generalization capability and robustness. Our results highlight the utility of machine-learned priors in improving the trainability of VQLSs and alleviating optimization challenges in variational quantum algorithms.
Variational Quantum Eigensolvers (VQEs) are a leading class of noisy intermediate-scale quantum (NISQ) algorithms with broad applications in quantum physics and quantum chemistry. However, as system size increases, VQE optimization is increasingly hindered by the barren plateau phenomenon, where gradients vanish and the loss function becomes trapped in local minima. While machine learning-based parameter initialization methods have been proposed to address this challenge, they often show limited effectiveness in complex VQE problems. This is primarily due to their inadequate ability to model the intricate correlations embedded in the Hamiltonian structure and the associated ansatz circuits. In this paper, we propose \textit{Qracle}, a graph neural network (GNN)-based parameter initializer for VQEs. \textit{Qracle} systematically encodes both the Hamiltonian and the associated ansatz circuit into a unified graph representation and leverages a GNN to learn a mapping from VQE problem graphs to optimized ansatz parameters. Compared to state-of-the-art initialization techniques, \textit{Qracle} achieves a reduction in initial loss of up to
10.86, accelerates convergence by decreasing optimization steps by up to
64.42%, and improves final performance with up to a
26.43% reduction in Symmetric Mean Absolute Percentage Error (SMAPE).
Variational Quantum Eigensolvers (VQEs) are a leading class of noisy intermediate-scale quantum (NISQ) algorithms with broad applications in quantum physics and quantum chemistry. However, as system size increases, VQE optimization is increasingly hindered by the barren plateau phenomenon, where gradients vanish and the loss function becomes trapped in local minima. While machine learning-based parameter initialization methods have been proposed to address this challenge, they often show limited effectiveness in complex VQE problems. This is primarily due to their inadequate ability to model the intricate correlations embedded in the Hamiltonian structure and the associated ansatz circuits. In this paper, we propose Qracle, a graph neural network (GNN)-based parameter initializer for VQEs. Qracle systematically encodes both the Hamiltonian and the associated ansatz circuit into a unified graph representation and leverages a GNN to learn a mapping from VQE problem graphs to optimized ansatz parameters. Compared to state-of-the-art initialization techniques, Qracle achieves a reduction in initial loss of up to 10.86, accelerates convergence by decreasing optimization steps by up to 64.42%, and improves final performance with up to a 26.43% reduction in Symmetric Mean Absolute Percentage Error (SMAPE), with all results averaged over the validation set of each respective application. The source code is publicly available at https://github.com/chizhang24/Qracle.
Variational Quantum Algorithms (VQAs) have gained prominence as a viable framework for exploiting near-term quantum devices in applications ranging from optimization and chemistry simulation to machine learning. However, the effectiveness of VQAs is often constrained by the so-called barren plateau problem, wherein gradients diminish exponentially as system size or circuit depth increases, thereby hindering training. In this work, we propose a reinforcement learning (RL)-based initialization strategy to alleviate the barren plateau issue by reshaping the initial parameter landscape to avoid regions prone to vanishing gradients. In particular, we explore several RL algorithms (Deterministic Policy Gradient, Soft ActorCritic, and Proximal Policy Optimization, etc.) to generate the circuit parameters (treated as “actions”) that minimize the VQAs cost function before standard gradient-based optimization. By pre-training with RL in this manner, subsequent optimization using methods such as gradient descent or Adam proceeds from a more favorable initial state. Extensive numerical experiments under various noise conditions and tasks consistently demonstrate that the RL-based initialization method significantly enhances both convergence speed and final solution quality. Moreover, comparisons among different RL algorithms highlight that multiple approaches can achieve comparable performance gains, underscoring the flexibility and robustness of our method. These findings shed light on a promising avenue for integrating machine learning techniques into quantum algorithm design, offering insights into how RL-driven parameter initialization can accelerate the scalability and practical deployment of VQAs. Opening up a promising path for the research community in machine learning for quantum, especially barren plateau problems in VQAs.
The potential of quantum computing for scientific and industrial breakthroughs is immense, however, we are still in the Noisy Intermediate-Scale Quantum (NISQ) era, where the currently available quantum devices contain small numbers of qubits, are very sensitive to environmental conditions and prone to quantum decoherence. Even so, existing NISQ computers have already been shown to outperform conventional computers on specific problems and the key question is how to make use of today’s NISQ devices to achieve quantum advantage in the field of computational science and engineering (CSE). In this direction, this work proposes a hybrid computing formulation by combining quantum computing with machine learning for accelerating the solution of parameterized linear systems in NISQ devices. In particular, it focuses on the Variational Quantum Linear Solver (VQLS), which is a hybrid quantum- classical algorithm for solving linear systems of equations. VQLS employs a short-depth quantum circuit to efficiently evaluate a cost function related to the system solution. The algorithm’s circuit consists of a quantum gate sequence (unitary operators) that involves a set of tunable parameters. Then, well-established classical optimizers are utilized to tune the parameters of the sequence in order to minimize the cost function, which is equivalent to finding the system solution at an acceptable level of accuracy. In this work, it is demonstrated that machine learning tools such as feed-forward neural networks and nearest-neighbor interpolation techniques can be successfully employed to accelerate the convergence of the VQLS algorithm towards the optimal values for the circuit parameters when applied to parameterized linear systems that need to be solved for multiple parameter instances.
The Variational Quantum Linear Solver (VQLS), a hybrid quantum-classical algorithm for solving linear systems, faces a practical scalability bottleneck: the Linear Combination of Unitaries (LCU) decomposition requires
O(L2) circuit evaluations per optimizer iteration, where
L can grow to
4n in the worst case for an
n-qubit system. We address this computational bottleneck through two complementary strategies. First, we present a distributed VQLS (D-VQLS) framework (https://code.ornl.gov/olcf-qcfd/DVQLS.git), built on NVIDIA CUDA-Q, that enables asynchronous, scalable distribution of the
O(L2) cost evaluations. Second, a fast Walsh--Hadamard transform (FWHT)-based Pauli decomposition with coefficient-amplitude pruning threshold
τ=0.01 curbs LCU growth for the structured Toeplitz family, reducing
L from
O(2n) to 64 for
n>6 and compressing the circuit complexity per optimizer iteration from
O(n4n) to
O(n). We derive the exact top-
L Frobenius error and connect it to worst-case solution error. For a 10-qubit tridiagonal Toeplitz system, the
L=64 pruning yields a
256× reduction---from 23 million to 90k circuits per optimizer iteration.
The D-VQLS framework is validated on the NERSC Perlmutter supercomputer using multi-node, multi-GPU ideal state-vector simulations, achieving over
99.99% fidelity against classical solutions on tridiagonal Toeplitz and Hele--Shaw flow benchmarks, with near-ideal strong scaling up to 24 GPUs and
95.3% weak scaling efficiency at 96 GPUs processing more than 360k circuits per optimizer iteration (from larger-
L pruning) for the 10-qubit system. Systematic profiling identifies the optimal resource allocation for distributed quantum circuit workloads, yielding a
2.52× speedup for the configurations studied.