arXiv:2310.06935

Quantum Shadow Gradient Descent for Variational Quantum Algorithms

Mohsen Heidari, Mobasshir A. Naved, Honjani, Zahra, Wenbo Xie, Arjun Jacob Grama, Wojciech Szpankowski A

Published Oct 10, 2023• 0 citations

Abstract

Gradient-based optimizers have been proposed for training variational quantum circuits in settings such as quantum neural networks (QNNs). The task of gradient estimation, however, has proven to be challenging, primarily due to distinctive quantum features such as state collapse and measurement incompatibility. Conventional techniques, such as the parameter-shift rule, necessitate several fresh samples in each iteration to estimate the gradient due to the stochastic nature of state measurement. Owing to state collapse from measurement, the inability to reuse samples in subsequent iterations motivates a crucial inquiry into whether fundamentally more efficient approaches to sample utilization exist. In this paper, we affirm the feasibility of such efficiency enhancements through a novel procedure called quantum shadow gradient descent (QSGD), which uses a single sample per iteration to estimate all components of the gradient. Our approach is based on an adaptation of shadow tomography that significantly enhances sample efficiency. Through detailed theoretical analysis, we show that QSGD has a significantly faster convergence rate than existing methods under locality conditions. We present detailed numerical experiments supporting all of our theoretical claims.

DOI: 10.48550/arxiv.2310.06935

Related papers

Stochastic Shadow Descent: Training Parametrized Quantum Circuits with Shadows of Gradients

Sayantan Pramanik, M Girish Chandra

In this paper, we focus on the task of optimizing the parameters in Parametrized Quantum Circuits (PQCs). While popular algorithms, such as Simultaneous Perturbation Stochastic Approximation (SPSA), limit the number of circuit-execution to two per iteration, irrespective of the number of parameters in the circuit, they have their own challenges. These methods use central-differences to calculate biased estimates of directional derivatives. We show, both theoretically and numerically, that this may lead to instabilities in \emph{training} the PQCs. To remedy this, we propose Stochastic Shadow Descent (\texttt{SSD}), which uses random-projections (or \emph{shadows}) of the gradient to update the parameters iteratively. We eliminate the bias in directional derivatives by employing the Parameter-Shift Rule, along with techniques from Quantum Signal Processing, to construct a quantum circuit that parsimoniously computes \emph{unbiased estimates} of directional derivatives. Finally, we prove the convergence of the \texttt{SSD} algorithm, provide worst-case bounds on the number of iterations, and numerically demonstrate its efficacy.

quant-pharXiv:2511.12168IEEE International Conference on Acoustics Speech and Signal ProcessingNov 18, 20250 citations

Quantum-Inspired Stochastic Gradient Descent for Large-Scale Neural Networks

Jincheng Zhang

Training large-scale neural networks with traditional stochastic gradient descent (SGD) methods often faces significant challenges, including slow convergence rates and high computational costs. This paper proposes a novel approach, Quantum-Inspired Stochastic Gradient Descent (QISGD), designed to address these limitations. QISGD leverages principles inspired by quantum measurement processes, specifically employing a random projection operator to approximate the gradient. This technique aims to provide a more efficient and potentially faster way to update the network's parameters during training. The theoretical underpinnings of QISGD are presented, along with a detailed explanation of the algorithm's components. We demonstrate the potential benefits of QISGD through a conceptual analysis and outline a framework for future research and implementation. The core innovation lies in translating quantum measurement intuition into a practical optimization strategy for classical neural networks. The goal is to improve the training efficiency of large networks while retaining the benefits of SGD.

Aug 28, 20260 citations

Quantum Gradient Descent in Neural Network Training Optimization

Zacharias Rallis, Kyriakos Vougiouklis

Optimisation of training still faces challenges due to an ill-conditioned loss surface and noisy gradient signals; at the same time, limited computational resources also restrict training options. Quantum Gradient Descent as a Hybrid Optimisation Strategy for Neural Network Training. The proposed noise-resilient quantum gradient descent framework maps selected gradient components to parameterised quantum circuits, estimates directional derivatives via parameter-shift measurements, and returns stable updates to the classical optimizer. It is not directly substituted for backpropagation; instead, it is a type of controllable gradient module that can be added to sensitive layers or low-dimensional projection heads. Add adaptive shot scheduling, damped momentum and layer-wise trust constraints to reduce estimator variance and prevent unstable quantum updates. Representative classification tasks are selected as the subjects of experiments for convergence speed, validation accuracy, gradient fidelity, measurement cost and noise robustness. Based on the above analysis, the new optimizer outperforms standard SGD in terms of final accuracy by 1.6% - 3.2% when using the same number of epochs; at the same time, it reduces the median gradient variance by 28.4% and maintains stable convergence even with an increase in simulated depolarizing noise from 0.001 to 0.015. Based on the above, it can be seen that Quantum Gradient Descent is not an all-purpose optimizer but rather a target-specific training accelerator for gradient-sensitive modules that can trade off sampling cost for more informative descent directions in measurement-aware update design.

Journal of Applied Automation TechnologiesAug 24, 20230 citations

Quantum natural stochastic pairwise coordinate descent

Mohammad Aamir Sohail, Mohsen Heidari, S. Sandeep Pradhan

Variational quantum algorithms, optimized using gradient-based methods, often exhibit sub-optimal convergence performance due to their dependence on Euclidean geometry. Quantum natural gradient descent (QNGD) is a more efficient method that incorporates the geometry of the state space via a quantum information metric. However, QNGD is computationally intensive and suffers from high sample complexity. In this work, we formulate a novel quantum information metric and construct an unbiased estimator for this metric using single-shot measurements. We develop a quantum optimization algorithm that leverages the geometry of the state space via this estimator while avoiding full-state tomography, as in conventional techniques. We provide the convergence analysis of the algorithm under mild conditions. Furthermore, we provide experimental results that demonstrate the better sample complexity and faster convergence of our algorithm compared to the state-of-the-art approaches. Our results illustrate the algorithm’s ability to avoid saddle points and local minima.

arXiv:2407.13858npj Quantum InformationJul 2, 20252 citations

Parsimonious Optimisation of Parameters in Variational Quantum Circuits

Sayantan Pramanik, Chaitanya Murti, M Girish Chandra

Variational quantum circuits characterise the state of a quantum system through the use of parameters that are optimised using classical optimisation procedures that typically rely on gradient information. The circuit-execution complexity of estimating the gradient of expectation values grows linearly with the number of parameters in the circuit, thereby rendering such methods prohibitively expensive. In this paper, we address this problem by proposing a novel Quantum-Gradient Sampling algorithm that requires the execution of at most two circuits per iteration to update the optimisable parameters, and with a reduced number of shots. Furthermore, our proposed method achieves similar asymptotic convergence rates to classical gradient descent, and empirically outperforms gradient descent, randomised coordinate descent, and SPSA.

arXiv:2306.11842Jun 20, 20230 citations

Quantum-Enhanced Gradient Descent for Neural Network Training

Jincheng Zhang

Quantum-enhanced gradient descent offers a potential paradigm shift in neural network training, promising faster convergence and improved generalization compared to traditional methods. This paper explores the implementation of a novel quantum-enhanced gradient descent algorithm, utilizing quantum tunneling to accelerate gradient updates. We analyze the theoretical implications, proposed implementation details, and preliminary experimental results, demonstrating the potential for significant performance gains. The core mechanism revolves around strategically introducing quantum tunneling into the gradient update process, aiming to bypass local minima and explore the parameter space more effectively. This paper provides a comprehensive overview of the proposed algorithm, including mathematical formulations and experimental validation.

Sep 1, 20260 citations