© 2026 Aqora Quantum S.A.S.

Terms Privacy Legal Notice

Journal of Applied Automation Technologies

Quantum Gradient Descent in Neural Network Training Optimization

Zacharias Rallis, Kyriakos Vougiouklis

Published Aug 24, 2023• 0 citations

Abstract

Optimisation of training still faces challenges due to an ill-conditioned loss surface and noisy gradient signals; at the same time, limited computational resources also restrict training options. Quantum Gradient Descent as a Hybrid Optimisation Strategy for Neural Network Training. The proposed noise-resilient quantum gradient descent framework maps selected gradient components to parameterised quantum circuits, estimates directional derivatives via parameter-shift measurements, and returns stable updates to the classical optimizer. It is not directly substituted for backpropagation; instead, it is a type of controllable gradient module that can be added to sensitive layers or low-dimensional projection heads. Add adaptive shot scheduling, damped momentum and layer-wise trust constraints to reduce estimator variance and prevent unstable quantum updates. Representative classification tasks are selected as the subjects of experiments for convergence speed, validation accuracy, gradient fidelity, measurement cost and noise robustness. Based on the above analysis, the new optimizer outperforms standard SGD in terms of final accuracy by 1.6% - 3.2% when using the same number of epochs; at the same time, it reduces the median gradient variance by 28.4% and maintains stable convergence even with an increase in simulated depolarizing noise from 0.001 to 0.015. Based on the above, it can be seen that Quantum Gradient Descent is not an all-purpose optimizer but rather a target-specific training accelerator for gradient-sensitive modules that can trade off sampling cost for more informative descent directions in measurement-aware update design.

DOI: 10.64972/jaat.2023v1.304p18e:242-254

Related papers

Quantum-Inspired Stochastic Gradient Descent for Large-Scale Neural Networks

Jincheng Zhang

Training large-scale neural networks with traditional stochastic gradient descent (SGD) methods often faces significant challenges, including slow convergence rates and high computational costs. This paper proposes a novel approach, Quantum-Inspired Stochastic Gradient Descent (QISGD), designed to address these limitations. QISGD leverages principles inspired by quantum measurement processes, specifically employing a random projection operator to approximate the gradient. This technique aims to provide a more efficient and potentially faster way to update the network's parameters during training. The theoretical underpinnings of QISGD are presented, along with a detailed explanation of the algorithm's components. We demonstrate the potential benefits of QISGD through a conceptual analysis and outline a framework for future research and implementation. The core innovation lies in translating quantum measurement intuition into a practical optimization strategy for classical neural networks. The goal is to improve the training efficiency of large networks while retaining the benefits of SGD.

•Aug 28, 2026•0 citations

Hybrid Quantum-Classical Training in Quantum Neural Networks: A Framework for Bridging Parameterized Quantum Circuits and Classical Optimization

Matthew Busel

Quantum Neural Networks (QNNs) represent a compelling convergence of quantum mechanics and machine learning, yet their practical deployment remains constrained by noise, limited qubit counts, and the cost of full quantum execution. Hybrid quantum-classical (HQC) training offers a pragmatic path forward: parameterized quantum circuits (PQCs) process information in exponentially large Hilbert spaces while classical optimizers update parameters via gradient methods accessible on today's hardware. We present a modular HQC training framework, formalising the parameter-shift rule for hardware-compatible gradient estimation, characterising the barren-plateau phenomenon through a variance-decay analysis, and introducing noise-aware training strategies for NISQ devices. Empirical results from state-vector and shot-based simulation confirm measurable quantum advantage on quantum-structured tasks, with the phase classification benchmark improving +12.1% over a classical MLP baseline. The accompanying open-source library provides a clean abstraction between quantum simulation and classical optimisation, serving as a foundation for near-term quantum machine learning research.

•Mar 3, 2026•0 citations

Quantum-Inspired Stochastic Gradient Descent with Adaptive Noise Injection

Jincheng Zhang

This paper presents a novel optimization algorithm, Quantum-Inspired Stochastic Gradient Descent (QISGD), designed to accelerate convergence in training machine learning models. QISGD leverages concepts from quantum mechanics, specifically quantum tunneling and superposition, to introduce adaptive noise into gradient estimates. The algorithm dynamically adjusts the noise level based on the training progress, aiming to escape local minima more effectively and navigate the loss landscape with greater precision. Unlike traditional stochastic gradient descent (SGD) which relies solely on random perturbations, QISGD incorporates a nuanced noise strategy informed by quantum principles, offering a potentially more robust and efficient approach to optimization. The core idea is to mimic the probabilistic nature of quantum systems, allowing the algorithm to explore the search space more thoroughly. This research explores the theoretical underpinnings of QISGD and provides a framework for its implementation and evaluation. The algorithm's performance is assessed through simulations, demonstrating its potential to outperform standard SGD in specific scenarios.

•Sep 2, 2026•0 citations

Quantum-aware gradient descent for hybrid machine learning architectures

Nadia Ahmed Sharna, Izzet F. Senturk

A viable approach for applying quantum computing to practical problems is hybrid quantum-classical machine learning (QML) systems. However, gradient discrepancies between quantum and classical components make it difficult to optimize such systems. For hybrid QML models, we suggest a new gradient descent technique called Quantum-Aware Gradient Descent (QAGD), which is intended to increase training stability and convergence. Our method addresses noise sensitivity and gradient scale mismatches by introducing layer-specific learning rate techniques and gradient normalization. The objective of this approach is to improve robustness and performance in noisy intermediate-scale quantum (NISQ) settings.

Quantum Computing, Communication, and Simulation•Mar 5, 2026•0 citations

Adaptive Grover-driven optimization for quantum-inspired deep learning: A gradient-free training framework

Irsa Sajjad, Huda M. Alshanbari, Mohammed M. A. Almazah +2 more

Training deep neural networks remains difficult due to vanishing gradients, non-convex loss surfaces, and hyperparameter sensitivity. These obstacles are compounded by quantum machine learning, where barren plateaus, circuit depth, and hardware noise restrict the applicability of gradient-based approaches. To overcome these drawbacks, this study presents adaptive Grover-driven parallel quantum optimization (AG-PQO), a hybrid, gradient-free scheme that leverages Grover's quadratic search speedup, along with adaptive loss-aware discretization and fidelity-based regularization. In contrast to more classical optimizers, such as Adam or evolutionary strategies (ES), which are either sensitive to the adequacy of the gradient update or exhibit poor scaling behavior, AG-PQO optimizes by performing Grover-accelerated candidate exploration across layers and reuses high-quality solutions in quantum memory caching. Testing indicates that AG-PQO yields higher accuracy, 2%–3% above Adam and ES, and faster convergence with less end-value loss than Adam, ES, and quantum feedforward-backpropagation (QFB). It is worth noting that AG-PQO remains stable at the simulated noise level of NISQ and has the potential to scale to near-term quantum processors.

AIMS Mathematics•Jan 1, 2025•4 citations

Robust Quantum Gradient Descent Algorithms For Noisy Intermediate Scale Quantum Devices

M Kasiselvanathan, Priya Sethuraman, K. Roshni Rajan +2 more

Noisy Intermediate-Scale Quantum (NISQ) devices show great promise for quantum advantage via Parametrized Quantum Circuits (PQCs) and Variational Quantum Algorithms (VQAs). Due to hardware imperfections, however, especially barren plateaus and environmental Pauli noise, the cost landscape is highly distorted, resulting in inaccurate classical optimization during training. To overcome these challenges, a robust quantum gradient descent framework is presented with the integration of error mitigation directly within the optimization loop. A noise-resilient parameter-shift rule is defined and modeled analytically, as is a variant of stochastic gradient descent with real-time Pauli noise mitigation. The framework is based on a 6-qubit system, which is tested on the Max-Cut problem in the presence of different amounts of depolarizing noise. It is shown experimentally that the proposed algorithm is able to achieve the final cost error of 0.045 under significant noise, whereas the standard quantum gradient descent fails to achieve better than 0.320 under this noise. Moreover, the methodology is consistent, converging without a noise-induced flat landscape and without local minima. The method offers a scalable route towards future applications of quantum machine learning on non-fault-tolerant hardware that does not suffer from the large sampling overhead often associated with conventional error mitigation techniques.

International Journal of Artificial Intelligence and Machine Learning•May 24, 2026•0 citations

Optimisation of training still faces challenges due to an ill-conditioned loss surface and noisy gradient signals; at the same time, limited computational resources also restrict training options. Quantum Gradient Descent as a Hybrid Optimisation Strategy for Neural Network Training. The proposed noise-resilient quantum gradient descent framework maps selected gradient components to parameterised quantum circuits, estimates directional derivatives via parameter-shift measurements, and returns stable updates to the classical optimizer. It is not directly substituted for backpropagation; instead, it is a type of controllable gradient module that can be added to sensitive layers or low-dimensional projection heads. Add adaptive shot scheduling, damped momentum and layer-wise trust constraints to reduce estimator variance and prevent unstable quantum updates. Representative classification tasks are selected as the subjects of experiments for convergence speed, validation accuracy, gradient fidelity, measurement cost and noise robustness. Based on the above analysis, the new optimizer outperforms standard SGD in terms of final accuracy by 1.6% - 3.2% when using the same number of epochs; at the same time, it reduces the median gradient variance by 28.4% and maintains stable convergence even with an increase in simulated depolarizing noise from 0.001 to 0.015. Based on the above, it can be seen that Quantum Gradient Descent is not an all-purpose optimizer but rather a target-specific training accelerator for gradient-sensitive modules that can trade off sampling cost for more informative descent directions in measurement-aware update design.

Training large-scale neural networks with traditional stochastic gradient descent (SGD) methods often faces significant challenges, including slow convergence rates and high computational costs. This paper proposes a novel approach, Quantum-Inspired Stochastic Gradient Descent (QISGD), designed to address these limitations. QISGD leverages principles inspired by quantum measurement processes, specifically employing a random projection operator to approximate the gradient. This technique aims to provide a more efficient and potentially faster way to update the network's parameters during training. The theoretical underpinnings of QISGD are presented, along with a detailed explanation of the algorithm's components. We demonstrate the potential benefits of QISGD through a conceptual analysis and outline a framework for future research and implementation. The core innovation lies in translating quantum measurement intuition into a practical optimization strategy for classical neural networks. The goal is to improve the training efficiency of large networks while retaining the benefits of SGD.

Quantum Neural Networks (QNNs) represent a compelling convergence of quantum mechanics and machine learning, yet their practical deployment remains constrained by noise, limited qubit counts, and the cost of full quantum execution. Hybrid quantum-classical (HQC) training offers a pragmatic path forward: parameterized quantum circuits (PQCs) process information in exponentially large Hilbert spaces while classical optimizers update parameters via gradient methods accessible on today's hardware. We present a modular HQC training framework, formalising the parameter-shift rule for hardware-compatible gradient estimation, characterising the barren-plateau phenomenon through a variance-decay analysis, and introducing noise-aware training strategies for NISQ devices. Empirical results from state-vector and shot-based simulation confirm measurable quantum advantage on quantum-structured tasks, with the phase classification benchmark improving +12.1% over a classical MLP baseline. The accompanying open-source library provides a clean abstraction between quantum simulation and classical optimisation, serving as a foundation for near-term quantum machine learning research.

This paper presents a novel optimization algorithm, Quantum-Inspired Stochastic Gradient Descent (QISGD), designed to accelerate convergence in training machine learning models. QISGD leverages concepts from quantum mechanics, specifically quantum tunneling and superposition, to introduce adaptive noise into gradient estimates. The algorithm dynamically adjusts the noise level based on the training progress, aiming to escape local minima more effectively and navigate the loss landscape with greater precision. Unlike traditional stochastic gradient descent (SGD) which relies solely on random perturbations, QISGD incorporates a nuanced noise strategy informed by quantum principles, offering a potentially more robust and efficient approach to optimization. The core idea is to mimic the probabilistic nature of quantum systems, allowing the algorithm to explore the search space more thoroughly. This research explores the theoretical underpinnings of QISGD and provides a framework for its implementation and evaluation. The algorithm's performance is assessed through simulations, demonstrating its potential to outperform standard SGD in specific scenarios.

A viable approach for applying quantum computing to practical problems is hybrid quantum-classical machine learning (QML) systems. However, gradient discrepancies between quantum and classical components make it difficult to optimize such systems. For hybrid QML models, we suggest a new gradient descent technique called Quantum-Aware Gradient Descent (QAGD), which is intended to increase training stability and convergence. Our method addresses noise sensitivity and gradient scale mismatches by introducing layer-specific learning rate techniques and gradient normalization. The objective of this approach is to improve robustness and performance in noisy intermediate-scale quantum (NISQ) settings.

Training deep neural networks remains difficult due to vanishing gradients, non-convex loss surfaces, and hyperparameter sensitivity. These obstacles are compounded by quantum machine learning, where barren plateaus, circuit depth, and hardware noise restrict the applicability of gradient-based approaches. To overcome these drawbacks, this study presents adaptive Grover-driven parallel quantum optimization (AG-PQO), a hybrid, gradient-free scheme that leverages Grover's quadratic search speedup, along with adaptive loss-aware discretization and fidelity-based regularization. In contrast to more classical optimizers, such as Adam or evolutionary strategies (ES), which are either sensitive to the adequacy of the gradient update or exhibit poor scaling behavior, AG-PQO optimizes by performing Grover-accelerated candidate exploration across layers and reuses high-quality solutions in quantum memory caching. Testing indicates that AG-PQO yields higher accuracy, 2%–3% above Adam and ES, and faster convergence with less end-value loss than Adam, ES, and quantum feedforward-backpropagation (QFB). It is worth noting that AG-PQO remains stable at the simulated noise level of NISQ and has the potential to scale to near-term quantum processors.

Noisy Intermediate-Scale Quantum (NISQ) devices show great promise for quantum advantage via Parametrized Quantum Circuits (PQCs) and Variational Quantum Algorithms (VQAs). Due to hardware imperfections, however, especially barren plateaus and environmental Pauli noise, the cost landscape is highly distorted, resulting in inaccurate classical optimization during training. To overcome these challenges, a robust quantum gradient descent framework is presented with the integration of error mitigation directly within the optimization loop. A noise-resilient parameter-shift rule is defined and modeled analytically, as is a variant of stochastic gradient descent with real-time Pauli noise mitigation. The framework is based on a 6-qubit system, which is tested on the Max-Cut problem in the presence of different amounts of depolarizing noise. It is shown experimentally that the proposed algorithm is able to achieve the final cost error of 0.045 under significant noise, whereas the standard quantum gradient descent fails to achieve better than 0.320 under this noise. Moreover, the methodology is consistent, converging without a noise-induced flat landscape and without local minima. The method offers a scalable route towards future applications of quantum machine learning on non-fault-tolerant hardware that does not suffer from the large sampling overhead often associated with conventional error mitigation techniques.