Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

On scalable quantum-inspired distributed machine learning

Jean-Michel Sellier, Hardik Dalal

Published Feb 8, 2024• 0 citations
OpenAlex

Abstract

Recently a new approach to train machine learning models, such as neural networks, has been introduced. This method is based on the simulation of a type of quantum systems, in particular systems of one-dimensional electrons coupled by a force, which offers important advantages. First, by exploiting simulations of the quantum tunnelling effect, a different, and faster, convergence in the training phase can be obtained. Secondly, it does not require the computation of any kind of gradient (in other words, it can be considered a derivative-free or gradient-free optimizer) thus allowing the training of complex models impossible to train otherwise, for instance with the gradient descent method, or variations of it. Finally, it allows the use of parallelization schemes which can scale linearly with the dimensions of problem at hand, i.e., the method is nearly "embarrassingly parallelizable". This opens the way towards scalable and performant distributed machine learning capabilities. The goal of this paper is to focus specifically on this very advantage, suggest various strategies for parallelization, and discuss their consequences.

Related papers

Quantum-Inspired Optimization for Large-Scale Machine Learning

Jincheng Zhang

The rapid growth of machine learning (ML) has been accompanied by a significant challenge: the scaling of optimization algorithms to handle the immense parameter spaces of modern models, such as deep neural networks. Traditional optimization methods, including gradient descent and its variants, often encounter difficulties in efficiently exploring these spaces, leading to slow training times and potential stagnation. This paper investigates the application of quantum-inspired optimization techniques to address this scaling problem. We explore algorithms inspired by quantum annealing and other quantum phenomena, adapting their core principles to classical computation. Specifically, we propose a novel optimization framework utilizing a stochastic search strategy based on quantum superposition and measurement, designed to navigate high-dimensional parameter spaces more effectively. The efficacy of this approach is evaluated through theoretical analysis and conceptual simulations, demonstrating its potential to accelerate the training of large-scale machine learning models. We demonstrate how these methods can improve convergence speed and potentially escape local minima more effectively than conventional techniques. The core contribution lies in providing a theoretical foundation and a practical framework for applying quantum-inspired concepts to optimization within the context of machine learning.

•Sep 6, 2026•0 citations

Quantum-Inspired Optimization of Large-Scale Machine Learning Models

Jincheng Zhang

The training of large-scale machine learning models presents significant computational challenges, primarily due to the inherent complexity of optimization algorithms like stochastic gradient descent (SGD) and its variants. These algorithms often struggle with convergence speed, getting trapped in local minima, and the ability to effectively explore the vast solution space. This paper investigates the potential of quantum-inspired optimization techniques to address these limitations. Specifically, we explore the application of quantum annealing and variational quantum eigensolver (VQE) approaches to accelerate the training and optimization process of large-scale machine learning models. Our core claim is that by mapping the optimization problem to a quantum system, we can leverage quantum computation to overcome the computational bottlenecks associated with classical optimization methods. We propose a framework where the objective function of the machine learning model is translated into a Hamiltonian for a quantum annealer or the cost function for a VQE, enabling a quantum-inspired solution. The results, while theoretical in this initial exploration, demonstrate a potential pathway for significantly reducing training times and improving the overall performance of large-scale machine learning models. Further research is needed to develop efficient hybrid quantum-classical algorithms and explore the practical limitations of this approach.

•Sep 6, 2026•0 citations

Quantum-Inspired Optimization of Large-Scale Machine Learning Model Training

Jincheng Zhang

This paper investigates the potential of leveraging quantum-inspired optimization techniques to accelerate the training of large-scale machine learning models. Traditional optimization methods, such as stochastic gradient descent (SGD) and its variants, often struggle with the complex, high-dimensional loss landscapes encountered in deep learning. We propose a novel training algorithm rooted in principles of quantum mechanics, specifically superposition and interference, to address these challenges. The core idea involves employing parallel computation and interference cancellation strategies to navigate the loss landscape more efficiently. This approach aims to overcome the limitations of classical optimization by exploring multiple regions of the loss function simultaneously and selectively amplifying beneficial updates while suppressing detrimental ones. The proposed method is theoretically grounded and offers a potentially transformative pathway toward faster and more effective training of large-scale machine learning models. We detail the mathematical formulation of the algorithm and present a conceptual framework for its implementation.

•Aug 28, 2026•0 citations

An invitation to distributed quantum neural networks

Lirandë Pira, Christopher Ferrie

Abstract Deep neural networks have established themselves as one of the most promising machine learning techniques. Training such models at large scales is often parallelized, giving rise to the concept of distributed deep learning. Distributed techniques are often employed in training large models or large datasets either out of necessity or simply for speed. Quantum machine learning, on the other hand, is the interplay between machine learning and quantum computing. It seeks to understand the advantages of employing quantum devices in developing new learning algorithms as well as improving the existing ones. A set of architectures that are heavily explored in quantum machine learning are quantum neural networks. In this review, we consider ideas from distributed deep learning as they apply to quantum neural networks. We find that the distribution of quantum datasets shares more similarities with its classical counterpart than does the distribution of quantum models, though the unique aspects of quantum data introduce new vulnerabilities to both approaches. We review the current state of the art in distributed quantum neural networks, including recent numerical experiments and the concept ofcircuit-cutting.

arXiv:2211.07056•Quantum Machine Intelligence•Jun 15, 2023•34 citations

Quantum-Inspired Optimization of Large-Scale Machine Learning Algorithms

Jincheng Zhang

Large-scale machine learning (ML) models, particularly deep neural networks, often present significant challenges for traditional optimization algorithms. These algorithms, rooted in classical mechanics, frequently encounter issues such as getting trapped in local optima, high computational cost, and difficulty in handling complex, non-convex landscapes. This paper investigates the application of quantum-inspired optimization techniques to address these challenges. We explore how concepts derived from quantum phenomena – such as quantum annealing and quantum walks – can be adapted to efficiently navigate and optimize large-scale ML models. The core idea is to leverage the probabilistic and superposition properties inherent in quantum mechanics to escape local optima and accelerate the convergence process. We present a framework for designing and implementing quantum-inspired optimization strategies, focusing on the theoretical foundations and potential benefits. The proposed approach aims to provide a novel and effective solution for optimizing complex ML models, ultimately improving model performance and reducing training time. This work contributes to the growing field of quantum machine learning and offers a promising avenue for tackling the optimization problems inherent in large-scale ML.

•Sep 7, 2026•0 citations

On Optimizing Hyperparameters for Quantum Neural Networks

Sabrina Herbst, Vincenzo De Maio, Ivona Brandić

The increasing capabilities of Machine Learning (ML) models go hand in hand with an immense amount of data and computational power required for training. Therefore, training is usually outsourced into HPC facilities, where we have started to experience limits in scaling conventional hardware, as theorized by Moore's law. Despite heavy parallelization and optimization efforts, current state-of-the-art ML models require weeks for training, which is associated with an enormous$CO_{2}$footprint. Quantum Computing, and specifically Quantum Machine Learning (QML), can offer significant theoretical speed-ups and enhanced expressive power. However, training QML models requires tuning various hyperparameters, which is a nontrivial task, and suboptimal choices can highly affect the trainability and performance of the models. In this study, we identify main hyperparameters and collect data about the performance of QML models on real-world data. Notably, we build on existing work by also benchmarking different proposed parameter initialization strategies, which should help avoid trainability issues, such as Barren Plateaus. We compare different configurations and provide researchers with performance data and concrete suggestions for hyperparameter selection.

arXiv:2403.18579•IEEE International Conference on Quantum Computing and Engineering (QCE)•Sep 15, 2024•15 citations
Recently a new approach to train machine learning models, such as neural networks, has been introduced. This method is based on the simulation of a type of quantum systems, in particular systems of one-dimensional electrons coupled by a force, which offers important advantages. First, by exploiting simulations of the quantum tunnelling effect, a different, and faster, convergence in the training phase can be obtained. Secondly, it does not require the computation of any kind of gradient (in other words, it can be considered a derivative-free or gradient-free optimizer) thus allowing the training of complex models impossible to train otherwise, for instance with the gradient descent method, or variations of it. Finally, it allows the use of parallelization schemes which can scale linearly with the dimensions of problem at hand, i.e., the method is nearly "embarrassingly parallelizable". This opens the way towards scalable and performant distributed machine learning capabilities. The goal of this paper is to focus specifically on this very advantage, suggest various strategies for parallelization, and discuss their consequences.
The rapid growth of machine learning (ML) has been accompanied by a significant challenge: the scaling of optimization algorithms to handle the immense parameter spaces of modern models, such as deep neural networks. Traditional optimization methods, including gradient descent and its variants, often encounter difficulties in efficiently exploring these spaces, leading to slow training times and potential stagnation. This paper investigates the application of quantum-inspired optimization techniques to address this scaling problem. We explore algorithms inspired by quantum annealing and other quantum phenomena, adapting their core principles to classical computation. Specifically, we propose a novel optimization framework utilizing a stochastic search strategy based on quantum superposition and measurement, designed to navigate high-dimensional parameter spaces more effectively. The efficacy of this approach is evaluated through theoretical analysis and conceptual simulations, demonstrating its potential to accelerate the training of large-scale machine learning models. We demonstrate how these methods can improve convergence speed and potentially escape local minima more effectively than conventional techniques. The core contribution lies in providing a theoretical foundation and a practical framework for applying quantum-inspired concepts to optimization within the context of machine learning.
The training of large-scale machine learning models presents significant computational challenges, primarily due to the inherent complexity of optimization algorithms like stochastic gradient descent (SGD) and its variants. These algorithms often struggle with convergence speed, getting trapped in local minima, and the ability to effectively explore the vast solution space. This paper investigates the potential of quantum-inspired optimization techniques to address these limitations. Specifically, we explore the application of quantum annealing and variational quantum eigensolver (VQE) approaches to accelerate the training and optimization process of large-scale machine learning models. Our core claim is that by mapping the optimization problem to a quantum system, we can leverage quantum computation to overcome the computational bottlenecks associated with classical optimization methods. We propose a framework where the objective function of the machine learning model is translated into a Hamiltonian for a quantum annealer or the cost function for a VQE, enabling a quantum-inspired solution. The results, while theoretical in this initial exploration, demonstrate a potential pathway for significantly reducing training times and improving the overall performance of large-scale machine learning models. Further research is needed to develop efficient hybrid quantum-classical algorithms and explore the practical limitations of this approach.
This paper investigates the potential of leveraging quantum-inspired optimization techniques to accelerate the training of large-scale machine learning models. Traditional optimization methods, such as stochastic gradient descent (SGD) and its variants, often struggle with the complex, high-dimensional loss landscapes encountered in deep learning. We propose a novel training algorithm rooted in principles of quantum mechanics, specifically superposition and interference, to address these challenges. The core idea involves employing parallel computation and interference cancellation strategies to navigate the loss landscape more efficiently. This approach aims to overcome the limitations of classical optimization by exploring multiple regions of the loss function simultaneously and selectively amplifying beneficial updates while suppressing detrimental ones. The proposed method is theoretically grounded and offers a potentially transformative pathway toward faster and more effective training of large-scale machine learning models. We detail the mathematical formulation of the algorithm and present a conceptual framework for its implementation.
Abstract Deep neural networks have established themselves as one of the most promising machine learning techniques. Training such models at large scales is often parallelized, giving rise to the concept of distributed deep learning. Distributed techniques are often employed in training large models or large datasets either out of necessity or simply for speed. Quantum machine learning, on the other hand, is the interplay between machine learning and quantum computing. It seeks to understand the advantages of employing quantum devices in developing new learning algorithms as well as improving the existing ones. A set of architectures that are heavily explored in quantum machine learning are quantum neural networks. In this review, we consider ideas from distributed deep learning as they apply to quantum neural networks. We find that the distribution of quantum datasets shares more similarities with its classical counterpart than does the distribution of quantum models, though the unique aspects of quantum data introduce new vulnerabilities to both approaches. We review the current state of the art in distributed quantum neural networks, including recent numerical experiments and the concept ofcircuit-cutting.
Large-scale machine learning (ML) models, particularly deep neural networks, often present significant challenges for traditional optimization algorithms. These algorithms, rooted in classical mechanics, frequently encounter issues such as getting trapped in local optima, high computational cost, and difficulty in handling complex, non-convex landscapes. This paper investigates the application of quantum-inspired optimization techniques to address these challenges. We explore how concepts derived from quantum phenomena – such as quantum annealing and quantum walks – can be adapted to efficiently navigate and optimize large-scale ML models. The core idea is to leverage the probabilistic and superposition properties inherent in quantum mechanics to escape local optima and accelerate the convergence process. We present a framework for designing and implementing quantum-inspired optimization strategies, focusing on the theoretical foundations and potential benefits. The proposed approach aims to provide a novel and effective solution for optimizing complex ML models, ultimately improving model performance and reducing training time. This work contributes to the growing field of quantum machine learning and offers a promising avenue for tackling the optimization problems inherent in large-scale ML.
The increasing capabilities of Machine Learning (ML) models go hand in hand with an immense amount of data and computational power required for training. Therefore, training is usually outsourced into HPC facilities, where we have started to experience limits in scaling conventional hardware, as theorized by Moore's law. Despite heavy parallelization and optimization efforts, current state-of-the-art ML models require weeks for training, which is associated with an enormousCO2CO_{2}CO2​footprint. Quantum Computing, and specifically Quantum Machine Learning (QML), can offer significant theoretical speed-ups and enhanced expressive power. However, training QML models requires tuning various hyperparameters, which is a nontrivial task, and suboptimal choices can highly affect the trainability and performance of the models. In this study, we identify main hyperparameters and collect data about the performance of QML models on real-world data. Notably, we build on existing work by also benchmarking different proposed parameter initialization strategies, which should help avoid trainability issues, such as Barren Plateaus. We compare different configurations and provide researchers with performance data and concrete suggestions for hyperparameter selection.