Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1704.09014

Substochastic Monte Carlo Algorithms

Michael Jarret, Brad Lackey

Published Apr 28, 2017• 5 citations
arXivHTMLPDF

Abstract

In this paper we introduce and formalize Substochastic Monte Carlo (SSMC) algorithms. These algorithms, originally intended to be a better classical foil to quantum annealing than simulated annealing, prove to be worthy optimization algorithms in their own right. In SSMC, a population of walkers is initialized according to a known distribution on an arbitrary search space and varied into the solution of some optimization problem of interest. The first argument of this paper shows how an existing classical algorithm, "Go-With-The-Winners" (GWW), is a limiting case of SSMC when restricted to binary search and particular driving dynamics. Although limiting to GWW, SSMC is more general. We show that (1) GWW can be efficiently simulated within the SSMC framework, (2) SSMC can be exponentially faster than GWW, (3) by naturally incorporating structural information, SSMC can exponentially outperform the quantum algorithm that first inspired it, and (4) SSMC exhibits desirable search features in general spaces. Our approach combines ideas from genetic algorithms (GWW), theoretical probability (Fleming-Viot processes), and quantum computing. Not only do we demonstrate that SSMC is often more efficient than competing algorithms, but we also hope that our results connecting these disciplines will impact each independently. An implemented version of SSMC has previously enjoyed some success as a competitive optimization algorithm for Max-$k$-SAT.

DOI
10.48550/arxiv.1704.09014

Related papers

Adiabatic optimization versus diffusion Monte Carlo methods

Michael Jarret, Stephen P. Jordan, Brad Lackey

Most experimental and theoretical studies of adiabatic optimization use stoquastic Hamiltonians, whose ground states are expressible using only real nonnegative amplitudes. This raises a question as to whether classical Monte Carlo methods can simulate stoquastic adiabatic algorithms with polynomial overhead. Here we analyze diffusion Monte Carlo algorithms. We argue that, based on differences between ${L}_{1}$ and ${L}_{2}$ normalized states, these algorithms suffer from certain obstructions preventing them from efficiently simulating stoquastic adiabatic evolution in generality. In practice however, we obtain good performance by introducing a method that we call Substochastic Monte Carlo. In fact, our simulations are good classical optimization algorithms in their own right, competitive with the best previously known heuristic solvers for MAX-$k$-SAT at $k=2,3,4$.

arXiv:1607.03389•Physical Review A•Oct 13, 2016•36 citations

Quantum-Enhanced Iterative Algorithm for Monte Carlo Simulations

Jincheng Zhang

This paper introduces a novel quantum-enhanced iterative algorithm for Monte Carlo simulations. We propose a hybrid approach combining the strengths of quantum annealing and QAOA to accelerate the exploration of the solution space and improve the accuracy of results. The algorithm systematically explores the solution space, leveraging quantum fluctuations to guide the search process and mitigate the effects of local optima. We demonstrate the effectiveness of this approach through simulations across a range of problems, highlighting its potential to significantly enhance the efficiency and reliability of Monte Carlo methods. The core mechanism centers around the quantum annealing process for initial exploration and the QAOA optimization loop for refinement. This research contributes to the development of more robust and faster simulations, offering a promising step towards broader applicability in various scientific and engineering disciplines.

•Aug 31, 2026•0 citations

Simulating quantum annealing via projective quantum Monte Carlo algorithms

Estelle M. Inack

In this thesis, we implement projective quantum Monte Carlo (PQMC) methods to simulate quantum annealing on classical computers. A detailed derivation of the algorithm is presented. We show that in the regime where the systematic errors are well controlled, PQMC algorithms are indeed capable of simulating the imaginary-time dynamics of the Schroedinger equation both on continuous space models and discrete basis systems. We also demonstrate that the tunneling time of the PQMC method is quadratically faster than the one of incoherent quantum tunneling. It also shows remarkable stability when applied to frustrated systems compared to the path integral Monte Carlo algorithm, the algorithm mostly chosen to do comparisons with quantum annealers. However, a major drawback of the method comes from the finite number of random walkers needed to implement the simulations. It grows exponentially with the system size when no or poor guiding wave-functions are utilized. Nevertheless, we demonstrated that when good enough guiding wave-functions are used -- in our case we choose artificial neural networks -- the computational complexity seems to go from exponential to polynomial in the system size. We advocate for a search of more efficient guiding wave functions since they determine when and how feasible the PQMC simulations are on classical computers, a question closely related to a provable need or speed-up of a quantum computer.

•Oct 26, 2018•0 citations

Enhancing the efficiency of quantum annealing via reinforcement: A path-integral Monte Carlo simulation of the quantum reinforcement algorithm

Abolfazl Ramezanpour

The standard quantum annealing algorithm tries to approach the ground state of a classical system by slowly decreasing the hopping rates of a quantum random walk in the configuration space of the problem, where the on-site energies are provided by the classical energy function. In a quantum reinforcement algorithm, the annealing works instead by increasing gradually the strength of the on-site energies according to the probability of finding the walker on each site of the configuration space. Here, by using the path-integral Monte Carlo simulations of the quantum algorithms, we show that annealing via reinforcement can significantly enhance the success probability of the quantum walker. More precisely, we implement a local version of the quantum reinforcement algorithm, where the system wave function is replaced by an approximate wave function using the local expectation values of the system. We use this algorithm to find solutions to a prototypical constraint satisfaction problem (XORSAT) close to the satisfiability to unsatisfiability phase transition. The study is limited to small problem sizes (a few hundreds of variables), nevertheless, the numerical results suggest that quantum reinforcement may provide a useful strategy to deal with other computationally hard problems and larger problem sizes even as a classical optimization algorithm.

arXiv:1812.02569•Physical Review A•Dec 6, 2018•8 citations

Quantum-Inspired Sampling for Monte Carlo Simulations

Jincheng Zhang

Quantum-inspired sampling is a novel approach to Monte Carlo simulations that aims to overcome the limitations of traditional methods by incorporating quantum-like phenomena – specifically superposition and entanglement – into the sampling process. This paper investigates the potential of utilizing these principles to accelerate convergence, enhance accuracy, and improve the overall efficiency of Monte Carlo simulations, particularly in complex systems. We present a theoretical framework and preliminary implementation demonstrating the effectiveness of this technique. The core mechanism focuses on manipulating the probability distribution to guide the search towards promising solutions, effectively leveraging quantum-inspired dynamics.

•Sep 3, 2026•0 citations

Quantum-enhanced Monte Carlo Tree Search framework for combinatorial optimization problems

Yohan Finet, Yves Bérubé-Lauzière, Victor Drouin-Touchette

Over the past decades, the operations research community has developed numerous effective optimization algorithms, yet quantum computing is emerging as a new computational paradigm with the potential to approach optimization problems more efficiently. Grover's algorithm offers a provable speedup for combinatorial optimization, but its circuit depth places it beyond current noisy intermediate-scale quantum (NISQ) devices. A more accessible alternative is to reformulate the optimization problem as a quadratic unconstrained binary optimization (QUBO) problem and apply quantum annealing; however, practical problem instances remain out of reach for existing hardware. We introduce AtomTreeSearch, a hybrid classical-quantum algorithm that integrates a quantum subroutine natively implementable on neutral-atom quantum computers within a Monte Carlo Tree Search framework. At each expansion step, a maximal weighted independent set of candidate actions provided by the quantum processor is selected, and these collective actions are performed to obtain a child node. We benchmark our method on the Traveling Salesman Problem, with instances of up to 60 cities on random Euclidean instances and up to 100 cities on TSPLIB instances. Our hybrid algorithm generally matches or outperforms both OR-Tools and simulated annealing on these instances, and we find that the quantum subroutine produces more diverse and higher-quality branches compared to classical alternate subroutines. These results suggest that carefully scoped quantum subroutines embedded in classical search frameworks represent a promising path toward near-term quantum utility in combinatorial optimization.

quant-pharXiv:2606.30415•Jun 30, 2026•0 citations
In this paper we introduce and formalize Substochastic Monte Carlo (SSMC) algorithms. These algorithms, originally intended to be a better classical foil to quantum annealing than simulated annealing, prove to be worthy optimization algorithms in their own right. In SSMC, a population of walkers is initialized according to a known distribution on an arbitrary search space and varied into the solution of some optimization problem of interest. The first argument of this paper shows how an existing classical algorithm, "Go-With-The-Winners" (GWW), is a limiting case of SSMC when restricted to binary search and particular driving dynamics. Although limiting to GWW, SSMC is more general. We show that (1) GWW can be efficiently simulated within the SSMC framework, (2) SSMC can be exponentially faster than GWW, (3) by naturally incorporating structural information, SSMC can exponentially outperform the quantum algorithm that first inspired it, and (4) SSMC exhibits desirable search features in general spaces. Our approach combines ideas from genetic algorithms (GWW), theoretical probability (Fleming-Viot processes), and quantum computing. Not only do we demonstrate that SSMC is often more efficient than competing algorithms, but we also hope that our results connecting these disciplines will impact each independently. An implemented version of SSMC has previously enjoyed some success as a competitive optimization algorithm for Max-kkk-SAT.
Most experimental and theoretical studies of adiabatic optimization use stoquastic Hamiltonians, whose ground states are expressible using only real nonnegative amplitudes. This raises a question as to whether classical Monte Carlo methods can simulate stoquastic adiabatic algorithms with polynomial overhead. Here we analyze diffusion Monte Carlo algorithms. We argue that, based on differences between L1{L}_{1}L1​ and L2{L}_{2}L2​ normalized states, these algorithms suffer from certain obstructions preventing them from efficiently simulating stoquastic adiabatic evolution in generality. In practice however, we obtain good performance by introducing a method that we call Substochastic Monte Carlo. In fact, our simulations are good classical optimization algorithms in their own right, competitive with the best previously known heuristic solvers for MAX-kkk-SAT at k=2,3,4k=2,3,4k=2,3,4.
This paper introduces a novel quantum-enhanced iterative algorithm for Monte Carlo simulations. We propose a hybrid approach combining the strengths of quantum annealing and QAOA to accelerate the exploration of the solution space and improve the accuracy of results. The algorithm systematically explores the solution space, leveraging quantum fluctuations to guide the search process and mitigate the effects of local optima. We demonstrate the effectiveness of this approach through simulations across a range of problems, highlighting its potential to significantly enhance the efficiency and reliability of Monte Carlo methods. The core mechanism centers around the quantum annealing process for initial exploration and the QAOA optimization loop for refinement. This research contributes to the development of more robust and faster simulations, offering a promising step towards broader applicability in various scientific and engineering disciplines.
In this thesis, we implement projective quantum Monte Carlo (PQMC) methods to simulate quantum annealing on classical computers. A detailed derivation of the algorithm is presented. We show that in the regime where the systematic errors are well controlled, PQMC algorithms are indeed capable of simulating the imaginary-time dynamics of the Schroedinger equation both on continuous space models and discrete basis systems. We also demonstrate that the tunneling time of the PQMC method is quadratically faster than the one of incoherent quantum tunneling. It also shows remarkable stability when applied to frustrated systems compared to the path integral Monte Carlo algorithm, the algorithm mostly chosen to do comparisons with quantum annealers. However, a major drawback of the method comes from the finite number of random walkers needed to implement the simulations. It grows exponentially with the system size when no or poor guiding wave-functions are utilized. Nevertheless, we demonstrated that when good enough guiding wave-functions are used -- in our case we choose artificial neural networks -- the computational complexity seems to go from exponential to polynomial in the system size. We advocate for a search of more efficient guiding wave functions since they determine when and how feasible the PQMC simulations are on classical computers, a question closely related to a provable need or speed-up of a quantum computer.
The standard quantum annealing algorithm tries to approach the ground state of a classical system by slowly decreasing the hopping rates of a quantum random walk in the configuration space of the problem, where the on-site energies are provided by the classical energy function. In a quantum reinforcement algorithm, the annealing works instead by increasing gradually the strength of the on-site energies according to the probability of finding the walker on each site of the configuration space. Here, by using the path-integral Monte Carlo simulations of the quantum algorithms, we show that annealing via reinforcement can significantly enhance the success probability of the quantum walker. More precisely, we implement a local version of the quantum reinforcement algorithm, where the system wave function is replaced by an approximate wave function using the local expectation values of the system. We use this algorithm to find solutions to a prototypical constraint satisfaction problem (XORSAT) close to the satisfiability to unsatisfiability phase transition. The study is limited to small problem sizes (a few hundreds of variables), nevertheless, the numerical results suggest that quantum reinforcement may provide a useful strategy to deal with other computationally hard problems and larger problem sizes even as a classical optimization algorithm.
Quantum-inspired sampling is a novel approach to Monte Carlo simulations that aims to overcome the limitations of traditional methods by incorporating quantum-like phenomena – specifically superposition and entanglement – into the sampling process. This paper investigates the potential of utilizing these principles to accelerate convergence, enhance accuracy, and improve the overall efficiency of Monte Carlo simulations, particularly in complex systems. We present a theoretical framework and preliminary implementation demonstrating the effectiveness of this technique. The core mechanism focuses on manipulating the probability distribution to guide the search towards promising solutions, effectively leveraging quantum-inspired dynamics.
Over the past decades, the operations research community has developed numerous effective optimization algorithms, yet quantum computing is emerging as a new computational paradigm with the potential to approach optimization problems more efficiently. Grover's algorithm offers a provable speedup for combinatorial optimization, but its circuit depth places it beyond current noisy intermediate-scale quantum (NISQ) devices. A more accessible alternative is to reformulate the optimization problem as a quadratic unconstrained binary optimization (QUBO) problem and apply quantum annealing; however, practical problem instances remain out of reach for existing hardware. We introduce AtomTreeSearch, a hybrid classical-quantum algorithm that integrates a quantum subroutine natively implementable on neutral-atom quantum computers within a Monte Carlo Tree Search framework. At each expansion step, a maximal weighted independent set of candidate actions provided by the quantum processor is selected, and these collective actions are performed to obtain a child node. We benchmark our method on the Traveling Salesman Problem, with instances of up to 60 cities on random Euclidean instances and up to 100 cities on TSPLIB instances. Our hybrid algorithm generally matches or outperforms both OR-Tools and simulated annealing on these instances, and we find that the quantum subroutine produces more diverse and higher-quality branches compared to classical alternate subroutines. These results suggest that carefully scoped quantum subroutines embedded in classical search frameworks represent a promising path toward near-term quantum utility in combinatorial optimization.