Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2111.06411 · Physical Review Research

Neural network evolution strategy for solving quantum sign structures

Ao Chen, Kenny Choo, Nikita Astrakhantsev, Titus Neupert

Published May 2, 2022• 27 citations
arXivHTMLPDF

Abstract

Feed-forward neural networks are a novel class of variational wave functions for correlated many-body quantum systems.Here, we propose a specific neural network ansatz suitable for systems with real-valued wave functions.Its characteristic is to encode the all-important rugged sign structure of a quantum wave function in a convolutional neural network with discrete output.Its training is achieved through an evolutionary algorithm.We test our variational ansatz and training strategy on two spin-1/2 Heisenberg models, one on the two-dimensional square lattice and one on the three-dimensional pyrochlore lattice.In the former, our ansatz converges with high accuracy to the analytically known sign structures of ordered phases.In the latter, where such sign structures are ap r i o r iunknown, we obtain better variational energies than with other neural network states.Our results demonstrate the utility of discrete neural networks to solve quantum many-body problems.

DOI
10.1103/physrevresearch.4.l022026

Related papers

Approximating quantum many-body wave functions using artificial neural networks

Zi Cai, Jin-Guo Liu

In this paper, we demonstrate the expressibility of artificial neural networks (ANNs) in quantum many-body physics by showing that a feed-forward neural network with a small number of hidden layers can be trained to approximate with high precision the ground states of some notable quantum many-body systems. We consider the one-dimensional free bosons and fermions, spinless fermions on a square lattice away from half-filling, as well as frustrated quantum magnetism with a rapidly oscillating ground-state characteristic function. In the latter case, an ANN with a standard architecture fails, while that with a slightly modified one successfully learns the frustration-induced complex sign rule in the ground state and approximates the ground states with high precisions. As an example of practical use of our method, we also perform the variational method to explore the ground state of an antiferromagnetic ${J}_{1}\text{\ensuremath{-}}{J}_{2}$ Heisenberg model.

arXiv:1704.05148•Physical review. B./Physical review. B•Jan 9, 2018•225 citations

Variational optimization of the amplitude of neural-network quantum many-body ground states

Jia-Qi Wang, Han-Qing Wu, Rong-Qiang He +1 more

Neural-network quantum states (NQSs), variationally optimized by combining traditional methods and deep learning techniques, is a new way to find quantum many-body ground states and has gradually become a competitor of traditional variational methods. However, there are still some difficulties in the optimization of NQSs, such as local minima, slow convergence, and sign structure optimization. Here, we split a quantum many-body variational wave function into a multiplication of a real-valued amplitude neural network and a sign structure, and focus on the optimization of the amplitude network while keeping the sign structure fixed. The amplitude network is a convolutional neural network (CNN) with residual blocks, namely a residual network (ResNet). Our method is tested on three typical quantum many-body systems. The obtained ground state energies are better than or comparable to those from traditional variational Monte Carlo methods and density matrix renormalization group. Surprisingly, for the frustrated Heisenberg ${J}_{1}\text{\ensuremath{-}}{J}_{2}$ model, our results are better than those of the complex-valued CNN in the literature, implying that the sign structure of the complex-valued NQS is difficult to optimize. We will study the optimization of the sign structure of NQSs in the future.

arXiv:2308.09664•Physical review. B./Physical review. B•Jun 14, 2024•16 citations

Learning the ground state of a non-stoquastic quantum Hamiltonian in a rugged neural network landscape

Marin Bukov, Markus Schmitt, Maxime Dupont

Strongly interacting quantum systems described by non-stoquastic Hamiltonians exhibit rich low-temperature physics. Yet, their study poses a formidable challenge, even for state-of-the-art numerical techniques. Here, we investigate systematically the performance of a class of universal variational wave-functions based on artificial neural networks, by considering the frustrated spin- 1/2 1 / 2 J_1-J_2 J 1 − J 2 Heisenberg model on the square lattice. Focusing on neural network architectures without physics-informed input, we argue in favor of using an ansatz consisting of two decoupled real-valued networks, one for the amplitude and the other for the phase of the variational wavefunction. By introducing concrete mitigation strategies against inherent numerical instabilities in the stochastic reconfiguration algorithm we obtain a variational energy comparable to that reported recently with neural networks that incorporate knowledge about the physical system. Through a detailed analysis of the individual components of the algorithm, we conclude that the rugged nature of the energy landscape constitutes the major obstacle in finding a satisfactory approximation to the ground state wavefunction, and prevents learning the correct sign structure. In particular, we show that in the present setup the neural network expressivity and Monte Carlo sampling are not primary limiting factors.

arXiv:2011.11214•SciPost Physics•Jun 17, 2021•102 citations

Two-dimensional frustrated J1−J2 model studied with neural network quantum states

Kenny Choo, Titus Neupert, Giuseppe Carleo

The use of artificial neural networks to represent quantum wave functions has recently attracted interest as a way to solve complex many-body problems. The potential of these variational parametrizations has been supported by analytical and numerical evidence in controlled benchmarks. While approaching the end of the early research phase in this field, it becomes increasingly important to show how neural-network states perform for models and physical problems that constitute a clear open challenge for other many-body computational methods. In this paper, we start addressing this aspect, concentrating on a presently unsolved model describing two-dimensional frustrated magnets. Using a fully convolutional neural network model as a variational ans\"atz, we study the frustrated spin-1/$2{J}_{1}\text{\ensuremath{-}}{J}_{2}$ Heisenberg model on the square lattice. We demonstrate that the resulting predictions for both ground-state energies and properties are competitive with, and often improve upon, existing state-of-the-art methods. In a relatively small region in the parameter space, corresponding to the maximally frustrated regime, our ans\"atz exhibits comparatively good but not the best performance. The gap between the complexity of the models adopted here and those routinely adopted in deep-learning applications is, however, still substantial, such that further improvements in future generations of neural-network quantum states are likely to be expected.

arXiv:1903.06713•Physical review. B./Physical review. B•Sep 11, 2019•272 citations

Hybrid convolutional neural network and projected entangled pair states wave functions for quantum many-particle states

Xiao Liang, Shaojun Dong, Lixin He

Neural networks have been used as variational wave functions for quantum many-particle problems. It has been shown that the correct sign structure is crucial to obtain highly-accurate ground state energies. In this paper, we propose a hybrid wave function combining the convolutional neural network (CNN) and projected entangled pair states (PEPS), in which the sign structures are determined by the PEPS, and the amplitudes of the wave functions are provided by CNN. We benchmark the ansatz on the highly frustrated spin-1/2 ${J}_{1}\text{\ensuremath{-}}{J}_{2}$ model. We show that the achieved ground energies are competitive with state-of-the-art results.

arXiv:2009.14370•Physical review. B./Physical review. B•Jan 22, 2021•39 citations

Solving the quantum many-body problem with artificial neural networks

Giuseppe Carleo, Matthias Troyer

The challenge posed by the many-body problem in quantum physics originates from the difficulty of describing the nontrivial correlations encoded in the exponential complexity of the many-body wave function. Here we demonstrate that systematic machine learning of the wave function can reduce this complexity to a tractable computational form for some notable cases of physical interest. We introduce a variational representation of quantum states based on artificial neural networks with a variable number of hidden neurons. A reinforcement-learning scheme we demonstrate is capable of both finding the ground state and describing the unitary time evolution of complex interacting quantum systems. Our approach achieves high accuracy in describing prototypical interacting spins models in one and two dimensions.

arXiv:1606.02318•Science•Feb 10, 2017•2,431 citations
Feed-forward neural networks are a novel class of variational wave functions for correlated many-body quantum systems.Here, we propose a specific neural network ansatz suitable for systems with real-valued wave functions.Its characteristic is to encode the all-important rugged sign structure of a quantum wave function in a convolutional neural network with discrete output.Its training is achieved through an evolutionary algorithm.We test our variational ansatz and training strategy on two spin-1/2 Heisenberg models, one on the two-dimensional square lattice and one on the three-dimensional pyrochlore lattice.In the former, our ansatz converges with high accuracy to the analytically known sign structures of ordered phases.In the latter, where such sign structures are ap r i o r iunknown, we obtain better variational energies than with other neural network states.Our results demonstrate the utility of discrete neural networks to solve quantum many-body problems.
In this paper, we demonstrate the expressibility of artificial neural networks (ANNs) in quantum many-body physics by showing that a feed-forward neural network with a small number of hidden layers can be trained to approximate with high precision the ground states of some notable quantum many-body systems. We consider the one-dimensional free bosons and fermions, spinless fermions on a square lattice away from half-filling, as well as frustrated quantum magnetism with a rapidly oscillating ground-state characteristic function. In the latter case, an ANN with a standard architecture fails, while that with a slightly modified one successfully learns the frustration-induced complex sign rule in the ground state and approximates the ground states with high precisions. As an example of practical use of our method, we also perform the variational method to explore the ground state of an antiferromagnetic ${J}_{1}\text{\ensuremath{-}}{J}_{2}$ Heisenberg model.
Neural-network quantum states (NQSs), variationally optimized by combining traditional methods and deep learning techniques, is a new way to find quantum many-body ground states and has gradually become a competitor of traditional variational methods. However, there are still some difficulties in the optimization of NQSs, such as local minima, slow convergence, and sign structure optimization. Here, we split a quantum many-body variational wave function into a multiplication of a real-valued amplitude neural network and a sign structure, and focus on the optimization of the amplitude network while keeping the sign structure fixed. The amplitude network is a convolutional neural network (CNN) with residual blocks, namely a residual network (ResNet). Our method is tested on three typical quantum many-body systems. The obtained ground state energies are better than or comparable to those from traditional variational Monte Carlo methods and density matrix renormalization group. Surprisingly, for the frustrated Heisenberg ${J}_{1}\text{\ensuremath{-}}{J}_{2}$ model, our results are better than those of the complex-valued CNN in the literature, implying that the sign structure of the complex-valued NQS is difficult to optimize. We will study the optimization of the sign structure of NQSs in the future.
Strongly interacting quantum systems described by non-stoquastic Hamiltonians exhibit rich low-temperature physics. Yet, their study poses a formidable challenge, even for state-of-the-art numerical techniques. Here, we investigate systematically the performance of a class of universal variational wave-functions based on artificial neural networks, by considering the frustrated spin- 1/2 1 / 2 J_1-J_2 J 1 − J 2 Heisenberg model on the square lattice. Focusing on neural network architectures without physics-informed input, we argue in favor of using an ansatz consisting of two decoupled real-valued networks, one for the amplitude and the other for the phase of the variational wavefunction. By introducing concrete mitigation strategies against inherent numerical instabilities in the stochastic reconfiguration algorithm we obtain a variational energy comparable to that reported recently with neural networks that incorporate knowledge about the physical system. Through a detailed analysis of the individual components of the algorithm, we conclude that the rugged nature of the energy landscape constitutes the major obstacle in finding a satisfactory approximation to the ground state wavefunction, and prevents learning the correct sign structure. In particular, we show that in the present setup the neural network expressivity and Monte Carlo sampling are not primary limiting factors.
The use of artificial neural networks to represent quantum wave functions has recently attracted interest as a way to solve complex many-body problems. The potential of these variational parametrizations has been supported by analytical and numerical evidence in controlled benchmarks. While approaching the end of the early research phase in this field, it becomes increasingly important to show how neural-network states perform for models and physical problems that constitute a clear open challenge for other many-body computational methods. In this paper, we start addressing this aspect, concentrating on a presently unsolved model describing two-dimensional frustrated magnets. Using a fully convolutional neural network model as a variational ans\"atz, we study the frustrated spin-1/$2{J}_{1}\text{\ensuremath{-}}{J}_{2}$ Heisenberg model on the square lattice. We demonstrate that the resulting predictions for both ground-state energies and properties are competitive with, and often improve upon, existing state-of-the-art methods. In a relatively small region in the parameter space, corresponding to the maximally frustrated regime, our ans\"atz exhibits comparatively good but not the best performance. The gap between the complexity of the models adopted here and those routinely adopted in deep-learning applications is, however, still substantial, such that further improvements in future generations of neural-network quantum states are likely to be expected.
Neural networks have been used as variational wave functions for quantum many-particle problems. It has been shown that the correct sign structure is crucial to obtain highly-accurate ground state energies. In this paper, we propose a hybrid wave function combining the convolutional neural network (CNN) and projected entangled pair states (PEPS), in which the sign structures are determined by the PEPS, and the amplitudes of the wave functions are provided by CNN. We benchmark the ansatz on the highly frustrated spin-1/2 ${J}_{1}\text{\ensuremath{-}}{J}_{2}$ model. We show that the achieved ground energies are competitive with state-of-the-art results.
The challenge posed by the many-body problem in quantum physics originates from the difficulty of describing the nontrivial correlations encoded in the exponential complexity of the many-body wave function. Here we demonstrate that systematic machine learning of the wave function can reduce this complexity to a tractable computational form for some notable cases of physical interest. We introduce a variational representation of quantum states based on artificial neural networks with a variable number of hidden neurons. A reinforcement-learning scheme we demonstrate is capable of both finding the ground state and describing the unitary time evolution of complex interacting quantum systems. Our approach achieves high accuracy in describing prototypical interacting spins models in one and two dimensions.