Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Accuracy of restricted Boltzmann machines for the one-dimensional $J_1-J_2$ Heisenberg model

Luciano Loris Viteritti

Published May 1, 2022• 33 citations
Publisher

Abstract

Neural networks have been recently proposed as variational wave functions for quantum many-body systems [G. Carleo and M. Troyer, Science 355, 602 (2017)]. In this work, we focus on a specific architecture, known as Restricted Boltzmann Machine (RBM), and analyse its accuracy for the spin-1/2 $J_1-J_2$ antiferromagnetic Heisenberg model in one spatial dimension. The ground state of this model has a non-trivial sign structure, especially for $J_2/J_1>0.5$, forcing us to work with complex-valued RBMs. Two variational Ans\"atze are discussed: one defined through a fully complex RBM, and one in which two different real-valued networks are used to approximate modulus and phase of the wave function. In both cases, translational invariance is imposed by considering linear combinations of RBMs, giving access also to the lowest-energy excitations at fixed momentum $k$. We perform a systematic study on small clusters to evaluate the accuracy of these wave functions in comparison to exact results, providing evidence for the supremacy of the fully complex RBM. Our calculations show that this kind of Ans\"atze is very flexible and describes both gapless and gapped ground states, also capturing the incommensurate spin-spin correlations and low-energy spectrum for $J_2/J_1>0.5$. The RBM results are also compared to the ones obtained with Gutzwiller-projected fermionic states, often employed to describe quantum spin models [F. Ferrari, A. Parola, S. Sorella and F. Becca, Phys. Rev. B 97, 235103 (2018)]. Contrary to the latter class of variational states, the fully-connected structure of RBMs hampers the transferability of the wave function from small to large clusters, implying an increase of the computational cost with the system size.

DOI
10.21468/scipostphys.12.5.166

Related papers

Accuracy of restricted Boltzmann machines for the one-dimensional $J_1-J_2$ Heisenberg model

Luciano Loris Viteritti, Francesco Ferrari, Federico Becca

Neural networks have been recently proposed as variational wave functions for quantum many-body systems [G. Carleo and M. Troyer, Science 355, 602 (2017)]. In this work, we focus on a specific architecture, known as restricted Boltzmann machine (RBM), and analyse its accuracy for the spin-1/2 J_1-J_2 J 1 − J 2 antiferromagnetic Heisenberg model in one spatial dimension. The ground state of this model has a non-trivial sign structure, especially for J_2/J_1>0.5 J 2 / J 1 > 0.5 , forcing us to work with complex-valued RBMs. Two variational Ansätze are discussed: one defined through a fully complex RBM, and one in which two different real-valued networks are used to approximate modulus and phase of the wave function. In both cases, translational invariance is imposed by considering linear combinations of RBMs, giving access also to the lowest-energy excitations at fixed momentum k. We perform a systematic study on small clusters to evaluate the accuracy of these wave functions in comparison to exact results, providing evidence for the supremacy of the fully complex RBM. Our calculations show that this kind of Ansätze is very flexible and describes both gapless and gapped ground states, also capturing the incommensurate spin-spin correlations and low-energy spectrum for J_2/J_1>0.5 J 2 / J 1 > 0.5 . The RBM results are also compared to the ones obtained with Gutzwiller-projected fermionic states, often employed to describe quantum spin models [F. Ferrari, A. Parola, S. Sorella and F. Becca, Phys. Rev. B 97, 235103 (2018)]. Contrary to the latter class of variational states, the fully-connected structure of RBMs hampers the transferability of the wave function from small to large clusters, implying an increase in the computational cost with the system size.

arXiv:2202.07576•SciPost Physics•May 19, 2022•1 citation

Approximating power of machine-learning ansatz for quantum many-body states

Artem Borin, Dmitry A. Abanin

An artificial neural network (ANN) with the restricted Boltzmann machine (RBM) architecture was recently proposed as a versatile variational quantum many-body wave function. In this work we provide physical insights into the performance of this ansatz. We uncover the connection between the structure of the RBM and perturbation series, which explains the excellent precision achieved by the RBM ansatz in certain simple models, demonstrated in G. Carleo and M. Troyer [Science 355, 602 (2017)]. Based on this relation, we improve the numerical algorithm to achieve a better performance of the RBM in cases where local minima complicate the convergence to the global one. Furthermore, we study the performance of a sparse RBM for approximating ground states of random, translationally invariant models in one dimension, as well as random matrix-product states. We find that the error in approximating such states exhibits a broad distribution and shows a positive correlation with the entanglement properties of the targeted state.

arXiv:1901.08615•Physical review. B./Physical review. B•May 26, 2020•24 citations

Helping restricted Boltzmann machines with quantum-state representation by restoring symmetry

Yusuke Nomura

Abstract The variational wave functions based on neural networks have recently started to be recognized as a powerful ansatz to represent quantum many-body states accurately. In order to show the usefulness of the method among all available numerical methods, it is imperative to investigate the performance in challenging many-body problems for which the exact solutions are not available. Here, we construct a variational wave function with one of the simplest neural networks, the restricted Boltzmann machine (RBM), and apply it to a fundamental but unsolved quantum spin Hamiltonian, the two-dimensional J 1 – J 2 Heisenberg model on the square lattice. We supplement the RBM wave function with quantum-number projections, which restores the symmetry of the wave function and makes it possible to calculate excited states. Then, we perform a systematic investigation of the performance of the RBM. We show that, with the help of the symmetry, the RBM wave function achieves state-of-the-art accuracy both in ground-state and excited-state calculations. The study shows a practical guideline on how we achieve accuracy in a controlled manner.

arXiv:2009.14777•Journal of Physics Condensed Matter•Feb 3, 2021•87 citations

Neural Gutzwiller-projected variational wave functions

Francesco Ferrari, Federico Becca, Juan Carrasquilla

Variational wave functions have enabled exceptional scientific breakthroughs related to the understanding of novel phases of matter. Examples include the Bardeen-Cooper-Schrieffer theory of superconductivity, the description of the fractional quantum Hall effect through the Laughlin state, and Feynman's variational understanding of large-scale quantum effects in liquid helium. More recently, Gutzwiller-projected wave functions, typically constructed from fermionic degrees of freedom, have been employed to examine quantum spin models in the presence of competing interactions, where exotic phases with no spontaneous symmetry breaking and fractional excitations may exist. In this work, we investigate the aforementioned fermionic wave functions supplemented with neural networks, specifically with the so-called restricted Boltzmann machine (RBM), to boost their accuracy and obtain reliable approximations to the ground state of generic spin models. In particular, we apply our neural augmented fermionic construction to the description of both magnetically ordered and disordered phases of increasing complexity, including cases where the ground state displays a nontrivial sign structure. Even though the RBM state is by far more effective for N\'eel states endowed with a particularly simple sign structure, it provides a significant improvement over the original fermionic state in highly frustrated regimes where a complex sign structure is anticipated, thus marking the path to an understanding of strongly correlated spin models on the lattice via neural Gutzwiller-projected variational wave functions.

arXiv:1906.00463•Physical review. B./Physical review. B•Sep 13, 2019•93 citations

Machine learning approach to dynamical properties of quantum many-body systems

Douglas Hendry, Adrian E. Feiguin

Variational representations of quantum states abound and have successfully been used to guess ground-state properties of quantum many-body systems. Some are based on partial physical insight (Jastrow, Gutzwiller-projected, and fractional quantum Hall states, for instance), and others operate as a black box that may contain information about the underlying structure of entanglement and correlations (tensor networks, neural networks) and offer the advantage of a large set of variational parameters that can be efficiently optimized. However, using variational approaches to study excited states and, in particular, calculating the excitation spectrum, remains a challenge. We present a variational method to calculate the dynamical properties and spectral functions of quantum many-body systems in the frequency domain, where the Green's function of the problem is encoded in the form of a restricted Boltzmann machine (RBM). We introduce a natural gradient descent approach to solve linear systems of equations and use Monte Carlo to obtain the dynamical correlation function. In addition, we propose a strategy to regularize the results that improves the accuracy dramatically. As an illustration, we study the dynamical spin structure factor of the one dimensional ${J}_{1}\ensuremath{-}{J}_{2}$ Heisenberg model. The method is general and can be extended to other variational forms.

arXiv:1907.01384•Physical review. B./Physical review. B•Dec 12, 2019•40 citations

Dynamical structure factor of the J1−J2 Heisenberg model in one dimension: The variational Monte Carlo approach

Francesco Ferrari, Alberto Parola, Sandro Sorella +1 more

The dynamical spin structure factor is computed within a variational framework to study the one-dimensional ${J}_{1}\ensuremath{-}{J}_{2}$ Heisenberg model. Starting from Gutzwiller-projected fermionic wave functions, the low-energy spectrum is constructed from two-spinon excitations. The direct comparison with Lanczos calculations on small clusters demonstrates the excellent description of both gapless and gapped (dimerized) phases, including incommensurate structures for ${J}_{2}/{J}_{1}>0.5$. Calculations on large clusters show how the intensity evolves when increasing the frustrating ratio and give an unprecedented accurate characterization of the dynamical properties of (nonintegrable) frustrated spin models.

arXiv:1803.02359•Physical review. B./Physical review. B•Jun 5, 2018•51 citations
Accuracy of restricted Boltzmann machines for the one-dimensional J1−J2J_1-J_2J1​−J2​ Heisenberg model
Neural networks have been recently proposed as variational wave functions for quantum many-body systems [G. Carleo and M. Troyer, Science 355, 602 (2017)]. In this work, we focus on a specific architecture, known as Restricted Boltzmann Machine (RBM), and analyse its accuracy for the spin-1/2 J1−J2J_1-J_2J1​−J2​ antiferromagnetic Heisenberg model in one spatial dimension. The ground state of this model has a non-trivial sign structure, especially for J2/J1>0.5J_2/J_1>0.5J2​/J1​>0.5, forcing us to work with complex-valued RBMs. Two variational Ans"atze are discussed: one defined through a fully complex RBM, and one in which two different real-valued networks are used to approximate modulus and phase of the wave function. In both cases, translational invariance is imposed by considering linear combinations of RBMs, giving access also to the lowest-energy excitations at fixed momentum kkk. We perform a systematic study on small clusters to evaluate the accuracy of these wave functions in comparison to exact results, providing evidence for the supremacy of the fully complex RBM. Our calculations show that this kind of Ans"atze is very flexible and describes both gapless and gapped ground states, also capturing the incommensurate spin-spin correlations and low-energy spectrum for J2/J1>0.5J_2/J_1>0.5J2​/J1​>0.5. The RBM results are also compared to the ones obtained with Gutzwiller-projected fermionic states, often employed to describe quantum spin models [F. Ferrari, A. Parola, S. Sorella and F. Becca, Phys. Rev. B 97, 235103 (2018)]. Contrary to the latter class of variational states, the fully-connected structure of RBMs hampers the transferability of the wave function from small to large clusters, implying an increase of the computational cost with the system size.
Accuracy of restricted Boltzmann machines for the one-dimensional J1−J2J_1-J_2J1​−J2​ Heisenberg model
Neural networks have been recently proposed as variational wave functions for quantum many-body systems [G. Carleo and M. Troyer, Science 355, 602 (2017)]. In this work, we focus on a specific architecture, known as restricted Boltzmann machine (RBM), and analyse its accuracy for the spin-1/2 J_1-J_2 J 1 − J 2 antiferromagnetic Heisenberg model in one spatial dimension. The ground state of this model has a non-trivial sign structure, especially for J_2/J_1>0.5 J 2 / J 1 > 0.5 , forcing us to work with complex-valued RBMs. Two variational Ansätze are discussed: one defined through a fully complex RBM, and one in which two different real-valued networks are used to approximate modulus and phase of the wave function. In both cases, translational invariance is imposed by considering linear combinations of RBMs, giving access also to the lowest-energy excitations at fixed momentum k. We perform a systematic study on small clusters to evaluate the accuracy of these wave functions in comparison to exact results, providing evidence for the supremacy of the fully complex RBM. Our calculations show that this kind of Ansätze is very flexible and describes both gapless and gapped ground states, also capturing the incommensurate spin-spin correlations and low-energy spectrum for J_2/J_1>0.5 J 2 / J 1 > 0.5 . The RBM results are also compared to the ones obtained with Gutzwiller-projected fermionic states, often employed to describe quantum spin models [F. Ferrari, A. Parola, S. Sorella and F. Becca, Phys. Rev. B 97, 235103 (2018)]. Contrary to the latter class of variational states, the fully-connected structure of RBMs hampers the transferability of the wave function from small to large clusters, implying an increase in the computational cost with the system size.
An artificial neural network (ANN) with the restricted Boltzmann machine (RBM) architecture was recently proposed as a versatile variational quantum many-body wave function. In this work we provide physical insights into the performance of this ansatz. We uncover the connection between the structure of the RBM and perturbation series, which explains the excellent precision achieved by the RBM ansatz in certain simple models, demonstrated in G. Carleo and M. Troyer [Science 355, 602 (2017)]. Based on this relation, we improve the numerical algorithm to achieve a better performance of the RBM in cases where local minima complicate the convergence to the global one. Furthermore, we study the performance of a sparse RBM for approximating ground states of random, translationally invariant models in one dimension, as well as random matrix-product states. We find that the error in approximating such states exhibits a broad distribution and shows a positive correlation with the entanglement properties of the targeted state.
Abstract The variational wave functions based on neural networks have recently started to be recognized as a powerful ansatz to represent quantum many-body states accurately. In order to show the usefulness of the method among all available numerical methods, it is imperative to investigate the performance in challenging many-body problems for which the exact solutions are not available. Here, we construct a variational wave function with one of the simplest neural networks, the restricted Boltzmann machine (RBM), and apply it to a fundamental but unsolved quantum spin Hamiltonian, the two-dimensional J 1 – J 2 Heisenberg model on the square lattice. We supplement the RBM wave function with quantum-number projections, which restores the symmetry of the wave function and makes it possible to calculate excited states. Then, we perform a systematic investigation of the performance of the RBM. We show that, with the help of the symmetry, the RBM wave function achieves state-of-the-art accuracy both in ground-state and excited-state calculations. The study shows a practical guideline on how we achieve accuracy in a controlled manner.
Variational wave functions have enabled exceptional scientific breakthroughs related to the understanding of novel phases of matter. Examples include the Bardeen-Cooper-Schrieffer theory of superconductivity, the description of the fractional quantum Hall effect through the Laughlin state, and Feynman's variational understanding of large-scale quantum effects in liquid helium. More recently, Gutzwiller-projected wave functions, typically constructed from fermionic degrees of freedom, have been employed to examine quantum spin models in the presence of competing interactions, where exotic phases with no spontaneous symmetry breaking and fractional excitations may exist. In this work, we investigate the aforementioned fermionic wave functions supplemented with neural networks, specifically with the so-called restricted Boltzmann machine (RBM), to boost their accuracy and obtain reliable approximations to the ground state of generic spin models. In particular, we apply our neural augmented fermionic construction to the description of both magnetically ordered and disordered phases of increasing complexity, including cases where the ground state displays a nontrivial sign structure. Even though the RBM state is by far more effective for N\'eel states endowed with a particularly simple sign structure, it provides a significant improvement over the original fermionic state in highly frustrated regimes where a complex sign structure is anticipated, thus marking the path to an understanding of strongly correlated spin models on the lattice via neural Gutzwiller-projected variational wave functions.
Variational representations of quantum states abound and have successfully been used to guess ground-state properties of quantum many-body systems. Some are based on partial physical insight (Jastrow, Gutzwiller-projected, and fractional quantum Hall states, for instance), and others operate as a black box that may contain information about the underlying structure of entanglement and correlations (tensor networks, neural networks) and offer the advantage of a large set of variational parameters that can be efficiently optimized. However, using variational approaches to study excited states and, in particular, calculating the excitation spectrum, remains a challenge. We present a variational method to calculate the dynamical properties and spectral functions of quantum many-body systems in the frequency domain, where the Green's function of the problem is encoded in the form of a restricted Boltzmann machine (RBM). We introduce a natural gradient descent approach to solve linear systems of equations and use Monte Carlo to obtain the dynamical correlation function. In addition, we propose a strategy to regularize the results that improves the accuracy dramatically. As an illustration, we study the dynamical spin structure factor of the one dimensional ${J}_{1}\ensuremath{-}{J}_{2}$ Heisenberg model. The method is general and can be extended to other variational forms.
The dynamical spin structure factor is computed within a variational framework to study the one-dimensional ${J}_{1}\ensuremath{-}{J}_{2}$ Heisenberg model. Starting from Gutzwiller-projected fermionic wave functions, the low-energy spectrum is constructed from two-spinon excitations. The direct comparison with Lanczos calculations on small clusters demonstrates the excellent description of both gapless and gapped (dimerized) phases, including incommensurate structures for J2/J1>0.5{J}_{2}/{J}_{1}>0.5J2​/J1​>0.5. Calculations on large clusters show how the intensity evolves when increasing the frustrating ratio and give an unprecedented accurate characterization of the dynamical properties of (nonintegrable) frustrated spin models.