Abstract Correlator product states (CPS) are a powerful and very broad class of states for quantum lattice systems whose (unnormalised) amplitudes in a fixed basis can be sampled exactly and efficiently. They work by gluing together states of overlapping clusters of sites on the lattice, called correlators. Recently Carleo and Troyer (2017 Science 355 602) introduced a new type sampleable ansatz called neural-network quantum states (NQS) that are inspired by the restricted Boltzmann model used in machine learning. By employing the formalism of tensor networks we show that NQS are a special form of CPS with novel properties. Diagramatically a number of simple observations become transparent. Namely, that NQS are CPS built from extensively sized GHZ-form correlators making them uniquely unbiased geometrically. The appearance of GHZ correlators also relates NQS to canonical polyadic decompositions of tensors. Another immediate implication of the NQS equivalence to CPS is that we are able to formulate exact NQS representations for a wide range of paradigmatic states, including superpositions of weighed-graph states, the Laughlin state, toric code states, and the resonating valence bond state. These examples reveal the potential of using higher dimensional hidden units and a second hidden layer in NQS. The major outlook of this study is the elevation of NQS to correlator operators allowing them to enhance conventional well-established variational Monte Carlo approaches for strongly correlated fermions.
Abstract Correlator product states (CPS) are a powerful and very broad class of states for quantum lattice systems whose (unnormalised) amplitudes in a fixed basis can be sampled exactly and efficiently. They work by gluing together states of overlapping clusters of sites on the lattice, called correlators. Recently Carleo and Troyer (2017 Science 355 602) introduced a new type sampleable ansatz called neural-network quantum states (NQS) that are inspired by the restricted Boltzmann model used in machine learning. By employing the formalism of tensor networks we show that NQS are a special form of CPS with novel properties. Diagramatically a number of simple observations become transparent. Namely, that NQS are CPS built from extensively sized GHZ-form correlators making them uniquely unbiased geometrically. The appearance of GHZ correlators also relates NQS to canonical polyadic decompositions of tensors. Another immediate implication of the NQS equivalence to CPS is that we are able to formulate exact NQS representations for a wide range of paradigmatic states, including superpositions of weighed-graph states, the Laughlin state, toric code states, and the resonating valence bond state. These examples reveal the potential of using higher dimensional hidden units and a second hidden layer in NQS. The major outlook of this study is the elevation of NQS to correlator operators allowing them to enhance conventional well-established variational Monte Carlo approaches for strongly correlated fermions.
Neural network quantum states (NQS) have been widely applied to spin-1/2 systems, where they have proven to be highly effective. The application to systems with larger on-site dimension, such as spin-1 or bosonic systems, has been explored less and predominantly using spin-1/2 Restricted Boltzmann Machines (RBMs) with a one-hot/unary encoding. Here, we propose a more direct generalization of RBMs for spin-1 that retains the key properties of the standard spin-1/2 RBM, specifically trivial product states representations, labeling freedom for the visible variables and gauge equivalence to the tensor network formulation. To test this new approach, we present variational Monte Carlo (VMC) calculations for the spin-1 anti-ferromagnetic Heisenberg (AFH) model and benchmark it against the one-hot/unary encoded RBM demonstrating that it achieves the same accuracy with substantially fewer variational parameters. Furthermore, we investigate how the hidden unit complexity of NQS depend on the local single-spin basis used. Exploiting the tensor network version of our RBM we construct an analytic NQS representation of the Affleck-Kennedy-Lieb-Tasaki (AKLT) state in the xyz spin-1 basis using only M=2N hidden units, compared to M∼O(N2) required in the Sz basis. Additional VMC calculations provide strong evidence that the AKLT state in fact possesses an exact compact NQS representation in the xyz basis with only M=N hidden units. These insights help to further unravel how to most effectively adapt the NQS framework for more complex quantum systems.
Neural network quantum states emerge as a promising tool for solving quantum many-body problems. However, its successes and limitations are still not well-understood in particular for Fermions with complex sign structures. Based on our recent work [J. Chem. Theory Comput. 21, 10252-10262 (2025)], we generalizes the restricted Boltzmann machine to a more general class of states for Fermions, formed by product of `neurons' and hence will be referred to as neuron product states (NPS). NPS builds correlation in a very different way, compared with the closely related correlator product states (CPS) [H. J. Changlani, et al. Phys. Rev. B, 80, 245116 (2009)], which use full-rank local correlators. In constrast, each correlator in NPS contains long-range correlations across all the sites, with its representational power constrained by the simple function form. We prove that products of such simple nonlocal correlators can approximate any wavefunction arbitrarily well under certain mild conditions on the form of activation functions. In addition, we also provide elementary proofs for the universal approximation capabilities of feedforward neural network (FNN) and neural network backflow (NNBF) in second quantization. Together, these results provide a deeper insight into the neural network representation of many-body wavefunctions in second quantization.
Neural network quantum states (NQS) have emerged as a powerful and flexible framework for addressing quantum many-body problems. While successful for model Hamiltonians, their application to molecular systems remains challenging for several reasons. In this work, we introduce three innovations to overcome some of the key limitations. (1) We develop a bounded-degree graph recurrent neural network (BDG–RNN) ansatz, which hybridizes the tensor network and neural network states and is more suitable to molecular electronic structure problems. As matrix product states (MPS) can be embedded into this ansatz, good initialization is possible for complex systems. (2) We introduce neural network correlators (NNCs) to further enhance expressivity and improve accuracy, without dramatically modifying the underlying variational Monte Carlo (VMC) optimization framework. Specifically, we introduce two types of restricted Boltzmann machine (RBM)-inspired correlators, namely, cos-RBM and Ising-RBM, which unlike previous correlators, such as Jastrow and real RBM, can adjust the sign structure of the wave function. (3) We introduce a semistochastic algorithm for local energy evaluation, which significantly reduces computational cost while maintaining high accuracy. Combining these advances, we demonstrate that our approaches can achieve chemical accuracy in challenging systems, including the one-dimensional hydrogen chain H 50, the iron–sulfur cluster [Fe 2 S 2 (SCH 3 ) 4 ] 2–, and a three-dimensional 3 × 3 × 2 hydrogen cluster H 18 . These methods are implemented in an open-source package, P y NQS ( https://github.com/Quantum-Chemistry-Group-BNU/PyNQS ), to advance NQS methodologies for quantum chemistry.
Neural-Network Quantum States have been recently introduced as an Ansatz for describing the wave function of quantum many-body systems. We show that there are strong connections between Neural-Network Quantum States in the form of Restricted Boltzmann Machines and some classes of Tensor-Network states in arbitrary dimensions. In particular we demonstrate that short-range Restricted Boltzmann Machines are Entangled Plaquette States, while fully connected Restricted Boltzmann Machines are String-Bond States with a nonlocal geometry and low bond dimension. These results shed light on the underlying architecture of Restricted Boltzmann Machines and their efficiency at representing many-body quantum states. String-Bond States also provide a generic way of enhancing the power of Neural-Network Quantum States and a natural generalization to systems with larger local Hilbert space. We compare the advantages and drawbacks of these different classes of states and present a method to combine them together. This allows us to benefit from both the entanglement structure of Tensor Networks and the efficiency of Neural-Network Quantum States into a single Ansatz capable of targeting the wave function of strongly correlated systems. While it remains a challenge to describe states with chiral topological order using traditional Tensor Networks, we show that Neural-Network Quantum States and their String-Bond States extension can describe a lattice Fractional Quantum Hall state exactly. In addition, we provide numerical evidence that Neural-Network Quantum States can approximate a chiral spin liquid with better accuracy than Entangled Plaquette States and local String-Bond States. Our results demonstrate the efficiency of neural networks to describe complex quantum wave functions and pave the way towards the use of String-Bond States as a tool in more traditional machine-learning applications.
Abstract Projected variational wavefunctions such as the Gutzwiller, many-body correlator and Jastrow ansatzes have provided crucial insight into the nature of superfluid-Mott insulator transition in the Bose Hubbard model (BHM) in two or more spatial dimensions. However, these ansatzes have no obvious tractable and systematic way of being improved. A promising alternative is to use Neural-network quantum states (NQS) based on Restricted Boltzmann Machines (RBMs). With binary visible and hidden units NQS have proven to be a highly effective at describing quantum states of interacting spin- 1 2 lattice systems. The application of NQS to bosonic systems has so far been based on one-hot encoding from machine learning where the multi-valued site occupation is distributed across several binary-valued visible units of an RBM. Compared to spin- 1 2 systems one-hot encoding greatly increases the number of variational parameters whilst also making their physical interpretation opaque. Here we revisit the construction of NQS for bosonic systems by reformulating a one-hot encoded RBM into a correlation operator applied to a reference state, analogous to the structure of the projected variational ansatzes. In this form we then propose a number of specialisations of the RBM motivated by the physics of the BHM and the ability to capture exactly the projected variational ansatzes. We analyse in detail the variational performance of these new RBM variants for a 10 × 10 BHM, using both a standard Bose condensate state and a pre-optimised Jastrow + many-body correlator state as the reference state of the calculation. Several of our new ansatzes give robust results as nearly good as one-hot encoding across the regimes of the BHM, but at a substantially reduced cost. Such specialised NQS are thus primed tackle bosonic lattice problems beyond the accuracy of classic variational wavefunctions.
Abstract Neural-network quantum states (NQSs) have become a powerful tool in many-body physics. Of the numerous possible architectures in which neural-networks can encode amplitudes of quantum states the simplicity of the complex restricted Boltzmann machine (RBM) has proven especially useful for both numerical and analytical studies. In particular devising exact NQS representations for important classes of states, like Jastrow and stabilizer states, has provided useful clues into the strengths and limitations of the RBM based NQS. However, current constructions for a system of N spins generate NQS with M ∼ O(N 2) hidden units that are very sparsely connected. This makes them rather atypical NQS compared to those commonly generated by numerical optimisation. Here we focus on compact NQS, denoting NQS with a hidden unit density α = M/N ⩽ 1 but with system-extensive hidden-visible unit connectivity. By unifying Jastrow and stabilizer states we introduce a new exact representation that requires at most M = N − 1 hidden units, illustrating how highly expressive α ⩽ 1 can be. Owing to their structural similarity to numerical NQS solutions our result provides useful insights and could pave the way for more families of quantum states to be represented exactly by compact NQS.