Quantum many-body problems are some of the most challenging problems in science and are central to demystifying some exotic quantum phenomena, e.g., high-temperature superconductors. The combination of neural networks (NN) for representing quantum states, coupled with the Variational Monte Carlo (VMC) algorithm, has been shown to be a promising method for solving such problems. However, the run-time of this approach scales quadratically with the number of simulated particles, constraining the practically usable NN to - in machine learning terms - minuscule sizes (<10M parameters). Considering the many breakthroughs brought by extreme NN in the +1B parameters scale to other domains, lifting this constraint could significantly expand the set of quantum systems we can accurately simulate on classical computers, both in size and complexity. We propose a NN architecture called Vector-Quantized Neural Quantum States (VQ-NQS) that utilizes vector-quantization techniques to leverage redundancies in the local-energy calculations of the VMC algorithm - the source of the quadratic scaling. In our preliminary experiments, we demonstrate VQ-NQS ability to reproduce the ground state of the 2D Heisenberg model across various system sizes, while reporting a significant reduction of about ${\times}10$ in the number of FLOPs in the local-energy calculation.
Quantum many-body problems are some of the most challenging problems in science and are central to demystifying some exotic quantum phenomena, e.g., high-temperature superconductors. The combination of neural networks (NN) for representing quantum states, coupled with the Variational Monte Carlo (VMC) algorithm, has been shown to be a promising method for solving such problems. However, the run-time of this approach scales quadratically with the number of simulated particles, constraining the practically usable NN to - in machine learning terms - minuscule sizes (<10M parameters). Considering the many breakthroughs brought by extreme NN in the +1B parameters scale to other domains, lifting this constraint could significantly expand the set of quantum systems we can accurately simulate on classical computers, both in size and complexity. We propose a NN architecture called Vector-Quantized Neural Quantum States (VQ-NQS) that utilizes vector-quantization techniques to leverage redundancies in the local-energy calculations of the VMC algorithm - the source of the quadratic scaling. In our preliminary experiments, we demonstrate VQ-NQS ability to reproduce the ground state of the 2D Heisenberg model across various system sizes, while reporting a significant reduction of about ×10 in the number of FLOPs in the local-energy calculation.
Quantum many-body computation is a central challenge across multiple domains of scientific research, and Monte Carlo method has emerged as one of the most effective numerical techniques for investigating large-scale many-body systems. In recent years, the integration of Monte Carlo methods with machine learning has led to the development of neural quantum state approach. Quantum neural networks (QNNs) offer superior expressiveness compared to classical neural networks. In this paper, we propose a novel Quantum Neural Network Quantum State (QNNQS) method, based on the variational Monte Carlo framework. This approach leverages a quantum neural network to represent the many-body quantum state, and optimizes it iteratively through gradient descent to determine the ground-state energy. To assess the performance of this method, we conduct simulations of the one-dimensional transverse-field Ising model, investigating the influence of quantum circuit architecture on circuit expressibility, entangling capability, and computational accuracy. The results demonstrate that the QNNQS method achieves comparable simulation accuracy while utilizing significantly fewer parameters and requiring less training resources than classical network quantum state methods.
Understanding strongly correlated quantum many-body systems requires dealing with a largeconfiguration space comprised of a set of all possible measurable configurations. The total number of configurations grows exponentially with the size of the system, which makes exact numerical calculations impossible for even moderately sized systems. Since the advent of high-temperature superconductivity and the subsequent interest in strongly correlated phases of matter, progress in the field has been marked by ingenuity of the field to overcome these computational limitations. The first techniques to emerge were inspired by quantum chemistry and based on exact diagonalization[1], which is limited to small clusters, and different variants of quantum Monte Carlo[2], that suffers from the sign problem in fermionic and frustrated systems. Circa 1992, the density matrix renormalization group (DMRG) [3, 4, 5, 6, 7] became one of the major breakthroughs of the past few decades. Despite the success of DMRG for one-dimensional(1D) and quasi-one-dimensional geometries, extensions to actual two-dimensional systems remain challenging and applications are constrained to long cylinders and strips. One promising alternative is to combine one the oldest methods, variational wave functions (VWFs), with neural networks, which have been used to recently with great success in machine learning. The focus of this dissertation is on developing novel variational Monte Carlo algorithms to make neural network variational wave functions applicable to many problems in quantum many-body physics. These algorithms draw from existing variational wave-function, tensor network, and machine learning methods. We calculate dynamical spectral functions using the vector correction and Chebyshev expansion method. We do finite temperature calculations with minimally entangled thermal states. Finally, we do ground state calculations for the frustrated J1−J2 Heisenberg model. We benchmark these results using restricted Boltzmann machines as the neural network for the the variational wave-functions.--Author's abstract
Abstract With diverse architectures and strong expressivity, neural-network quantum states (NQS) offer an alternative to traditional variational ansätze for simulating physical systems. Energy-based models such as Hopfield networks and Restricted Boltzmann Machines draw on statistical physics, mapping quantum states onto energy landscapes as associative memories. We show these models can be trained efficiently with Monte Carlo accelerated by quantum devices. Our algorithm scales linearly with circuit width and depth, uses constant measurements, avoids mid-circuit measurements, and requires polynomial storage. It treats both phase and amplitude fields, enlarging the trial space. Sampling on quantum hardware shortens mixing times and yields more faithful estimates, revealing a quantum-assisted advantage. We demonstrate accurate learning of ground states for local spin models and nonlocal electronic-structure Hamiltonians, including at distorted geometries with strong multi-reference correlation. Benchmarks show close agreement and high robustness highlighting promise of machine-learning protocols paired with near-term quantum devices for state learning in chemistry and condensed-matter physics.
The central challenge in materials science and quantum chemistry is solving the electronic Schrodinger equation, complicated by the curse of dimensionality as system size grows. Neural network-based variational Monte Carlo (NN-VMC) offers a promising path forward, achieving unprecedented accuracy at far lower cost than traditional high-level methods. However, the flexibility of neural network wavefunctions introduces a bottleneck: their optimization is high-dimensional, stochastic, and non-convex. This Perspective reviews the evolution of optimization methods in NN-VMC, from stochastic reconfiguration to approximate second-order algorithms and geometric insights. We highlight key challenges currently limiting scalability and efficiency, and outline future opportunities to advance the field. With continued progress in optimization, neural network techniques, and computer architectures, NN-VMC can tackle larger and more complex quantum systems and move from trailing experiments to guiding them.
Neural-network quantum states (NQS) is an exciting area of quantum-inspired machine learning, wherein a fully classical neural network is used to efficiently learn the optimal state vector for a quantum unsupervised learning problem, bypassing the need to model the full Hilbert space, which is exponentially large. In theory, NQS architectures are broadly applicable, and have been demonstrated successfully on several fundamental applications. We seek to further explore the practical utility of NQS as a black box solver for various applications in the scientific computing domain. We first present NQS as an explicit avenue for de-quantizing variational quantum eigensolvers, demonstrating with the variational quantum linear solver (VQLS). We then explore the utility of VQLS and its de-quantization, VNLS, as black box matrix inversion tools for a Newton-based linear complementarity solver, used to model the time evolution of a rudimentary granular medium. Turning our attention toward applications of NQS in quantum chemistry, we introduce a new retentive network (RetNet) autoregressive NQS ansatz to solve electronic ground state problems, and explore the incorporation of neural annealing techniques to these problems as a means of improving accuracy and ease of training. We finish with a rudimentary scaling law analysis of the RetNet architecture and its immediate autoregressive predecessors as applied to electronic structure calculations.
Simulating strongly correlated fermionic systems remains a fundamental challenge in quantum physics, largely due to the sign problem in quantum Monte Carlo (QMC) methods. We present a neural network-based variational Monte Carlo (NN-VMC) approach, leveraging a flexible neural network ansatz to represent the many-body wavefunction. Focusing on quantum dots with up to 30 electrons, we demonstrate that NN-VMC significantly reduces variational bias and achieves ground-state energies surpassing those of fixed-node diffusion Monte Carlo (DMC). A key feature is that the neural network adaptively learns and optimizes nodal structures during energy minimization. We provide qualitative insights into the nodal structure of fermionic wavefunctions by comparing the nodal structures generated by NN-VMC with those obtained from traditional trial functions. Additionally, we reveal spin-resolved radial distributions and electron density profiles, highlighting the versatility and accuracy of NN-VMC. This work underscores the potential of machine learning to advance quantum simulations and deepen our understanding of strongly correlated systems.