Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2108.08631 · Physical Review Research

Determinant-free fermionic wave function using feed-forward neural networks

Koji Inui, Yasuyuki Kato, Yukitoshi Motome

Published Nov 19, 2021• 30 citations
arXivHTMLPDF

Abstract

We propose a general framework for finding the ground state of many-body fermionic systems by using feed-forward neural networks. The anticommutation relation for fermions is usually implemented to a variational wave function by the Slater determinant (or Pfaffian), which is a computational bottleneck because of the numerical cost of $O({N}^{3})$ for $N$ particles. We bypass this bottleneck by explicitly calculating the sign changes associated with particle exchanges in real space and using fully connected neural networks for optimizing the rest parts of the wave function. This reduces the computational cost from $O({N}^{3})$ to $O({N}^{2})$ or less, while the overall cost depends on the number of Monte Carlo samples and the number of parameters in neural networks. We show that the accuracy of the approximation can be improved by optimizing the ``variance'' of the energy simultaneously with the energy itself. We also find that a reweighting method in Monte Carlo sampling can stabilize the calculation. These improvements can be applied to other approaches based on variational Monte Carlo methods. Moreover, we show that the accuracy can be further improved by using the symmetry of the system, the representative states, data preprocessing, and an additional neural network implementing a generalized Gutzwiller-Jastrow factor. We demonstrate the efficiency of the method by applying it to a two-dimensional Hubbard model.

DOI
10.1103/physrevresearch.3.043126

Related papers

Determinant-free fermionic wave function using feed-forward neural network

Koji Inui, Yasuyuki Kato, Yukitoshi Motome

We propose a general framework for finding the ground state of many-body fermionic systems by using feed-forward neural networks. The anticommutation relation for fermions is usually implemented to a variational wave function by the Slater determinant (or Pfaffian), which is a computational bottleneck because of the numerical cost of $O(N^3)$ for $N$ particles. We bypass this bottleneck by explicitly calculating the sign changes associated with particle exchanges in real space and using fully connected neural networks for optimizing the rest parts of the wave function. This reduces the computational cost to $O(N^2)$ or less. We show that the accuracy of the approximation can be improved by optimizing the variance of the energy simultaneously with the energy itself. We also find that a reweighting method in Monte Carlo sampling can stabilize the calculation. These improvements can be applied to other approaches based on variational Monte Carlo methods. Moreover, we show that the accuracy can be further improved by using the symmetry of the system, the representative states, and an additional neural network implementing a generalized Gutzwiller-Jastrow factor. We demonstrate the efficiency of the method by applying it to a two-dimensional Hubbard model.

•Aug 19, 2021•0 citations

Feed-forward neural network based variational wave function for the fermionic Hubbard model in one dimension

Md. Tahir Hossain Sarder, Amal Medhi

Abstract We explore the suitability of a feed-forward neural network (FNN) to represent the ground state of the fermionic Hubbard model in one dimension (1D). We consider the model at half-filling, represent the ground state wave function in terms of an FNN and optimize it using the variational Monte Carlo (VMC) method. The results are compared with the exact Bethe Ansatz solution. We find that for lattice sizes which give a ‘filled-shell’ condition for the non-interacting Fermi sea wave function, a simple FNN performs very well at all values of Hubbard interaction U. For lattice sizes where this condition is not obtained, the simple FNN fails and we find a modified network with a ‘sign’ component (sFNN) to work in such cases. On the flip side, though we find the FNN to be successful in providing an unbiased variational wave function for the fermionic many-body system in 1D, the computational cost for the wave function scales up rapidly with lattice size which limits its applicability.

Journal of Physics Condensed Matter•Jun 30, 2022•1 citation

$O(N^2)$ Universal Antisymmetry in Fermionic Neural Networks

Tianyu Pang, Shuicheng Yan, Min Lin

Fermionic neural network (FermiNet) is a recently proposed wavefunction Ansatz, which is used in variational Monte Carlo (VMC) methods to solve the many-electron Schrödinger equation. FermiNet proposes permutation-equivariant architectures, on which a Slater determinant is applied to induce antisymmetry. FermiNet is proved to have universal approximation capability with a single determinant, namely, it suffices to represent any antisymmetric function given sufficient parameters. However, the asymptotic computational bottleneck comes from the Slater determinant, which scales with $O(N^3)$ for $N$ electrons. In this paper, we substitute the Slater determinant with a pairwise antisymmetry construction, which is easy to implement and can reduce the computational cost to $O(N^2)$. We formally prove that the pairwise construction built upon permutation-equivariant architectures can universally represent any antisymmetric function. Besides, this universality can be achieved via continuous approximators when we aim to represent ground-state wavefunctions.

arXiv:2205.13205•May 26, 2022•4 citations

Backflow Transformations via Neural Networks for Quantum Many-Body Wave Functions

Di Luo, Bryan K. Clark

Obtaining an accurate ground state wave function is one of the great challenges in the quantum many-body problem. In this Letter, we propose a new class of wave functions, neural network backflow (NNB). The backflow approach, pioneered originally by Feynman and Cohen [Phys. Rev. 102, 1189 (1956)10.1103/PhysRev.102.1189], adds correlation to a mean-field ground state by transforming the single-particle orbitals in a configuration-dependent way. NNB uses a feed-forward neural network to learn the optimal transformation via variational Monte Carlo calculations. NNB directly dresses a mean-field state, can be systematically improved, and directly alters the sign structure of the wave function. It generalizes the standard backflow [L. F. Tocchio et al., Phys. Rev. B 78, 041101(R) (2008)10.1103/PhysRevB.78.041101], which we show how to explicitly represent as a NNB. We benchmark the NNB on Hubbard models at intermediate doping, finding that it significantly decreases the relative error, restores the symmetry of both observables and single-particle orbitals, and decreases the double-occupancy density. Finally, we illustrate interesting patterns in the weights and bias of the optimized neural network.

arXiv:1807.10770•Physical Review Letters•Jun 4, 2019•174 citations

Artificial Neural Networks as Trial Wave Functions for Quantum Monte Carlo

Jan Kessler, Francesco Calcavecchia, Thomas D. Kühne

Abstract Inspired by the universal approximation theorem and widespread adoption of artificial neural network techniques in a diversity of fields, feed‐forward neural networks are proposed as a general purpose trial wave function for quantum Monte Carlo simulations of continuous many‐body systems. Whereas for simple model systems the whole many‐body wave function can be represented by a neural network, the antisymmetry condition of non‐trivial fermionic systems is incorporated by means of a Slater determinant. To demonstrate the accuracy of the trial wave functions, an exactly solvable model system of two trapped interacting particles, as well as the hydrogen dimer, is studied.

arXiv:1904.10251•Advanced Theory and Simulations•Jan 25, 2021•30 citations

Symmetries and Many-Body Excitations with Neural-Network Quantum States

Kenny Choo, Giuseppe Carleo, Nicolas Regnault +1 more

Artificial neural networks have been recently introduced as a general ansatz to represent many-body wave functions. In conjunction with variational Monte Carlo calculations, this ansatz has been applied to find Hamiltonian ground states and their energies. Here, we provide extensions of this method to study excited states, a central task in several many-body quantum calculations. First, we give a prescription that allows us to target eigenstates of a (nonlocal) symmetry of the Hamiltonian. Second, we give an algorithm to compute low-lying excited states without symmetries. We demonstrate our approach with both restricted Boltzmann machines and feed-forward neural networks. Results are shown for the one-dimensional spin-1/2 Heisenberg model, and for the one-dimensional Bose-Hubbard model. When comparing to exact results, we obtain good agreement for a large range of excited-states energies. Interestingly, we find that deep networks typically outperform shallow architectures for high-energy states.

arXiv:1807.03325•Physical Review Letters•Oct 19, 2018•246 citations
We propose a general framework for finding the ground state of many-body fermionic systems by using feed-forward neural networks. The anticommutation relation for fermions is usually implemented to a variational wave function by the Slater determinant (or Pfaffian), which is a computational bottleneck because of the numerical cost of O(N3)O({N}^{3})O(N3) for NNN particles. We bypass this bottleneck by explicitly calculating the sign changes associated with particle exchanges in real space and using fully connected neural networks for optimizing the rest parts of the wave function. This reduces the computational cost from O(N3)O({N}^{3})O(N3) to O(N2)O({N}^{2})O(N2) or less, while the overall cost depends on the number of Monte Carlo samples and the number of parameters in neural networks. We show that the accuracy of the approximation can be improved by optimizing the ``variance'' of the energy simultaneously with the energy itself. We also find that a reweighting method in Monte Carlo sampling can stabilize the calculation. These improvements can be applied to other approaches based on variational Monte Carlo methods. Moreover, we show that the accuracy can be further improved by using the symmetry of the system, the representative states, data preprocessing, and an additional neural network implementing a generalized Gutzwiller-Jastrow factor. We demonstrate the efficiency of the method by applying it to a two-dimensional Hubbard model.
We propose a general framework for finding the ground state of many-body fermionic systems by using feed-forward neural networks. The anticommutation relation for fermions is usually implemented to a variational wave function by the Slater determinant (or Pfaffian), which is a computational bottleneck because of the numerical cost of O(N3)O(N^3)O(N3) for NNN particles. We bypass this bottleneck by explicitly calculating the sign changes associated with particle exchanges in real space and using fully connected neural networks for optimizing the rest parts of the wave function. This reduces the computational cost to O(N2)O(N^2)O(N2) or less. We show that the accuracy of the approximation can be improved by optimizing the variance of the energy simultaneously with the energy itself. We also find that a reweighting method in Monte Carlo sampling can stabilize the calculation. These improvements can be applied to other approaches based on variational Monte Carlo methods. Moreover, we show that the accuracy can be further improved by using the symmetry of the system, the representative states, and an additional neural network implementing a generalized Gutzwiller-Jastrow factor. We demonstrate the efficiency of the method by applying it to a two-dimensional Hubbard model.
Abstract We explore the suitability of a feed-forward neural network (FNN) to represent the ground state of the fermionic Hubbard model in one dimension (1D). We consider the model at half-filling, represent the ground state wave function in terms of an FNN and optimize it using the variational Monte Carlo (VMC) method. The results are compared with the exact Bethe Ansatz solution. We find that for lattice sizes which give a ‘filled-shell’ condition for the non-interacting Fermi sea wave function, a simple FNN performs very well at all values of Hubbard interaction U. For lattice sizes where this condition is not obtained, the simple FNN fails and we find a modified network with a ‘sign’ component (sFNN) to work in such cases. On the flip side, though we find the FNN to be successful in providing an unbiased variational wave function for the fermionic many-body system in 1D, the computational cost for the wave function scales up rapidly with lattice size which limits its applicability.
O(N2)O(N^2)O(N2) Universal Antisymmetry in Fermionic Neural Networks
Fermionic neural network (FermiNet) is a recently proposed wavefunction Ansatz, which is used in variational Monte Carlo (VMC) methods to solve the many-electron Schrödinger equation. FermiNet proposes permutation-equivariant architectures, on which a Slater determinant is applied to induce antisymmetry. FermiNet is proved to have universal approximation capability with a single determinant, namely, it suffices to represent any antisymmetric function given sufficient parameters. However, the asymptotic computational bottleneck comes from the Slater determinant, which scales with O(N3)O(N^3)O(N3) for NNN electrons. In this paper, we substitute the Slater determinant with a pairwise antisymmetry construction, which is easy to implement and can reduce the computational cost to O(N2)O(N^2)O(N2). We formally prove that the pairwise construction built upon permutation-equivariant architectures can universally represent any antisymmetric function. Besides, this universality can be achieved via continuous approximators when we aim to represent ground-state wavefunctions.
Obtaining an accurate ground state wave function is one of the great challenges in the quantum many-body problem. In this Letter, we propose a new class of wave functions, neural network backflow (NNB). The backflow approach, pioneered originally by Feynman and Cohen [Phys. Rev. 102, 1189 (1956)10.1103/PhysRev.102.1189], adds correlation to a mean-field ground state by transforming the single-particle orbitals in a configuration-dependent way. NNB uses a feed-forward neural network to learn the optimal transformation via variational Monte Carlo calculations. NNB directly dresses a mean-field state, can be systematically improved, and directly alters the sign structure of the wave function. It generalizes the standard backflow [L. F. Tocchio et al., Phys. Rev. B 78, 041101(R) (2008)10.1103/PhysRevB.78.041101], which we show how to explicitly represent as a NNB. We benchmark the NNB on Hubbard models at intermediate doping, finding that it significantly decreases the relative error, restores the symmetry of both observables and single-particle orbitals, and decreases the double-occupancy density. Finally, we illustrate interesting patterns in the weights and bias of the optimized neural network.
Abstract Inspired by the universal approximation theorem and widespread adoption of artificial neural network techniques in a diversity of fields, feed‐forward neural networks are proposed as a general purpose trial wave function for quantum Monte Carlo simulations of continuous many‐body systems. Whereas for simple model systems the whole many‐body wave function can be represented by a neural network, the antisymmetry condition of non‐trivial fermionic systems is incorporated by means of a Slater determinant. To demonstrate the accuracy of the trial wave functions, an exactly solvable model system of two trapped interacting particles, as well as the hydrogen dimer, is studied.
Artificial neural networks have been recently introduced as a general ansatz to represent many-body wave functions. In conjunction with variational Monte Carlo calculations, this ansatz has been applied to find Hamiltonian ground states and their energies. Here, we provide extensions of this method to study excited states, a central task in several many-body quantum calculations. First, we give a prescription that allows us to target eigenstates of a (nonlocal) symmetry of the Hamiltonian. Second, we give an algorithm to compute low-lying excited states without symmetries. We demonstrate our approach with both restricted Boltzmann machines and feed-forward neural networks. Results are shown for the one-dimensional spin-1/2 Heisenberg model, and for the one-dimensional Bose-Hubbard model. When comparing to exact results, we obtain good agreement for a large range of excited-states energies. Interestingly, we find that deep networks typically outperform shallow architectures for high-energy states.