arXiv:2207.12587 · The Journal of Chemical Physics
A truncated Davidson method for the efficient “chemically accurate” calculation of full configuration interaction wavefunctions without any large matrix diagonalization
This work develops and illustrates a new method of calculating “chemically accurate” electronic wavefunctions (and energies) via a truncated full configuration interaction (CI) procedure, which arguably circumvents the large matrix diagonalization that is the core problem of full CI and is also central to modern selective CI approaches. This is accomplished simply by following the standard/ubiquitous Davidson method in its “direct” form—wherein, in each iteration, the electronic Hamiltonian operator is applied directly in second quantization to the Ritz vector/wavefunction from the prior iteration—except that (in this work) only a small portion of the resultant expansion vector is actually even computed (through the application of only a similarly small portion of the Hamiltonian). Specifically, at each iteration of this truncated Davidson approach, the new expansion vector is taken to be twice as large as that from the prior iteration. In this manner, a small set of highly truncated expansion vectors (say 10–30) of increasing precision is incrementally constructed, forming a small subspace within which diagonalization of the Hamiltonian yields clear, consistent, and monotonically variational convergence to the approximate full CI limit. The good efficiency in which convergence to the level of chemical accuracy (1.6 mhartree) is achieved suggests, at least for the demonstrated problem sizes—Hilbert spaces of 1018 and wavefunctions of 108 determinants—that this truncated Davidson methodology can serve as a replacement of standard CI and complete-active space approaches in circumstances where only a few chemically significant digits of accuracy are required and/or meaningful in view of ever-present basis set limitations.
This work develops and illustrates a new method of calculating “chemically accurate” electronic wavefunctions (and energies) via a truncated full configuration interaction (CI) procedure, which arguably circumvents the large matrix diagonalization that is the core problem of full CI and is also central to modern selective CI approaches. This is accomplished simply by following the standard/ubiquitous Davidson method in its “direct” form—wherein, in each iteration, the electronic Hamiltonian operator is applied directly in second quantization to the Ritz vector/wavefunction from the prior iteration—except that (in this work) only a small portion of the resultant expansion vector is actually even computed (through the application of only a similarly small portion of the Hamiltonian). Specifically, at each iteration of this truncated Davidson approach, the new expansion vector is taken to be twice as large as that from the prior iteration. In this manner, a small set of highly truncated expansion vectors (say 10–30) of increasing precision is incrementally constructed, forming a small subspace within which diagonalization of the Hamiltonian yields clear, consistent, and monotonically variational convergence to the approximate full CI limit. The good efficiency in which convergence to the level of chemical accuracy (1.6 mhartree) is achieved suggests, at least for the demonstrated problem sizes—Hilbert spaces of 1018 and wavefunctions of 108 determinants—that this truncated Davidson methodology can serve as a replacement of standard CI and complete-active space approaches in circumstances where only a few chemically significant digits of accuracy are required and/or meaningful in view of ever-present basis set limitations.
We present quantum algorithms, for Hamiltonians of linear combinations of local unitary operators, for Hamiltonian matrix-vector products and for preconditioning with the inverse of shifted reduced Hamiltonian operator that contributes to the diagonal matrix elements only. The algorithms implement a convergent series of approximations towards the exact solution of the full CI (configuration interaction) problem. The algorithm scales with O(m^5 ), with m the number of one-electron orbitals in the case of molecular electronic structure calculations. Full CI results can be obtained with a scaling of O(nm^5 ), with n the number of electrons and a prefactor on the order of 10 to 20. With low orders of Hamiltonian matrix-vector products, a whole repertoire of approximations widely used in modern electronic structure theory, including various orders of perturbation theory and/or truncated CI at different orders of excitations can be implemented for quantum computing for both routine and benchmark results at chemical accuracy. The lowest order matrix-vector product with preconditioning, basically the second-order perturbation theory, is expected to be a leading algorithm for demonstrating quantum supremacy for Ab Initio simulations, one of the most anticipated real world applications. The algorithm is also applicable for the hybrid variational quantum eigensolver.
Abstract Recent advances in selected configuration interaction methods have made them competitive with the most accurate techniques available and, hence, creating an increasingly powerful tool for solving quantum Hamiltonians. In this work, we build on recent advances from the adaptive sampling configuration interaction (ASCI) algorithm. We show that a useful paradigm for generating efficient selected CI/exact diagonalization algorithms is driven by fast sorting algorithms, much in the same way iterative diagonalization is based on the paradigm of matrix vector multiplication. We present several new algorithms for all parts of performing a selected CI, which includes new ASCI search, dynamic bit masking, fast orbital rotations, fast diagonal matrix elements, and residue arrays. The ASCI search algorithm can be used in several different modes, which includes an integral driven search and a coefficient driven search. The algorithms presented here are fast and scalable, and we find that because they are built on fast sorting algorithms they are more efficient than all other approaches we considered. After introducing these techniques, we present ASCI results applied to a large range of systems and basis sets to demonstrate the types of simulations that can be practically treated at the full-CI level with modern methods and hardware, presenting double- and triple-ζ benchmark data for the G1 data set. The largest of these calculations is Si2H6 which is a simulation of 34 electrons in 152 orbitals. We also present some preliminary results for fast deterministic perturbation theory simulations that use hash functions to maintain high efficiency for treating large basis sets.
We propose an efficient deterministic method to calculate the full configuration interaction (FCI) ground state energy. This method leverages the sparseness of the Lanczos basis vectors that span the Krylov subspace associated with the Hamiltonian to rapidly calculate the lowest eigenvalue of the effective Hamiltonian formed in this basis. By iteratively performing the spanning and diagonalization steps, this method is capable of rapidly reaching chemical accuracy for a variety of strongly correlated molecules, including stretched N2 and C2, in merely several tens of iterations. To accelerate our algorithm, we implement parallelized sparse matrix-sparse vector multiplication, which features a novel hashing method that establishes a one-to-one correspondence between the set of full configuration Slater determinants and a set of consecutive integers. A near-linear acceleration was observed.
6098], we introduced a new approach for accurately approximating full CI ground states in large electronic active-spaces called Tensor Product Selected CI (TPSCI). In TPSCI, a large orbital active space is first partitioned into disjoint sets (clusters) for which the exact, local many-body eigenstates are obtained. Tensor products of these locally correlated many-body states are taken as the basis for the full, global Hilbert space. By folding correlation into the basis states themselves, the low-energy eigenstates become increasingly sparse, creating a more compact selected CI expansion. While we demonstrated that this approach can improve accuracy for a variety of systems, there is even greater potential for applications to excited states, particularly those which have some excited-state character. In this paper, we report on the accuracy of TPSCI for excited states, including a far more efficient implementation in the Julia programming language. In traditional SCI methods that use a Slater determinant basis, accurate excitation energies are obtained only after a linear extrapolation and at a large computational cost. We find that TPSCI with perturbative corrections provides accurate excitation energies for several excited states of various polycyclic aromatic hydrocarbons with respect to the extrapolated result (i.e., near exact result). Further, we use TPSCI to report highly accurate estimates of the lowest 31 eigenstates for a tetracene tetramer system with an active space of 40 electrons in 40 orbitals, giving direct access to the initial bright states and the resulting 18 doubly excited (biexcitonic) states.
Development of exponentially scaling methods has seen great progress in tackling larger systems than previously thought possible. One such technique, full configuration interaction quantum Monte Carlo, is a useful algorithm that allows exact diagonalization through stochastically sampling determinants. The method derives its utility from the information in the matrix elements of the Hamiltonian, along with a stochastic projected wave function, to find the important parts of Hilbert space. However, the stochastic representation of the wave function is not required to search Hilbert space efficiently, and here we describe a highly efficient deterministic method that can achieve chemical accuracy for a wide range of systems, including the difficult Cr2 molecule. We demonstrate for systems like Cr2 that such calculations can be performed in just a few cpu hours which makes it one of the most efficient and accurate methods that can attain chemical accuracy for strongly correlated systems. In addition our method also allows efficient calculation of excited state energies, which we illustrate with benchmark results for the excited states of C2.
Development of exponentially scaling methods has seen great progress in tackling larger systems than previously thought possible. One such technique, full configuration interaction quantum Monte Carlo, is a useful algorithm that allows exact diagonalization through stochastically sampling determinants. The method derives its utility from the information in the matrix elements of the Hamiltonian, along with a stochastic projected wave function, to find the important parts of Hilbert space. However, the stochastic representation of the wave function is not required to search Hilbert space efficiently, and here we describe a highly efficient deterministic method that can achieve chemical accuracy for a wide range of systems, including the difficult Cr2 molecule. We demonstrate for systems like Cr2 that such calculations can be performed in just a few cpu hours which makes it one of the most efficient and accurate methods that can attain chemical accuracy for strongly correlated systems. In addition our method also allows efficient calculation of excited state energies, which we illustrate with benchmark results for the excited states of C2.