We accelerated an ab initio molecular QMC calculation by using GPGPU. Only the bottle-neck part of the calculation is replaced by CUDA subroutine and performed on GPU. The performance on a (single core CPU + GPU) is compared with that on a (single core CPU with double precision), getting 23.6 (11.0) times faster calculations in single (double) precision treatments on GPU. The energy deviation caused by the single precision treatment was found to be within the accuracy required in the calculation, ∼10(-5) hartree. The accelerated computational nodes mounting GPU are combined to form a hybrid MPI cluster on which we confirmed the performance linearly scales to the number of nodes.
We accelerated an ab initio molecular QMC calculation by using GPGPU. Only the bottle-neck part of the calculation is replaced by CUDA subroutine and performed on GPU. The performance on a (single core CPU + GPU) is compared with that on a (single core CPU with double precision), getting 23.6 (11.0) times faster calculations in single (double) precision treatments on GPU. The energy deviation caused by the single precision treatment was found to be within the accuracy required in the calculation, ∼10(-5) hartree. The accelerated computational nodes mounting GPU are combined to form a hybrid MPI cluster on which we confirmed the performance linearly scales to the number of nodes.
Graphical Processing Units (GPUs) are highly parallel, programmable accelerators boasting high peak floating point performance. Over the last couple of years the use of GPUs for general purpose computing have revolutionized quantum chemistry. The computational bottleneck in an ab-initio quantum method is the calculation of a large number of twoelectron integrals. To date, a number of GPU accelerated two-electron integral implementations have been developed significantly improving the performance of a static quantum mechanical (QM) calculation. However, when performing an ab-initio QM gradient calculation, optimization, QM or Hybrid Quantum Mechanical/Molecular Mechanical (QM/MM) dynamics simulation the twoelectron integral derivatives arise as an additional bottleneck. Hybrid QM/MM methods particularly dynamics methods are commonly used to study large chemical/biological systems. These methods are a popular choice used for studying reaction mechanisms, conformational and configurational structures important in glycobiology. Usually a semiempirical QM method is used however, these have shown variable accuracy for the study of carbohydrate conformation and prevents an analytical investigation of electronic structure. The use of a higher level of theory, such as an ab initio method, is desirable however this comes at a much greater computational cost. Together with the bottlenecks above this cost results from the polarization of the QM region within an electrostatic embedding scheme, which requires the calculation of a large number of one-electron integral derivatives. Thus for QM/MM calculations the one-electron integral derivatives becomes a third bottleneck together with the two mentioned above. Recently, the above bottlenecks have become popular GPU acceleration targets. This thesis describes an extension of the GPU based Quantum Supercharger Library (QSL) to perform the above calculations/simulations. In contrast to GPU packages developed from the ground up, the QSL is a library of routines aimed at accelerating legacy codes, such as GAMESS-UK, GAMESS-US and NWChem, used in electronic structure calculations. Algorithms are presented for accelerating the one- and two-electron integral derivatives on a GPU. In addition to the derivatives, the one-electron integral calculation was ported to the GPU in order to remove a small additional cost arising for large QM/MM systems. Furthermore, the use of automatic code generation for generating GPU kernels was explored and compared to the original approach. Using the QSL library implemented in GAMESS-UK several benchmark calculations and simulations were performed. These were performed in double precision on a single GPU (Kepler K20) and compared to a single CPU using the 6-31G basis set. A speedup of up to 9.3X is achieved for an ab initio gradient calculation compared to the CPU running an optimized serial version of GAMESS-UK using the Schlegel method. For a single point QM/MM calculation of cellobiose in different sized water spheres (3267-24843 point charges) speedups of between 13X and 34X is achieved. QSL/GAMESS-UK coupled to the CHARMM molecular dynamics package was then used in order to perform accelerated molecular dynamics simulations. Benchmark QM and QM/MM molecular dynamics simulations were performed on cellobiose in vacuo and in a water sphere (45 QM atoms and 24843 point charges respectively). The QSL is able to perform 9.7 ps/day of ab initio QM dynamics and 6.4 ps/day of QM/MM dynamics. Testing of the auto-generated version of the QSL showed better performance for lower angular momentum classes but reduced performance for higher angular momentum classes. The efficiency of the integral and derivative routines within the QSL library was tested on a computationally intense realistic glycobiological condensed phase free energy computation. Ab-initio pucker free energy surfaces/volumes of !-Ribofuranose and !-Glucopyranose in vacuum and in water were computed. These are the first converged Hartree-Fock/MM free energy simulations for these carbohydrates performed in solution. The value of the ab initio Free energy surfaces/volumes was demonstrated through an analysis of solvent polarization effects that are evident through a comparison of the vacuum and solution minimum free energy pathways. In particular the water structure around the pucker conformers, analysis of the primary alcohol distribution as well as analysis of the electronic structure of these conformers reveals that water significantly affects the free energy pathways, primary alcohol distribution and the barriers for inter-conversion between pucker conformers.
Heterogeneous nodes composed of a multicore CPU and at least one graphics processing unit (GPU) are increasingly common in high-performance scientific computing, and significant programming effort is currently being undertaken to port existing scientific algorithms to these unique architectures. We present implementations for two many-body quantum chemistry methods on heterogeneous nodes: the coupled-cluster with single and double excitations (CCSD) and time-dependent configuration interaction with single and double excitations (TD-CISD) methods. Both methods can be implemented on a computer as a series of dense matrix-matrix multiplications, operations that GPUs are particularly adept at performing. The GPU-accelerated CCSD algorithm is as much as 4.3 times faster than the corresponding CPU algorithm and 9.7 times faster than the algorithm in the Molpro package. The TD-CISD algorithm is accelerated by as much as a factor of 3.9 by GPUs. Enhanced performance is achieved by overlapping CPU and GPU computations.
It has been shown that coupled-cluster calculations with single-precision data are able to provide correlation energy with insignificant loss of accuracy. In this work, we employed consumer GPUs to accelerate open-shell spin-unrestricted CCSD and CCSD(T) calculations based on single-precision data. Some open-shell molecules are calculated to benchmark the acceleration performance of GPUs. In CCSD calculations, good acceleration performance on consumer GPUs is achieved for molecules when all the two-electron integrals can be saved in the host memory. On the other hand, I/O operations cost a lot of time for larger molecules and the performance of GPUs is not as significant. Good acceleration performance can usually be obtained in calculating the (T) correction employing GPUs since matrix contractions are always more costly than other operations. For systems with less than four hundred basis functions, our single-precision GPU code could provide an acceleration of 4-14 times for CCSD calculations and 12-20 times for (T) correction compared with double-precision CPU codes on the same hardware level.
The coupled cluster (CC) ansatz is generally recognized as providing one of the best wave function-based descriptions of electronic correlation in small- and medium-sized molecules. The fact that the CC equations with double excitations (CCD) may be expressed as a handful of dense matrix-matrix multiplications makes it an ideal method to be ported to graphics processing units (GPUs). We present our implementation of the spin-free CCD equations in which the entire iterative procedure is evaluated on the GPU. The GPU-accelerated algorithm readily achieves a factor of 4-5 speedup relative to the multithreaded CPU algorithm on same-generation hardware. The GPU-accelerated algorithm is approximately 8-12 times faster than Molpro, 17-22 times faster than NWChem, and 21-29 times faster than GAMESS for each CC iteration. Single-precision GPU-accelerated computations are also performed, leading to an additional doubling of performance. Single-precision errors in the energy are typically on the order of 10(-6) hartrees and can be improved by about an order of magnitude by performing one additional iteration in double precision.
An algorithm is presented for the coupled-cluster singles, doubles, and perturbative triples correction [CCSD(T)] method based on the density fitting or the resolution-of-the-identity (RI) approximation for performing calculations on heterogeneous computing platforms composed of multicore CPUs and graphics processing units (GPUs). The directive-based approach to GPU offloading offered by the OpenMP application programming interface has been employed to adapt the most compute-intensive terms in the RI-CCSD amplitude equations with computational costs scaling as O ( N O 2 N V 4 ), O ( N O 3 N V 3 ), and O ( N O 4 N V 2 ) (where N O and N V denote the numbers of correlated occupied and virtual orbitals, respectively) and the perturbative triples correction to execute on GPU architectures. The pertinent tensor contractions are performed using an accelerated math library such as cuBLAS or hipBLAS. Optimal strategies are discussed for splitting large data arrays into tiles to fit them into the relatively small memory space of the GPUs, while also minimizing the low-bandwidth CPU–GPU data transfers. The performance of the hybrid CPU–GPU RI-CCSD(T) code is demonstrated on pre-exascale supercomputers composed of heterogeneous nodes equipped with NVIDIA Tesla V100 and A100 GPUs and on the world’s first exascale supercomputer named “Frontier”, the nodes of which consist of AMD MI250X GPUs. Speedups within the range 4–8× relative to the recently reported CPU-only algorithm are obtained for the GPU-offloaded terms in the RI-CCSD amplitude equations. Applications to polycyclic aromatic hydrocarbons containing 16–66 carbon atoms demonstrate that the acceleration of the hybrid CPU–GPU code for the perturbative triples correction relative to the CPU-only code increases with the molecule size, attaining a speedup of 5.7× for the largest circumovalene molecule (C 66 H 20 ). The GPU-offloaded code enables the computation of the perturbative triples correction for the C 60 molecule using the cc-pVDZ/aug-cc-pVTZ-RI basis sets in 7 min on Frontier when using 12,288 AMD GPUs with a parallel efficiency of 83.1%.
Traditional molecular dynamics simulations have been providing crucial support to the fields of physics, chemistry, and materials science for many years. However, recent research efforts have increasingly focused on microphysical phenomena and quantum effects. Given the cost and complexity of experimental studies, quantum molecular dynamics simulations have emerged as a viable alternative for research. Despite their potential, existing simulation projects are hindered by the limited performance of CPUs. To overcome this limitation, we present an advanced and efficient implementation of Electron Field Force (EFF) model. The Electron Field Force (EFF) model, based on wave-particle duality and numerical approximation, can effectively provide an accurate correction to the conventional results derived from traditional methods. In this paper, a GPU-accelerated version of the EFF model is proposed to enhance simulation capabilities significantly. Our implementation has achieved a remarkable speedup of 90x on a single A100 GPU node. Additionally, we have developed a scalable multi-GPU version using MPI+CUDA technology for further scalability, which greatly extends the scope of research in quantum molecular dynamics.