Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2503.10380

Towards Using Matrix-Free Tensor Decompositions to Systematically Improve Approximate Tensor-Networks

Karl Pierce

Published Mar 13, 2025• 0 citations
arXivHTMLPDF

Abstract

We investigate a novel approach to approximate tensor-network contraction via the exact, matrix-free decomposition of full tensor-networks. We study this method as a means to eliminate the propagation of error in the approximation of tensor-networks. Importantly, this decomposition-based approach is generic, i.e. it does not depend on a specific tensor-network, the tensor index (physical) ordering, or the choice of tensor decomposition. Careful consideration should be made to determine the best decomposition strategy. Furthermore, this method does not rely on robust cancellation of errors (i.e. the Taylor expansion). As a means to study the effectiveness of the approach, we replace the exact contraction of the particle particle ladder (PPL) tensor diagram in the popular coupled-cluster with single and double excitation (CCSD) method with a low-rank tensor decomposition, namely the canonical polyadic decomposition (CPD). With this approach, we replace an $\mathcal{O}(N^6)$ tensor contractions with a potentially reduced-scaling $\mathcal{O}(N^4R)$ optimization problem, where $R$ is the CP rank, and we reduce the computational storage of the PPL tensor from $\mathcal{O}(N^4)$ to $\mathcal{O}(NR)$, although we do not take advantage of this compression in this study. To minimize the cost of the CPD optimization, we utilize the iterative structure of CCSD to efficiently initialize the CPD optimization. We show that accurate chemically-relevant energy values can be computed with an error of less than 1 kcal/mol using a relatively low CP rank.

DOI
10.48550/arxiv.2503.10380

Related papers

Toward Using Matrix-free Tensor Decompositions to Systematically Improve Approximate Tensor-Networks

Karl Pierce

We investigate a novel approach to approximate tensor-network contraction via the exact, matrix-free decomposition of full tensor-networks. We study this method as a means to eliminate the propagation of error in the approximation of tensor-networks. Importantly, this decomposition-based approach is generic, i.e., it does not depend on a specific tensor-network, the tensor index (physical) ordering, or the choice of tensor decomposition. Careful consideration should be made to determine the best decomposition strategy. Furthermore, this method does not rely on robust cancellation of errors (i.e., the Taylor expansion). As a means to study the effectiveness of the approach, we replace the exact contraction of the particle–particle ladder (PPL) tensor diagram in the popular coupled-cluster with single and double excitation (CCSD) method with a low-rank tensor decomposition, namely the canonical polyadic decomposition (CPD). With this approach, we replace an O ( N 6 ) tensor contractions with a potentially reduced-scaling O ( N 4 R ) optimization problem, where R is the CP rank, and we reduce the computational storage of the PPL tensor from O ( N 4 ) to O ( N R ), although we do not take advantage of this compression in this study. To minimize the cost of the CPD optimization, we utilize the iterative structure of CCSD to efficiently initialize the CPD optimization. We show that accurate chemically relevant energy values can be computed with an error of less than 1 kcal/mol using a relatively low CP rank.

Journal of Chemical Theory and Computation•Jun 26, 2025•3 citations

Using Matrix-Free Tensor-Network Optimizations To Construct a Reduced-Scaling and Robust Second-Order Moller-Plesset Theory

Karl Pierce, Miguel A. Morales

We investigate the efficient combination of the canonical polyadic decomposition (CPD) and tensor hyper-contraction (THC) approaches. We first present a novel low-cost CPD solver that leverages a precomputed THC factorization of an order-4 tensor to efficiently optimize the order-4 CPD with O ( N R 2 ) scaling. With the matrix-free THC-based optimization strategy in hand, we can efficiently generate CPD factorizations of the order-4 two-electron integral tensors and develop novel electronic structure methods that take advantage of both the THC and CPD approximations. Next, we investigate the application of a combined CPD and THC approximation of the Laplace transform (LT) second-order Mo̷ller-Plesset (MP2) method. We exploit the ability to switch efficiently between the THC and CPD factorizations of the two-electron integrals to reduce the computational complexity of the LT MP2 method while preserving the accuracy of the approach. Furthermore, we take advantage of the robust fitting approximation to eliminate the leading-order error in the CPD approximated tensor networks. Finally, we show that modest values of THC and CPD rank preserve the accuracy of the LT MP2 method and that this CPD + THC LT MP2 strategy realizes a performance advantage over canonical LT MP2 in both computational wall-times and memory resource requirements.

Journal of Chemical Theory and Computation•Jun 4, 2025•3 citations

Robust Approximation of Tensor Networks: Application to Grid-Free Tensor Factorization of the Coulomb Interaction

Karl Pierce, Varun Rishi, Edward F. Valeev

Approximation of a tensor network by approximating (e.g., factorizing) one or more of its constituent tensors can be improved by canceling the leading-order error due to the constituents’ approximation. The utility of such robust approximation is demonstrated for robust canonical polyadic (CP) approximation of a (density-fitting) factorized two-particle Coulomb interaction tensor. The resulting algebraic (grid-free) approximation for the Coulomb tensor, closely related to the factorization appearing in pseudospectral and tensor hypercontraction approaches, is efficient and accurate, with significantly reduced rank compared to the naive (nonrobust) approximation. Application of the robust approximation to the particle–particle ladder term in the coupled-cluster singles and doubles reduces the size complexity from O ( N 6 ) to O ( N 5 ) with robustness ensuring negligible errors in chemically relevant energy differences using CP ranks approximately equal to the size of the density-fitting basis.

arXiv:2012.13002•Journal of Chemical Theory and Computation•Mar 29, 2021•23 citations

Using Matrix-Free Tensor-Network Optimizations to Construct a Reduced-Scaling and Robust Second-Order Møller-Plesset Theory

Karl Pierce, Miguel A. Morales

We investigate the efficient combination of the canonical polyadic decomposition (CPD) and tensor hyper-contraction (THC) approaches. We first present a novel low-cost CPD solver which leverages a precomputed THC factorization of an order-$4$ tensor to efficiently optimize the order-$4$ CPD with $\mathcal{O}(NR^2)$ scaling. With the matrix-free THC-based optimization strategy in hand we can: efficiently generate CPD factorizations of the order-4 two-electron integral tensors; and develop novel electronic structure methods which take advantage of both the THC and CPD approximations. Next, we investigate the application of a combined CPD and THC approximation of the Laplace transform (LT) second-order Møller-Plesset (MP2) method. We exploit the ability to switch efficiently between the THC and CPD factorizations of the two electron integrals to reduce the computational complexity of the LT MP2 method while preserving the accuracy of the approach. Furthermore we take advantage of the robust fitting approximation to eliminate leading order error in the CPD approximated tensor networks. Finally, we show that modest values of THC and CPD rank preserve the accuracy of the LT MP2 method and that this CPD+THC LT MP2 strategy realizes a performance advantage over canonical LT MP2 in both computational wall-times and memory resource requirements.

arXiv:2502.17683•Feb 24, 2025•0 citations

Efficient Construction of Canonical Polyadic Approximations of Tensor Networks

Karl Pierce, Edward F. Valeev

We consider the problem of constructing a canonical polyadic (CP) decomposition for a tensor network, rather than a single tensor. We illustrate how it is possible to reduce the complexity of constructing an approximate CP representation of the network by leveraging its structure in the course of the CP factor optimization. The utility of this technique is demonstrated for the order-4 Coulomb interaction tensor approximated by two order-3 tensors via an approximate generalized square-root (SQ) factorization, such as density fitting or (pivoted) Cholesky. The complexity of constructing a four-way CP decomposition is reduced from O ( n 4 R CP ) (for the nonapproximated Coulomb tensor) to O ( n 3 R CP ) (for the SQ-factorized Coulomb tensor), where n and R CP are the basis and CP ranks, respectively. This reduces the cost of constructing the CP approximation of two-body interaction tensors of relevance to accurate many-body electronic structure by up to 2 orders of magnitude for systems with up to 36 atoms studied here. The full four-way CP approximation of the Coulomb interaction tensor is shown to be more accurate than the known approaches which utilize CP-factorizations of the SQ factors (which are also constructed with an O ( n 3 R CP ) cost), such as the algebraic pseudospectral and tensor hypercontraction approaches. The CP-decomposed SQ factors can also serve as a robust initial guess for the four-way CP factors.

arXiv:2208.09992•Journal of Chemical Theory and Computation•Dec 9, 2022•11 citations

A CPD-enabled low-scaling environment solver in a coupled cluster based static quantum embedding theory

Karl Pierce, Muhammad Talha Aziz, Avijit Shee +1 more

We incorporate a canonical polyadic decomposition (CPD) based low-level solver as a means to accelerate the environment-level solver for the recently developed MPCC embedding framework. Using CPD, we both factorize the three dominant order-three density-fitting two-electron integral (DF TEI) tensors and develop a novel formulation that reduces the storage complexity of the low-level solver from ${O}(N^3)$ to $O(NR)$, where $R$ is the CPD rank, and the computational scaling of the most time-consuming contractions from ${O}(N^4)$ to ${O}(NR^2)$. We provide benchmarks on representative chemical environments, namely water clusters $\mathrm{(H_2O)_n}$ with $n = 1$ to $6$ and linear alkane chains $\mathrm{C_nH_{2n+2}}$ with $n = 1$ to $6$. For both test sets, using the CPD-compressed DF TEI tensors reproduces the DF reference convergence behavior of the low-level solver, the subsequent high-level step, and the fully self-consistent MPCC iterations, while introducing only small, rank-controlled shifts in absolute energies. At a fixed tolerance in the absolute MPCC energy, the CP ranks required for these tensor approximations increase linearly with system size. Chemically relevant energy differences are likewise preserved, as demonstrated for water-cluster dissociation energies and in a proof-of-concept embedding calculation of methane in a four-water cluster.

arXiv:2602.15129•Feb 16, 2026•0 citations
We investigate a novel approach to approximate tensor-network contraction via the exact, matrix-free decomposition of full tensor-networks. We study this method as a means to eliminate the propagation of error in the approximation of tensor-networks. Importantly, this decomposition-based approach is generic, i.e. it does not depend on a specific tensor-network, the tensor index (physical) ordering, or the choice of tensor decomposition. Careful consideration should be made to determine the best decomposition strategy. Furthermore, this method does not rely on robust cancellation of errors (i.e. the Taylor expansion). As a means to study the effectiveness of the approach, we replace the exact contraction of the particle particle ladder (PPL) tensor diagram in the popular coupled-cluster with single and double excitation (CCSD) method with a low-rank tensor decomposition, namely the canonical polyadic decomposition (CPD). With this approach, we replace an O(N6)\mathcal{O}(N^6)O(N6) tensor contractions with a potentially reduced-scaling O(N4R)\mathcal{O}(N^4R)O(N4R) optimization problem, where RRR is the CP rank, and we reduce the computational storage of the PPL tensor from O(N4)\mathcal{O}(N^4)O(N4) to O(NR)\mathcal{O}(NR)O(NR), although we do not take advantage of this compression in this study. To minimize the cost of the CPD optimization, we utilize the iterative structure of CCSD to efficiently initialize the CPD optimization. We show that accurate chemically-relevant energy values can be computed with an error of less than 1 kcal/mol using a relatively low CP rank.
We investigate a novel approach to approximate tensor-network contraction via the exact, matrix-free decomposition of full tensor-networks. We study this method as a means to eliminate the propagation of error in the approximation of tensor-networks. Importantly, this decomposition-based approach is generic, i.e., it does not depend on a specific tensor-network, the tensor index (physical) ordering, or the choice of tensor decomposition. Careful consideration should be made to determine the best decomposition strategy. Furthermore, this method does not rely on robust cancellation of errors (i.e., the Taylor expansion). As a means to study the effectiveness of the approach, we replace the exact contraction of the particle–particle ladder (PPL) tensor diagram in the popular coupled-cluster with single and double excitation (CCSD) method with a low-rank tensor decomposition, namely the canonical polyadic decomposition (CPD). With this approach, we replace an O ( N 6 ) tensor contractions with a potentially reduced-scaling O ( N 4 R ) optimization problem, where R is the CP rank, and we reduce the computational storage of the PPL tensor from O ( N 4 ) to O ( N R ), although we do not take advantage of this compression in this study. To minimize the cost of the CPD optimization, we utilize the iterative structure of CCSD to efficiently initialize the CPD optimization. We show that accurate chemically relevant energy values can be computed with an error of less than 1 kcal/mol using a relatively low CP rank.
We investigate the efficient combination of the canonical polyadic decomposition (CPD) and tensor hyper-contraction (THC) approaches. We first present a novel low-cost CPD solver that leverages a precomputed THC factorization of an order-4 tensor to efficiently optimize the order-4 CPD with O ( N R 2 ) scaling. With the matrix-free THC-based optimization strategy in hand, we can efficiently generate CPD factorizations of the order-4 two-electron integral tensors and develop novel electronic structure methods that take advantage of both the THC and CPD approximations. Next, we investigate the application of a combined CPD and THC approximation of the Laplace transform (LT) second-order Mo̷ller-Plesset (MP2) method. We exploit the ability to switch efficiently between the THC and CPD factorizations of the two-electron integrals to reduce the computational complexity of the LT MP2 method while preserving the accuracy of the approach. Furthermore, we take advantage of the robust fitting approximation to eliminate the leading-order error in the CPD approximated tensor networks. Finally, we show that modest values of THC and CPD rank preserve the accuracy of the LT MP2 method and that this CPD + THC LT MP2 strategy realizes a performance advantage over canonical LT MP2 in both computational wall-times and memory resource requirements.
Approximation of a tensor network by approximating (e.g., factorizing) one or more of its constituent tensors can be improved by canceling the leading-order error due to the constituents’ approximation. The utility of such robust approximation is demonstrated for robust canonical polyadic (CP) approximation of a (density-fitting) factorized two-particle Coulomb interaction tensor. The resulting algebraic (grid-free) approximation for the Coulomb tensor, closely related to the factorization appearing in pseudospectral and tensor hypercontraction approaches, is efficient and accurate, with significantly reduced rank compared to the naive (nonrobust) approximation. Application of the robust approximation to the particle–particle ladder term in the coupled-cluster singles and doubles reduces the size complexity from O ( N 6 ) to O ( N 5 ) with robustness ensuring negligible errors in chemically relevant energy differences using CP ranks approximately equal to the size of the density-fitting basis.
We investigate the efficient combination of the canonical polyadic decomposition (CPD) and tensor hyper-contraction (THC) approaches. We first present a novel low-cost CPD solver which leverages a precomputed THC factorization of an order-444 tensor to efficiently optimize the order-444 CPD with O(NR2)\mathcal{O}(NR^2)O(NR2) scaling. With the matrix-free THC-based optimization strategy in hand we can: efficiently generate CPD factorizations of the order-4 two-electron integral tensors; and develop novel electronic structure methods which take advantage of both the THC and CPD approximations. Next, we investigate the application of a combined CPD and THC approximation of the Laplace transform (LT) second-order Møller-Plesset (MP2) method. We exploit the ability to switch efficiently between the THC and CPD factorizations of the two electron integrals to reduce the computational complexity of the LT MP2 method while preserving the accuracy of the approach. Furthermore we take advantage of the robust fitting approximation to eliminate leading order error in the CPD approximated tensor networks. Finally, we show that modest values of THC and CPD rank preserve the accuracy of the LT MP2 method and that this CPD+THC LT MP2 strategy realizes a performance advantage over canonical LT MP2 in both computational wall-times and memory resource requirements.
We consider the problem of constructing a canonical polyadic (CP) decomposition for a tensor network, rather than a single tensor. We illustrate how it is possible to reduce the complexity of constructing an approximate CP representation of the network by leveraging its structure in the course of the CP factor optimization. The utility of this technique is demonstrated for the order-4 Coulomb interaction tensor approximated by two order-3 tensors via an approximate generalized square-root (SQ) factorization, such as density fitting or (pivoted) Cholesky. The complexity of constructing a four-way CP decomposition is reduced from O ( n 4 R CP ) (for the nonapproximated Coulomb tensor) to O ( n 3 R CP ) (for the SQ-factorized Coulomb tensor), where n and R CP are the basis and CP ranks, respectively. This reduces the cost of constructing the CP approximation of two-body interaction tensors of relevance to accurate many-body electronic structure by up to 2 orders of magnitude for systems with up to 36 atoms studied here. The full four-way CP approximation of the Coulomb interaction tensor is shown to be more accurate than the known approaches which utilize CP-factorizations of the SQ factors (which are also constructed with an O ( n 3 R CP ) cost), such as the algebraic pseudospectral and tensor hypercontraction approaches. The CP-decomposed SQ factors can also serve as a robust initial guess for the four-way CP factors.
We incorporate a canonical polyadic decomposition (CPD) based low-level solver as a means to accelerate the environment-level solver for the recently developed MPCC embedding framework. Using CPD, we both factorize the three dominant order-three density-fitting two-electron integral (DF TEI) tensors and develop a novel formulation that reduces the storage complexity of the low-level solver from O(N3){O}(N^3)O(N3) to O(NR)O(NR)O(NR), where RRR is the CPD rank, and the computational scaling of the most time-consuming contractions from O(N4){O}(N^4)O(N4) to O(NR2){O}(NR^2)O(NR2). We provide benchmarks on representative chemical environments, namely water clusters (H2O)n\mathrm{(H_2O)_n}(H2​O)n​ with n=1n = 1n=1 to 666 and linear alkane chains CnH2n+2\mathrm{C_nH_{2n+2}}Cn​H2n+2​ with n=1n = 1n=1 to 666. For both test sets, using the CPD-compressed DF TEI tensors reproduces the DF reference convergence behavior of the low-level solver, the subsequent high-level step, and the fully self-consistent MPCC iterations, while introducing only small, rank-controlled shifts in absolute energies. At a fixed tolerance in the absolute MPCC energy, the CP ranks required for these tensor approximations increase linearly with system size. Chemically relevant energy differences are likewise preserved, as demonstrated for water-cluster dissociation energies and in a proof-of-concept embedding calculation of methane in a four-water cluster.