Tensor Network Contraction and Multi-Linear Algebra

Abstract

This chapter is aimed at understanding TN algorithms from the perspective of MLA Multi-linear algebra (MLA) . In Sect. 5.1, we start from a simple example with a 1D TN Tensor network (TN) stripe, which can be “contracted” by solving the eigenvalue decomposition of matrices. This relates to several important MPS techniques such as canonicalization (Orús and Vidal, Phys Rev B 78:155117, 2008) that enables to implement optimal truncations of the bond dimensions of MPSs Matrix product state (MPS) (Sect. 5.1.1). In Sect. 5.2, we discuss about super-orthogonalization (Ran et al., Phys Rev B 86:134429, 2012) inspired by Tucker decomposition (De Lathauwer et al., SIAM J Matrix Anal Appl 21(4):1324–1342, 2000) in MLA, which is also a higher-dimensional generalization of canonicalization; it is proposed to implement optimal truncations of the iPEPSs defined on trees. In Sect. 5.3.1, we explain based on the rank-1 decomposition (De Lathauwer et al., SIAM J Matrix Anal Appl 21:1253–1278, 2000) that super-orthogonalization in fact provides the “loopless approximation” of the iPEPSs Infinite projected entangled pair state (iPEPS) on regular lattices (Ran et al., Phys Rev B 88:064407, 2013); it explains how the approximations in the simple update algorithm works for the ground-state simulations on 2D regular lattices (Jiang et al., Phys Rev Lett 101:090603, 2008). In Sect. 5.4, we will discuss tensor ring decomposition (TRD) Tensor ring decomposition (TRD) (Ran, Phys Rev E 93:053310, 2016), which is a rank-N generalization of the rank-1 decomposition. TRD naturally provides a unified description of iDMRG (White, Phys Rev Lett 69:2863, 1992; Phys Rev B 48:10345–10356, 1993; McCulloch, Infinite size density matrix renormalization group, revisited, 2008. arXiv:0804.2509) Infinite density matrix renormalization group (iDMRG) , iTEBD (Vidal, Phys Rev Lett 98:070201, 2007) Infinite time-evolving block decimation (iTEBD) , and CTMRG Corner transfer matrix renormalization group (CTMRG) (Orús and Vidal, Phys Rev B 80:094403, 2009; Fishman et al., Faster methods for contracting infinite 2D tensor networks, 2017. arXiv:1711.05881) when considering the contractions of 2D TNs Tensor network (TN) .