One characteristic that defines us, human beings, is the curiosity of the unknown. Since our birth, we have been trying to use any methods that human brains can comprehend to explore the nature: to mimic, to understand, and to utilize in a controlled and repeatable way. One of the most ancient means lies in the nature herself, experiments, leading to tremendous achievements from the creation of fire to the scissors of genes. Then comes mathematics, a new world we made by numbers and symbols, where the nature is reproduced by laws and theorems in an extremely simple, beautiful, and unprecedentedly accurate manner. With the explosive development of digital sciences, computer was created. It provided us the third way to investigate the nature, a digital world whose laws can be ruled by ourselves with codes and algorithms to numerically mimic the real universe. In this chapter, we briefly review the history of tensor network algorithms and the related progresses made recently. The organization of our lecture notes is also presented.
One characteristic that defines us, human beings, is the curiosity of the unknown. Since our birth, we have been trying to use any methods that human brains can comprehend to explore the nature: to mimic, to understand, and to utilize in a controlled and repeatable way. One of the most ancient means lies in the nature herself, experiments, leading to tremendous achievements from the creation of fire to the scissors of genes. Then comes mathematics, a new world we made by numbers and symbols, where the nature is reproduced by laws and theorems in an extremely simple, beautiful, and unprecedentedly accurate manner. With the explosive development of digital sciences, computer was created. It provided us the third way to investigate the nature, a digital world whose laws can be ruled by ourselves with codes and algorithms to numerically mimic the real universe. In this chapter, we briefly review the history of tensor network algorithms and the related progresses made recently. The organization of our lecture notes is also presented.
Tensor networks provide extremely powerful tools for the study of complex classical and quantum many-body problems. Over the past two decades, the increment in the number of techniques and applications has been relentless, and especially the last ten years have seen an explosion of new ideas and results that may be overwhelming for the newcomer. This short review introduces the basic ideas, the best established methods, and some of the most significant algorithmic developments that are expanding the boundaries of the tensor network potential. The goal of this review is to help the reader not only appreciate the many possibilities offered by tensor networks but also find their way through state-of-the-art codes, their applicability, and some avenues of ongoing progress.
Discover the foundations of classical and quantum information theory in the digital age with this modern introductory textbook. Familiarise yourself with core topics such as uncertainty, correlation, and entanglement before exploring modern techniques and concepts including tensor networks, quantum circuits and quantum discord. Deepen your understanding and extend your skills with over 250 thought-provoking end-of-chapter problems, with solutions for instructors, and explore curated further reading. Understand how abstract concepts connect to real-world scenarios with over 400 examples, including numerical and conceptual illustrations, and emphasising practical applications. Build confidence as chapters progressively increase in complexity, alternating between classic and quantum systems. This is the ideal textbook for senior undergraduate and graduate students in electrical engineering, computer science, and applied mathematics, looking to master the essentials of contemporary information theory.
The deepest structure of the cosmos resides in a perfect complementarity between two extremes. At the microscopic level, the quantum world is violent and indeterminate. The universe does not allow this indeterminacy to collapse into chaos; instead, it confines and organizes it through a rigorously geometric classical structure known as tensor networks. The absolute stability supplied by this classical scaffolding permits the underlying quantum entanglement to condense and, through emergence, to produce the solid Earth beneath our feet and the curved spacetime described by Einstein. The classical character of tensor computation—its stability, determinism, and capacity for controlled nonlinearity—is not a limitation. It is the universe’s highest engineering principle: classical tensors function as the ultimate container of order that tames quantum disorder. From the birth of the cosmos to the ultimate horizon of artificial intelligence, the same logic holds: both frameworks are indispensable. Classical structure locks in order; a quantum core supplies explosive speed and correlation. This paper examines the classical essence of tensor computation in contemporary AI systems, the fundamental physical obstructions that prevent its full quantumization, the striking structural isomorphism between AI tensor networks and the tensor-network constructions used in quantum gravity, and the consequent division of labor between classical AI capabilities and irreducibly human forms of understanding, originality, and responsibility.
Tensor network (TN), a young mathematical tool of high vitality and great potential, has been undergoing extremely rapid developments in the last two decades, gaining tremendous success in condensed matter physics, atomic physics, quantum information science, statistical physics, and so on. In this lecture notes, we focus on the contraction algorithms of TN as well as some of the applications to the simulations of quantum many-body systems. Starting from basic concepts and definitions, we first explain the relations between TN and physical problems, including the TN representations of classical partition functions, quantum many-body states (by matrix product state, tree TN, and projected entangled pair state), time evolution simulations, etc. These problems, which are challenging to solve, can be transformed to TN contraction problems. We present then several paradigm algorithms based on the ideas of the numerical renormalization group and/or boundary states, including density matrix renormalization group, time-evolving block decimation, coarse-graining/corner tensor renormalization group, and several distinguished variational algorithms. Finally, we revisit the TN approaches from the perspective of multi-linear algebra (also known as tensor algebra or tensor decompositions) and quantum simulation. Despite the apparent differences in the ideas and strategies of different TN algorithms, we aim at revealing the underlying relations and resemblances in order to present a systematic picture to understand the TN contraction approaches.
Quantum mechanics is usually defined in terms of some loosely connected axioms and rules. Such a foundation is far from the beauty of, e.g., the `principles' underlying classical mechanics. Motivated, in addition, by notorious interpretation problems, there have been numerous attempts to modify or `complete' quantum mechanics. A first attempt was based on so-called hidden variables; its proponents essentially tried to expel the non-classical nature of quantum mechanics. More recent proposals intend to complete quantum mechanics not within mechanics proper but on a `higher (synthetic) level'; by means of a combination with gravitation theory (R Penrose), with quantum information theory (C M Caves, C A Fuchs) or with psychology and brain science (H P Stapp). I think it is fair to say that in each case the combination is with a subject that, per se , suffers from a very limited understanding that is even more severe than that of quantum mechanics. This was acceptable, though, if it could convincingly be argued that scientific progress desperately needs to join forces. Quantum mechanics of a closed system was a beautiful and well understood theory with its respective state being presented as a point on a deterministic trajectory in Liouville space---not unlike the motion of a classical N -particle system in its 6N -dimensional phase-space. Unfortunately, we need an inside and an outside view, we need an external reference frame, we need an observer. This unavoidable partition is the origin of most of the troubles we have with quantum mechanics. A pragmatic solution is introduced in the form of so-called measurement postulates: one of the various incompatible properties of the system under consideration is supposed to be realized (i.e. to become a fact, to be defined without fundamental dispersion) based on `instantaneous' projections within some externally selected measurement basis. As a result, the theory becomes essentially statistical rather than deterministic; furthermore there is an asymmetry between the observed and the observing. This is the point where consciousness may come in. Complemented by an introduction and several appendices, Henry Stapp's book consists essentially of three parts: theory, implications, and new developments. The theory part gives a very readable account of the Copenhagen interpretation, some aspects of a psychophysical theory, and, eventually, hints towards a quantum foundation of the brain--mind connection. The next part, `implications', summarizes some previous attempts to bridge the gap between the working rules of quantum mechanics and their possible consequences for our understanding of this world (Pauli, Everett, Bohm, Heisenberg). The last section, `new developments', dwells on some ideas about the conscious brain and its possible foundation on quantum mechanics. The book is an interesting and, in part, fascinating contribution to a field that continues to be a companion to `practical' quantum mechanics since its very beginning. It is doubtful whether such types of `quantum ontologies' will ever become (empirically) testable; right now one can hardly expect more than to be offered some consistent `grand picture', which the reader may find more or less acceptable or even rewarding. Many practicing quantum physicists, though, will remain unimpressed. The shift from synthetic ontology to analytic ontology is the foundation of the present work. This means that fundamental wholes are being partitioned into their ontologically subordinate components by means of `events'. The actual event, in turn, is an abrupt change in the Heisenberg state describing the quantum universe. The new state then defines the tendencies associated with the next actual event. To avoid infinite regression in terms of going from one state of tendencies to the next, consciousness is there to give these events a special `feel', to provide a status of `intrinsic actuality'. The brain of an alert human observer is similar in an important way to a quantum detection device: it can amplify small signals to large macroscopic effects. On the other hand, actual events are not postulated to occur exclusively in brains. They are more generally associated with the formation of records. Records are necessarily part of the total state of the universe: it is obvious that the state of the universe cannot undergo a Schrödinger dynamics and at the same time record its own history. `The full universe consists therefore of an exceedingly thin veneer of relatively sluggish, directly observable properties resting on a vast ocean or rapidly fluctuating unobservable ones.' The present ideas also bear on how the world should be seen to develop. While conventional cosmology encounters problems as to how to define the intial conditions, which would enter the governing equations of motion, here `the boundary conditions are set not at some initial time, but gradually by a sequence of acts that imposes a sequence of constraints. After any sequence of acts there remains a collection of possible worlds, some of which will be eliminated by the next act.' Connected with those acts is `meaning': there has always been some speculation about the special significance of local properties in our understanding of the world. One could argue that correlations (even the quantum correlations found, e.g., in the EPR-experiments) were as real as anything else. But also Stapp stresses the special role of locality: the `local observable properties, or properties similar to them are the natural, and perhaps exclusive, carriers of meaning in the quantum universe. From this point of view the quantum universe tends to create meaning.' This sounds like an absolute concept: meaning not with respect to something else, but defined intrinsically---not easy to digest. The role of consciousness in the developing quantum universe requires more attention. `The causal irrelevance of our thoughts within classical physics constitutes a serious deficiency of that theory, construed as a description of reality.' This is taken to be entirely different within quantum mechanics. `The core idea of quantum mechanics is to describe our activities as knowledge-seeking and knowledge-using agents.' `21st century science does not reduce human beings to mechanical automata. Rather it elevates human beings to agents whose free choices can, according to the known laws, actually influence their behaviour.' An example with respect to perception is discussed: `Why, when we look at a triangle, do we experience three lines joined at three points and not some pattern of neuron firings?' The brain `does not convert an actual whole triangle into some jumbled set of particle motions; rather it converts a concatenation of separate external events into the actualization of some single integrated pattern of neural activity that is congruent to the perceived whole triangle.' How convincing is this proposal? It is hard to tell. I think Henry Stapp did a good job, but there are tight limitations to any such endeavour. Quantum mechanics is often strange indeed, but it also gives rise to our classical world around us. For the emergence of classicality jumps and measurement projections (the basic phenomena connected with those fundamental events of choice) are not needed. Therefore, I doubt whether the explanation of the evolution of our world really allows (or requires) that much free choice. On the other hand, most scientist will agree that empirical science was not possible without free will: we could not ask independent questions if this asking was part of a deterministic trajectory. The fact that the result of a quantum measurement is indeterminate (within given probabilities) does certainly not explain free will. How about the type of measurment? The experimentalist will have to assume that he can select the pertinent observable within some limits. But given a certain design the so-called pointer basis (producing stable measurement results) is no longer a matter of free choice. `The main theme of classical physics is that we live in a clocklike universe.' Today it is often assumed that the universe was a big (quantum-) computer or a cellular automaton. Many would be all too happy to leave that rather restrictive picture behind. But where to go? Stapp suggests giving consciousness a prominent role: `The most profound alteration of the fundamental principles was to bring consciousness of human beings into the basic structure of the physical theory.' How far we are able to go in this direction will depend on the amount of concrete research results becoming available to support this view.