I review the proposal made in my 2004 book [1], that quantum theory is an emergent theory arising from a deeper level of dynamics. The dynamics at this deeper level is taken to be an extension of classical dynamics to non-commuting matrix variables, with cyclic permutation inside a trace used as the basic calculational tool. With plausible assumptions, quantum theory is shown to emerge as the statistical thermodynamics of this underlying theory, with the canonical commutation-anticommutation relations derived from a generalized equipartition theorem. Brownian motion corrections to this thermodynamics are argued to lead to state vector reduction and to the probabilistic interpretation of quantum theory, making contact with phenomenological proposals [2, 3] for stochastic modifications to Schrödinger dynamics.
I review the proposal made in my 2004 book [1], that quantum theory is an emergent theory arising from a deeper level of dynamics. The dynamics at this deeper level is taken to be an extension of classical dynamics to non-commuting matrix variables, with cyclic permutation inside a trace used as the basic calculational tool. With plausible assumptions, quantum theory is shown to emerge as the statistical thermodynamics of this underlying theory, with the canonical commutation-anticommutation relations derived from a generalized equipartition theorem. Brownian motion corrections to this thermodynamics are argued to lead to state vector reduction and to the probabilistic interpretation of quantum theory, making contact with phenomenological proposals [2, 3] for stochastic modifications to Schrödinger dynamics.
Quantum mechanics is our most successful physical theory. However, it raises conceptual issues that have perplexed physicists and philosophers of science for decades. This 2004 book develops an approach, based on the proposal that quantum theory is not a complete, final theory, but is in fact an emergent phenomenon arising from a deeper level of dynamics. The dynamics at this deeper level are taken to be an extension of classical dynamics to non-commuting matrix variables, with cyclic permutation inside a trace used as the basic calculational tool. With plausible assumptions, quantum theory is shown to emerge as the statistical thermodynamics of this underlying theory, with the canonical commutation/anticommutation relations derived from a generalized equipartition theorem. Brownian motion corrections to this thermodynamics are argued to lead to state vector reduction and to the probabilistic interpretation of quantum theory, making contact with phenomenological proposals for stochastic modifications to Schrödinger dynamics.
We consider the classical dynamics of bosonic and fermionic matrix variables in complex Hilbert space, defined by a trace action, assuming cyclic invariance under the trace and the presence of a global unitary invariance. With plausible and explicitly stated assumptions, including the existence of a large hierarchy of scale between the underlying dynamics and observed physics, we show that (1) the equilibrium statistical mechanics of this matrix dynamics, in the canonical ensemble, gives rise to an emergent quantum mechanics for many degrees of freedom, including the standard canonical commutation/anticommutation relations and the usual unitary Heisenberg and Schrödinger picture time evolutions of operators and states, and (2) the fluctuation or Brownian motion corrections to this thermodyamics lead to an energy-driven stochastic modification of the Schrödinger equation, which is known to imply state vector reduction with Born rule probabilities. Thus, quantum mechanics and its probabilistic interpretation both arise as emergent phenomena in the underlying trace dynamics.
We introduce a realist, unextravagant interpretation of quantum theory that builds on the existing physical structure of the theory and allows experiments to have definite outcomes, but leaves the theory's basic dynamical content essentially intact. Much as classical systems have specific states that evolve along definite trajectories through configuration spaces, the traditional formulation of quantum theory asserts that closed quantum systems have specific states that evolve unitarily along definite trajectories through Hilbert spaces, and our interpretation extends this intuitive picture of states and Hilbert-space trajectories to the case of open quantum systems as well. We provide independent justification for the partial-trace operation for density matrices, reformulate wave-function collapse in terms of an underlying interpolating dynamics, derive the Born rule from deeper principles, resolve several open questions regarding ontological stability and dynamics, address a number of familiar no-go theorems, and argue that our interpretation is ultimately compatible with Lorentz invariance. Along the way, we also investigate a number of unexplored features of quantum theory, including an interesting geometrical structure---which we call subsystem space---that we believe merits further study. We include an appendix that briefly reviews the traditional Copenhagen interpretation and the measurement problem of quantum theory, as well as the instrumentalist approach and a collection of foundational theorems not otherwise discussed in the main text.
This article examines the scope and limitations of quantum mechanics in its Schrödinger and Dirac formulations. Quantum theory provides an extraordinarily precise description of how physical states evolve, interfere, and produce measurable probabilities. However, like other foundational theories, it presupposes a specific mathematical structure—complex Hilbert spaces, linear unitary dynamics, an external time parameter, and the Born rule—that it does not itself explain. The work argues that quantum mechanics answers the question of how quantum states behave, but not the deeper question of why physical reality admits a state-based, probabilistic description at all. To address this missing level of explanation, the article places quantum mechanics within the broader framework of the Thermodynamic Imperative of Order (TIO) and the Granular Entropic Program (GEP). Within this framework, quantum states are interpreted as emergent, statistically stable macroscopic representations of typical correlations in high-dimensional configuration spaces. Linearity, unitarity, and the Born rule arise as necessary consequences of measure concentration and stability, rather than as fundamental postulates. The article does not propose modifications to quantum mechanics. Instead, it clarifies the domain of validity of the theory and explains why a framework with its structure and remarkable universality must exist if stable quantum phenomena are to be observed at all.
Recently, the possibility of investigating single molecule, or single spin observables, as well as the necessity of a better understanding of the mechanisms underlying quantum dynamics in order to obtain nanoscale devices and nanostructered materials suitable for quantum computing tasks, have revived the interest in foundational aspects of quantum statistical mechanics. This thesis aims to give a contribution to this field by re-considering the statistical characterization of a quantum system at the light of some paradigmatic changes in our understanding of quantum theory which have taken place in the last two decades. In particular the impressive development of quantum information theory has changed the perceptions of quantum entanglement: for a long time it has been considered a somewhat paradoxical property of the matter at the atomic scale, but now it is regarded as an essential and ubiquitous phenomenon whose consequences are affecting the very macroscopic world that we experience. Still the decoherence program has brought out the importance of considering a quantum system together with its environment in order to clarify some key aspects of quantum dynamics. Thus, we start from the idea that quantum correlations are ubiquitous and somewhat uncontrollable in systems with many degrees of freedom which are typically considered in statistical mechanics. As a consequence we assume the standpoint that quantum statistical mechanics has not to be based on the underlying idea of a collection of many, independent quantum systems but rather it has to emerge at the level of a global wavefunction (pure state) which describes the system as well as its environment as a whole. In order to investigate the consequences of these assumptions we study the equilibrium distribution of an isolated quantum system. This is defined, in analogy with the ergodic foundations of classical statistical mechanics, on the basis of the time evolution of the quantum state. Then, we study the emergence of thermodynamic properties in a quantum system by studying the probability distribution of some function of interests, as the entropy and the equilibrium state of a subsystem, on Ensembles of Pure States. Such a probability distribution is derived from the geometry of the Hilbert space, and the theoretical tools suitable for its characterization are developed. On the one hand we perform a numerical sampling of the ensemble distributions by employing Monte Carlo techniques, on the other hand simpler analytical approximation of the geometrical distributions are derived by means of a maximum entropy principle. Model systems composed of an ensemble of spins are chosen to illustrate the salient features which emerge from the developed theoretical framework: the main point is that the Ensemble Distributions of “thermodynamic observables” (entropy or equilibrium state of a subsystem) are sharply peaked around a typical value. From the analysis it emerges that each of the overwhelming majority of the wavefunctions which has appreciable weight in the considered ensemble, is characterized by the same value of the “macroscopic” functions. This is a striking evidence of the “typicality” of these properties. In the essence, our impossibility to know the state of the system in detail does not matter, just for the remarkable fact that almost all quantum states behave essentially in the same way. By virtue of this typicality the study of the behaviour of the typical values of the thermodynamic function become meaningful. Notably, under certain conditions, one recovers the results of standard statistical mechanics, that is, the equilibrium average of the state of a subsystem can be cast in the Boltzmann canonical form at the temperature given by the usual thermodynamical relation . In the second part of the thesis we consider the dynamical aspects of the equilibrium state of a subsystem interacting with its environment. The fluctuations around the equilibrium average critically depends on the entanglement between the system and the environment and on the form of the interaction Hamiltonian. The connection between the dynamics of the fluctuations of an observable at the equilibrium and the relaxation toward the equilibrium from a “non typical” initial value is also investigated with the aid of simple model systems. The study presented in this thesis was partly motivated by a critical analysis of the statistical methods available for the theoretical modelling of magnetic resonance experiments. One of these, the Stochastic Liouville Equation, has been employed in a work completed during the first year of my Ph.D. program in order to interpret some feature of a two dimensional electron spin resonance experiment, [Fresch B., Frezzato D., Moro G. J., Kothe G., Freed J. H.; J. Phys. Chem. B., 110, 24238, (2006)].