This work addresses J.A. Wheeler's critical idea that all things physical are information-theoretic in origin. In this paper, we introduce a novel mathematical framework based on information geometry, using the Fisher information metric as a particular Riemannian metric, defined in the parameter space of a smooth statistical manifold of normal probability distributions. Following this approach, we study the stationary states with the time-independent Schrödinger's equation to discover that the information could be represented and distributed over a set of quantum harmonic oscillators, one for each independent source of data, whose coordinate for each oscillator is a parameter of the smooth statistical manifold to estimate. We observe that the estimator's variance equals the energy levels of the quantum harmonic oscillator, proving that the estimator's variance is definitively quantized, being the minimum variance at the minimum energy level of the oscillator. Interestingly, we demonstrate that quantum harmonic oscillators reach the Cramér-Rao lower bound on the estimator's variance at the lowest energy level. In parallel, we find that the global probability density function of the collective mode of a set of quantum harmonic oscillators at the lowest energy level equals the posterior probability distribution calculated using Bayes' theorem from the sources of information for all data values, taking as a prior the Riemannian volume of the informative metric. Interestingly, the opposite is also true, as the prior is constant. Altogether, these results suggest that we can break the sources of information into little elements: quantum harmonic oscillators, with the square modulus of the collective mode at the lowest energy representing the most likely reality, supporting A. Zeilinger's recent statement that the world is not broken into physical but informational parts.
This work addresses J.A. Wheeler's critical idea that all things physical are information-theoretic in origin. In this paper, we introduce a novel mathematical framework based on information geometry, using the Fisher information metric as a particular Riemannian metric, defined in the parameter space of a smooth statistical manifold of normal probability distributions. Following this approach, we study the stationary states with the time-independent Schrödinger's equation to discover that the information could be represented and distributed over a set of quantum harmonic oscillators, one for each independent source of data, whose coordinate for each oscillator is a parameter of the smooth statistical manifold to estimate. We observe that the estimator's variance equals the energy levels of the quantum harmonic oscillator, proving that the estimator's variance is definitively quantized, being the minimum variance at the minimum energy level of the oscillator. Interestingly, we demonstrate that quantum harmonic oscillators reach the Cramér-Rao lower bound on the estimator's variance at the lowest energy level. In parallel, we find that the global probability density function of the collective mode of a set of quantum harmonic oscillators at the lowest energy level equals the posterior probability distribution calculated using Bayes' theorem from the sources of information for all data values, taking as a prior the Riemannian volume of the informative metric. Interestingly, the opposite is also true, as the prior is constant. Altogether, these results suggest that we can break the sources of information into little elements: quantum harmonic oscillators, with the square modulus of the collective mode at the lowest energy representing the most likely reality, supporting A. Zeilinger's recent statement that the world is not broken into physical but informational parts.
With this follow-up paper, we continue developing a mathematical framework based on information geometry for representing physical objects. The long-term goal is to lay down informational foundations for physics, especially quantum physics. We assume that we can now model information sources as univariate normal probability distributions N (μ, σ0), as before, but with a constant σ0 not necessarily equal to 1. Then, we also relaxed the independence condition when modeling m sources of information. Now, we model m sources with a multivariate normal probability distribution Nm(μ,Σ0) with a constant variance–covariance matrix Σ0 not necessarily diagonal, i.e., with covariance values different to 0, which leads to the concept of modes rather than sources. Invoking Schrödinger’s equation, we can still break the information into m quantum harmonic oscillators, one for each mode, and with energy levels independent of the values of σ0, altogether leading to the concept of “intrinsic”. Similarly, as in our previous work with the estimator’s variance, we found that the expectation of the quadratic Mahalanobis distance to the sample mean equals the energy levels of the quantum harmonic oscillator, being the minimum quadratic Mahalanobis distance at the minimum energy level of the oscillator and reaching the “intrinsic” Cramér–Rao lower bound at the lowest energy level. Also, we demonstrate that the global probability density function of the collective mode of a set of m quantum harmonic oscillators at the lowest energy level still equals the posterior probability distribution calculated using Bayes’ theorem from the sources of information for all data values, taking as a prior the Riemannian volume of the informative metric. While these new assumptions certainly add complexity to the mathematical framework, the results proven are invariant under transformations, leading to the concept of “intrinsic” information-theoretic models, which are essential for developing physics.
A statistical model M is a family of probability distributions, characterised by a set of continuous parameters known as the parameter space. This possesses natural geometrical properties induced by the embedding of the family of probability distributions into the space of all square–integrable functions. More precisely, by consideration of the square–root density function we can regard M as a submanifold of the unit sphere S in a real Hilbert space H. Therefore, H embodies the ‘state space’ of the probability distributions, and the geometry of the given statistical model can be described in terms of the embedding of M in S. The geometry in question is characterised by a natural Riemannian metric (the Fisher–Rao metric), thus allowing us to formulate the principles of classical statistical inference in a natural geometric setting. In particular, we focus attention on the variance lower bounds for statistical estimation, and establish generalisations of the classical Cramér–Rao and Bhattacharyya inequalities, described in terms of the geometry of the underlying real Hilbert space. As a comprehensive illustration of the utility of the geometric framework, the statistical model M is then specialised to the case of a submanifold of the state space of a quantum mechanical system. This is pursued by introducing a compatible complex structure on the underlying real Hilbert space, which allows the operations of ordinary quantum mechanics to be reinterpreted in the language of real Hilbert space geometry. The application of generalised variance bounds in the case of quantum statistical estimation leads to a set of higher order corrections to the Heisenberg uncertainty relations for canonically conjugate observables.
A statistical model M is a family of probability distributions, characterised by a set of continuous parameters known as the parameter space. This possesses natural geometrical properties induced by the embedding of the family of probability distributions into the space of all square–integrable functions. More precisely, by consideration of the square–root density function we can regard M as a submanifold of the unit sphere S in a real Hilbert space H. Therefore, H embodies the ‘state space’ of the probability distributions, and the geometry of the given statistical model can be described in terms of the embedding of M in S. The geometry in question is characterised by a natural Riemannian metric (the Fisher–Rao metric), thus allowing us to formulate the principles of classical statistical inference in a natural geometric setting. In particular, we focus attention on the variance lower bounds for statistical estimation, and establish generalisations of the classical Cramér–Rao and Bhattacharyya inequalities, described in terms of the geometry of the underlying real Hilbert space. As a comprehensive illustration of the utility of the geometric framework, the statistical model M is then specialised to the case of a submanifold of the state space of a quantum mechanical system. This is pursued by introducing a compatible complex structure on the underlying real Hilbert space, which allows the operations of ordinary quantum mechanics to be reinterpreted in the language of real Hilbert space geometry. The application of generalised variance bounds in the case of quantum statistical estimation leads to a set of higher order corrections to the Heisenberg uncertainty relations for canonically conjugate observables.
A statistical model M is specified by a family of probability distributions, characterised by a set of continuous parameters known as the parameter space. This possesses natural geometrical properties induced by the embedding of the family of probability distributions into the space of all square-integrable functions. More precisely, by consideration of the square-root density function we can regard M as a submanifold of the unit sphere S in a real Hilbert space H. Therefore, H effectively embodies the `state space' of the probability distributions, and the geometry of the given statistical model can be described in terms of the embedding of M in S. The geometry in question is characterised by a natural Riemannian metric (the Fisher-Rao metric), and as a consequence various aspects of classical statistical inference can be formulated in a natural geometric setting. In particular, we focus attention on the variance lower bounds for statistical estimation, and establish generalisations of the classical Cramér-Rao and Bhattacharyya bounds, described in terms of the geometry of the underlying real Hilbert space. The statistical model M can then be specialised to the case of a submanifold of the state space of a quantum mechanical system. This can be pursued by introducing a compatible complex structure on the underlying real Hilbert space, thus allowing the operations of ordinary quantum mechanics to be reinterpreted in the language of real Hilbert space geometry. The application of generalised variance bounds to quantum statistical estimation is shown to lead to higher order corrections to the Heisenberg uncertainty relations.
Abstract Our purpose here is to draw attention to an interesting relationship that can be shown to hold between (a) information geometry, and (b) quantum geometry. By ‘information geometry’, we mean the natural geometry associated with families of probability distributions. This is a subject that goes back more than half a century to the pioneering work of Rao (1945), who showed that the Fisher information matrix associated with a parametrised family of probability dis tributions gives rise to a natural Riemannian metric on the parameter space. This then allows one to speak in a precise way of the ‘distance’ between two probability distributions, an idea that turns out to be useful in problems of statistical inference. An extensive literature has thus developed, following this line of enquiry, on applications of differential geometry to statistics (see, e.g., Amari (1985), Barndorff-Nielsen et al. (1986), Murray and Rice (1993)). By ‘quantum geometry’, on the other hand, we mean the geometry of the manifold of states associated with a given quantum mechanical system. In particular, we consider the manifold of ‘pure’ states associated with a given complex Hilbert space. This is the space of ‘rays’ through the origin in the Hilbert space, which has the structure of a complex projective space. It is known that the usual rules of quantum mechanics allow one to construct a natural metric on this space, namely the Fubini-Study metric, the specification of which is equivalent to all the familiar structure associated with ordinary quantum mechanics.