Fisher's Information and Probability Dictated by Physics and Not Vice Versa?
Francesco R. Ruggeri
Abstract
Given a coin, one has two complementary pieces of information and a corresponding probability of .5 and .5. Similar considerations apply to a die. As a result, one may get the impression that there exists a unique probability distribution in a probabilistic system and that this single probability scheme is linked to the constrained maximization of Shannon’s entropy or Fisher’s information. We argue however, that there may be different probability schemes in the same problem associated with different pieces of information which are relevant to the physics which occurs in the system. Thus, we argue that it is the physics which selects the probability distribution to be examined. For example, one may loosely think in terms of a detailed probability scheme versus a kind-of coarse grained one in the same system. For example, for a quantum free particle, P(x)=1 i.e there is the same probability for a particle to be at any x point. This, however, is based on velocity, i.e. the relationship between dx and dt. There is another piece of information in the system, namely mo which together with v yields momentum (either relativistic or nonrelativistic) .This need not be measured using a clock (which velocity requires), but by the impact of an impulse on a target. Thus, nonrelativistically p=m1v1=m2v2 give the same impulse, but have different velocities. Quantum mechanics shows that a free particle is governed by exp(ipx) which contains two unnormalized probability distributions cos(px) and sin(px). These are key for impulse interactions (i.e. the physics of interactions such as with a 2-slit apparatus etc), yet exp(ipx)/sqrt(L) maps into the “coarse-grained” P(x)=exp(ipx)exp(-ipx) / L = constant. P(x) is one probability scheme in the problem and exp(ipx) another (for a free particle). Each answers some physical questions, but one needs to know which probability to use (i.e. what information is relevant) to a particular situation. P(x) is relevant to motion in space not involving interactions. exp(ipx) is relevant to interactions (even with a magnetic vector potential causing no magnetic field) or with a 2-slit apparatus. Furthermore, in a quantum bound state, one has W*(x)W(x) = P(x) (W(x)=wavefunction =Sum over p a(p)exp(ipx)) and a*(p)a(p).=P(p). Each probability scheme corresponds to the analysis of a different kind of measurement, but various schemes may also be linked. Thus one may have to start with one to create the others. For example, exp(ipx) is the base for creating W(x)=Sum over p a(p)exp(ipx), which ultimately yields P(x)=W*(x)W(x). As a result, we argue that if probability exists in a system, it is not necessarily the case that there is a unique probability distribution. There may be various probability schemes linked with different information and different measurements/interactions. Thus, physics leads one to focus on a specific probability scheme. As a result, we argue that one must be careful when discussing pure statistical quantities and their extremization, because these quantities, like Shannon’s entropy and Fisher’ s information, contain a classical probability distribution, but they do not indicate which distribution to use in the case that a system has more than one. . As a result, the analysis of a system requires knowledge of the physics (interactions) occurring.We argue against thinking in terms of physics following directly from statistical considerations. The constrained extremization of one statistical quantity may yield a probability distribution related to one piece of information, but not to another. Furthermore, Shannon’s entropy and Fisher’s information pertain to classical probability 0<=P(x)<1 and Integral P(x)dx =1. The wavefunction, exp(ipx)/sqrt(L), is comprised of two probability distributions and ADD and MULTIPLIES statistically (i.e. OR and AND ) situations, but is involved in relative average calculations because it is not normalized. It is also different because it allows for positive and negative values. These are properties which do not follow from statistics using a classical P(x).