This is the second, mathematically more detailed part of a paper consisting of two articles, the first having appeared in the immediately preceding issue of this Journal∗. It shows that a measurement converts a pure case into a mixture with reducible probabilities. The measurement as such permits no inference whatever as to the state of the physical system subjected to measurement after the measurement has been performed. But because the probabilities after the act are classical and therefore reducible, it is often possible to adjust them so that Von Neumann's projection postulate is true. Among the more specific features dealt with in Part II is the occurrence of negative joint probabilities for the measurement of non-commuting operators in certain (not all!) quantum states. The general conclusions reached are stated at the end of the article.
This is the second, mathematically more detailed part of a paper consisting of two articles, the first having appeared in the immediately preceding issue of this Journal∗. It shows that a measurement converts a pure case into a mixture with reducible probabilities. The measurement as such permits no inference whatever as to the state of the physical system subjected to measurement after the measurement has been performed. But because the probabilities after the act are classical and therefore reducible, it is often possible to adjust them so that Von Neumann's projection postulate is true. Among the more specific features dealt with in Part II is the occurrence of negative joint probabilities for the measurement of non-commuting operators in certain (not all!) quantum states. The general conclusions reached are stated at the end of the article.
Although there is a complete consensus among working physicists with respect to the practical and operational meanings of quantum states, and also a rather loosely formulated general philosophic view called the Copenhagen interpretation, a great deal of confusion and divergence of opinions exist as to the details of the measurement process and its effects upon quantum states. This paper reviews the current expositions of the measurement problem, limiting itself for lack of space primarily to the writings of physicists; it calls attention to inconsistencies and proposes resolutions. Except for a summary of the properties of statistical matrices which are needed in Part II, the first part is non-mathematical and deals largely with two kinds of probability, reducible and irreducible probabilities, which need to be distinguished for a proper understanding of the measurement act.
The paper first scrutinizes thoroughly the variety of compositions which lead to the same quantum-mechanical mixture (as opposed to state or pure state ). With respect to a given mixture every state has a definite probability (or mixing fraction) between 0 and 1 (including the limits), which is calculated from the mixtures Statistical Operator and the wave function of the state in question. A well-known example of mixtures occurs when a system consists of two separated parts. If the wave function of the whole system is known, either part is in the situation of a mixture, which is decomposed into definite constituents by a definite measuring programme to be carried out on the other part. All the conceivable decompositions (into linearly independent constituents) of the first system are just realized by all the possible measuring programmes that can be carried out on the second one. In general every state of the first system can be given a finite chance by a suitable choice of the programme. It is suggested that these conclusions, unavoidable within the present theory but repugnant to some physicists including the author, are caused by applying non-relativistic quantum mechanics beyond its legitimate range. An alternative possibility is indicated.
An attempt to extend the postulational basis of quantum theory by introducing correlations between the results of measurements, developed in this article, leads to negative joint probabilities for otherwise meaningful sets of measured values. Since, so far as can be seen, the attempt made is the only one compatible with the theory of random variables, and is incompatible with the structure of Hilbert space, we conclude that correlations are absent. This result, though it is tantamount to a denial of von Neumann's projection postulate and the “reduction of wave packets” on measurement, is nevertheless shown to be entirely satisfactory from the physical point of view.
Extracting information from a quantum system inevitably requires the performance of a measurement, and it is no surprise that the theory of measurement plays a central role in our subject. The physical nature of the measurement process remains one of the great philosophical problems in the formulation of quantum theory. Fortunately, however, it is sufficient for us to take a pragmatic view by asking what measurements are possible and how the theory describes them, without addressing the physical mechanism of the measurement process. This is the approach we shall adopt. We shall find that it leads us to a powerful and general description of both the probabilities associated with measurement outcomes and the manner in which the observation transforms the quantum state of the measured system. The simplest form of measurement was given a mathematical formulation by von Neumann, and we shall refer to measurements of this type as von Neumann measurements or projective measurements. It is this description of measurements that is usually introduced in elementary quantum theory courses. We start with an observable quantity A represented by a Hermitian operator Â, the eigenvalues of which are the possible results of the measurement of A. The relationship between the operator, its eigenstates {|λnñ}, and its (real) eigenvalues {λn} is expressed by the eigenvalue equation . . . Â |λn_ = λn|λn_. (4.1) . . .
``Quantum'' stands for for the concepts (both operational and formal) which had to be added to classical physics in order to understand otherwise unexplainable observed phenomena such as the structure of the spectral lines in atomic spectra. While the basic part of classical mechanics deals with the (essentially) reversible dynamics, quantum required adding the notions of ``measurement'' and (possibly non-local) ``correlations'' to the discussion. Crucially, all this comes with a ``probabilistic calculus''. The corresponding mathematical formalism was considered to have reached maturity in [von Neumann 1932], but there are some manifest problems with that formalism: (i) While measurements are applied to physical systems, application of their formal counterpart (i.e. a self-adjoint linear operator) to the vector representing that state of the system in no way reflects how the state changes during the act of measurement. Analogously, the composite of two self-adjoint operators has no physical significance while in practice measurements can be effectuated sequentially. More generally, the formal types in von Neumann's formalism do not reflect the nature of the corresponding underlying concept at all! (ii) Part of the problem regarding the measurements discussed above is that in the von Neumann formalism there is no place for storage, manipulation and exchange of the classical data obtained from measurements. Protocols such as quantum teleportation involving these cannot be given a full formal description. (iii) The behavioral properties of quantum entanglement which for example enable continuous data exchange using only finitary communication are hidden in the formalism. In [Abramsky and Coecke 2004] we addressed all these problems, and in addition provided a purely categorical axiomatization of quantum mechanics. The concepts of the abstract quantum mechanics are formulated relative to a strongly compact closed category with biproducts (of which the category FdHilb of finite dimensional Hilbert spaces and linear maps is an example). Preparations, measurements, either destructive or not, classical data exchange are all morphisms in that category, and their types fully reflect their kinds. Correctness properties of standard quantum protocols can be abstractly proven. Surprisingly, in this seemingly purely qualitative setting even the quantitative Born rule arises, that is the rule which tells you how to calculate the probabilities. Indeed, each such category has as endomorphism Hom of the tensor unit an abelian semiring of `scalars', and a special subset of these scalars will play the role of weights: each scalar induces a natural transformation which propagates through physical processes, and when a `state' undergoes a `measurement', the composition of the corresponding morphisms gives rise to the weight. Hence the probabilistic weights live within the category of processes. J. von Neumann. Mathematische Grundlagen der Quantenmechanik. Springer-Verlag (1932). English translation in Mathematical Foundations of Quantum Mechanics. Princeton University Press (1955). S. Abramsky and B. Coecke. A categorical semantics of quantum protocols. In the proceedings of LiCS'04 (2004). An extended version is available at arXiv:quant-ph/0402130 A more reader friendly version entitled `Quantum information flow, concretely, abstractly' is at http://www.vub.ac.be/CLEA/Bob/Papers/QPL.pdf
Chapter 1: On the existence of quantum representations for two dichotomic measurements. Under which conditions do outcome probabilities of measurements possess a quantum-mechanical model? This kind of problem is solved here for the case of two dichotomic von Neumann measurements which can be applied repeatedly to a quantum system with trivial dynamics. The solution uses methods from the theory of operator algebras and the theory of moment problems. The ensuing conditions reveal surprisingly simple relations between certain quantum-mechanical probabilities. It also shown that generally, none of these relations holds in general probabilistic models. This result might facilitate further experimental discrimination between quantum mechanics and other general probabilistic theories. Chapter 2: Possibilistic Physics. I try to outline a framework for fundamental physics where the concept of probability gets replaced by the concept of possibility. Whereas a probabilistic theory assigns a state-dependent probability value to each outcome of each measurement, a possibilistic theory merely assigns one of the state-dependent labels "possible to occur" or "impossible to occur" to each outcome of each measurement. It is argued that Spekkens' combinatorial toy theory of quantum mechanics is inconsistent in a probabilistic framework, but can be regarded as possibilistic. Then, I introduce the concept of possibilistic local hidden variable models and derive a class of possibilistic Bell inequalities which are violated for the possibilistic Popescu-Rohrlich boxes. The chapter ends with a philosophical discussion on possibilistic vs. probabilistic. It can be argued that, due to better falsifiability properties, a possibilistic theory has higher predictive power than a probabilistic one. Chapter 3: The quantum region for von Neumann measurements with postselection. It is determined under which conditions a probability distribution on a finite set can occur as the outcome distribution of a quantum-mechanical von Neumann measurement with hyphenation given that the scalar product between the initial and the final state is known as well as the success probability of the postselection. An intermediate von Neumann measurement can enhance transition probabilities between states such that the error probability shrinks by a factor of up to 2. Chapter 4: A presentation of the category of stochastic matrices. This chapter gives generators and relations for the strict monoidal category of probabilistic maps on finite cardinals (i.e., stochastic matrices). Chapter 5: Convex Spaces: Definition and Examples. We try to promote convex spaces as an abstract concept of convexity which was introduced by Stone as "barycentric calculus''. A convex space is a set where one can take convex combinations in a consistent way. By identifying the corresponding Lawvere theory as the category from chapter 4 and using the results obtained there, we give a different proof of a result of Swirszcz which shows that convex spaces can be identified with algebras of a finitary version of the Giry monad. After giving an extensive list of examples of convex sets as they appear throughout mathematics and theoretical physics, we note that there also exist convex spaces that cannot be embedded into a vector space: semilattices are a class of examples of purely combinatorial type. In an information-theoretic interpretation, convex subsets of vector spaces are probabilistic, while semilattices are possibilistic. Convex spaces unify these two concepts.