This article reviews the history of J. von Neumann’s analysis of hidden variables in quantum mechanics and the subsequent analysis by others. In his book The Mathematical Foundations of Quantum Mechanics, published in 1932, von Neumann performed an analysis of the consequences of introducing hidden parameters (hidden variables) into quantum mechanics. He arrived at two principal conclusions: first, hidden variables cannot be incorporated into the existing theory of quantum mechanics without major modifications, and second, if they did exist, the theory would have already failed in situations where it has been successfully applied. This analysis has been taken as an “incorrect proof” against the existence of hidden variables, possibly due to a mistranslation of the German word prufen. von Neumann’s so-called proof isn’t even wrong as such a proof does not exist, but it is an examination of the limitations imposed by internal consistency of the Hilbert space formulation of the theory. One of the earliest attempts to eliminate uncertainty, by D. Bohm, requires a major modification of quantum mechanics (observables are not represented by Hermitian operators), which supports von Neumann’s first principal conclusion. However, testing the Bohm theory requires constructing a physically impossible initial state. As such, the theory has no experimental consequences, so W. Pauli referred to it as an “uncashable check”. As there are no observable consequences, the Bohm theory is possibly a counterexample to von Neumann’s second conclusion that hidden variables in particular would have already led to a failure of the theory.
This article reviews the history of J. von Neumann’s analysis of hidden variables in quantum mechanics and the subsequent analysis by others. In his book The Mathematical Foundations of Quantum Mechanics, published in 1932, von Neumann performed an analysis of the consequences of introducing hidden parameters (hidden variables) into quantum mechanics. He arrived at two principal conclusions: first, hidden variables cannot be incorporated into the existing theory of quantum mechanics without major modifications, and second, if they did exist, the theory would have already failed in situations where it has been successfully applied. This analysis has been taken as an “incorrect proof” against the existence of hidden variables, possibly due to a mistranslation of the German word prufen. von Neumann’s so-called proof isn’t even wrong as such a proof does not exist, but it is an examination of the limitations imposed by internal consistency of the Hilbert space formulation of the theory. One of the earliest attempts to eliminate uncertainty, by D. Bohm, requires a major modification of quantum mechanics (observables are not represented by Hermitian operators), which supports von Neumann’s first principal conclusion. However, testing the Bohm theory requires constructing a physically impossible initial state. As such, the theory has no experimental consequences, so W. Pauli referred to it as an “uncashable check”. As there are no observable consequences, the Bohm theory is possibly a counterexample to von Neumann’s second conclusion that hidden variables in particular would have already led to a failure of the theory.
In his book \textit{The Mathematical Foundations of Quantum Mechanics}, published in 1932, J. von Neumann performed an analysis of the consequences of introducing hidden parameters (hidden variables) into quantum mechanics. He showed that hidden variables cannot be incorporated into the existing theory of quantum mechanics without major modifications, and concluded that if they did exist, the theory would have already failed in situations where it has been successfully applied. von Neumann left open the possibility that the theory is not complete, and his analysis for internal consistency is the best that can be done for a self-referenced logical system (Gödel's theorem). This analysis had been taken as an ``incorrect proof" against the existence of hidden variables. von Neumann's so-called proof isn't even wrong as such a proof does not exist. One of the earliest attempts at a hidden variable theory was by D. Bohm, and because there were no experimental consequences, W. Pauli referred to it as an ``uncashable check." To our knowledge, a successful hidden variable extension to quantum mechanics with testable consequences has not yet been produced, suggesting that von Neumann's analysis is worthy of rehabilitation, which we attempt to provide in a straightforward manner.
Hidden variable theories, ‘the hidden parameter’ as von Neumann called them, entered the quantum scene soon after the formalization of quantum mechanics as we know it today. That formalization was led by front-line physicists like Born, Dirac, Heisenberg, Jordan, and Schrödinger. Attention to hidden variable theories garnered strength following the criticisms towards quantum mechanics formulated by Einstein and colleagues in 1935. That criticism, stating that quantum mechanics was ‘not complete,’ as a theory, led Bohm, in the 1950s, to formulate hidden variable theories. In turn, Bell in 1964 introduced his famed Bell theorem that provided a test for the existence of hidden variable theories. This chapter examines the history of the futile search, for experimental proof, for the existence of these theories.
Abstract Hidden variables are hypothetical parameters that, if known, would deterministically specify quantum measurement outcomes, aiming to restore determinism and causality typical of classical mechanics. This work provides a modern and pedagogical exposition of John von Neumann’s 1932 proof on the incompatibility of hidden variables with quantum mechanics. We detail his two main conclusions: (1) dispersion-free ensembles (as defined within the framework of hidden variable theories) are incompatible with quantum mechanics; and (2) the quantum state provides a complete description of physical reality. We critically analyze the key assumptions in von Neumann’s proof, highlighting later challenges—particularly John Bell’s critique and the development of contextual hidden-variable theories by Kochen and Specker. This discussion clarifies von Neumann’s historical role as a pioneer in this debate, while showing how modern hidden-variable theories, such as Bohmian mechanics, remain compatible with quantum predictions. Conversion tables are included between this article’s notation and von Neumann’s original book.
Abstract Von Neumann’s book, The Mathematical Foundations of Quantum Mechanics, is reviewed in its entirety. The absence of the Dirac delta function in von Neumann’s treatment of quantum mechanics is understood from the historical perspective. Basically, the delta function was not on a firm mathematical foundation at the time. Von Neumann introduced the concept of the density matrix and we discuss its application to his proof of “no hidden parameters (variables)” in quantum mechanics. His proof is often maligned as being incorrect. Von Neumann showed that the existence of hidden parameters would require a reworking of the entire structure of quantum mechanics.
In this paper I provide a detailed history of von Neumann’s “No Hidden Variables” theorem, and I argue it is a demonstration that his axiomatization mathematically captures a salient feature of the statistical interpretation (namely, that hidden variables are incompatible). I show that this reading of von Neumann’s theorem is obvious once one recalls several contextual factors of his work. First, his axiomatization was what I call a Hilbert-style axiomatic completion; indeed, it developed from work initiated by Hilbert (and Nordheim). Second, it was responsive to specific mathematical and theoretical problems faced by Dirac and Jordan’s statistical transformation theory (then called ‘quantum mechanics’). Third, the axiomatization was essentially completed already in his 1927 papers, at least concerning the status of hidden variables, and this would have been obvious to the audience for those papers. Thus, the theorem’s statement and proof were only necessary when the material was presented for a general mathematical audience, i.e., in his 1932 Mathematical Foundations of Quantum Mechanics . With this reading in mind, his claim that quantum mechanics was in “compelling logical contradiction with causality” appears as a straightforward consequence of his theorem. I conclude by reassessing the theorem’s broader historical and scientific significance.
The impossibility of theories with hidden variables as an alternative and replacement for quantum mechanics was discussed by J. von Neumann in 1932. His proof was criticized as being logically circular, by Grete Hermann soon after, and as fundamentally flawed, by John Bell in 1964. Bell's severe criticism of Neumann's proof and the explicit (counter) example of a hidden variable model for the measurement of a quantum spin are considered by most researchers, though not all, as the definitive demonstration that Neumann's proof is inadequate. Despite being an argument of mathematical physics, an ambiguity of decision remains to this day. I show that Neumann's assumption of the linear additivity of the expectation values, even for incompatible (noncommuting) observables, is a necessary constraint related to the nature of observable physical variables and to the conservation laws. Therefore, any theory should necessarily obey it to qualify as a physically valid theory. Then, obviously, the hidden variable theories with dispersion-free ensembles that violate this assumption are ruled out. I show that it is Bell's counter-example that is fundamentally flawed, being inconsistent with the factual mechanics. Further, it is shown that the local hidden variable theories, for which the Bell's inequalities were derived, are grossly incompatible with the fundamental conservation laws. I identify the intrinsic uncertainty in the action as the reason for the irreducible dispersion, which implies that there are no dispersion-free ensembles at any scale of mechanics. With the unconditional validity of its central assumption shown, Neumann's proof is fully resurrected.