Abstract Given the state of a quantum system, we define the conditional expectation of an observable with respect to a second observable, or commuting family of observables, as the real-valued function of the latter which best approximates the observable, in the sense of minimizing the quantum mechanical expectation of the difference squared. This corresponds to the notion of best predictor of a random variable by another random variable in non-parametric statistical regression. A basic example is the conditional expectation of the quantum mechanical momentum with respect to position, which can be identified with the Bohm momentum. We re-examine the de Broglie–Bohm theory from this perspective. As a second example we consider the simplest quantum system, that of a spin- 1 / 2 paticle in a magnetic field. We study the conditional expectations of the Pauli spin-operators S 1 , S 2 , S 3 with respect to S 3 , and determine their dynamics if the pure-state wave-function solves the relevant Schrödinger equation. Considering S 3 as a beable we can, following Bell, introduce a generalized guidance law in the form of a Markov jump process on the spectrum of S 3 which is compatible with the time evolution of the Born probabilities of the two eigenstates of S 3 . The conditional expectations of the remaining spin operators are then shown to follow a piece-wise deterministic Markov process, defined by an explicit SDE. We finally examine the relationship between the conditional expectations of this paper, and the von Neumann-algebraic conditional expectation onto the sub-algebra generated by the commuting family of conditioning operators when the joint spectrum of the latter is discrete, and derive a general expression for the conditional expectation dynamics in that context.
Given a normalized state-vector
ψ, we define the conditional expectation $\mathbb{E }_{ψ} (A | B ) $ of a Hermitian operator $A $ with respect to a strongly commuting family of self-adjoint operators $B $ as the best approximation, in the operator mean square norm associated to
ψ, of $A $ by a real-valued function of $B . $ A fundamental example is the conditional expectation of the momentum operator $P $ given the position operator $X $, which is found to be the Bohm momentum. After developing the Bohm theory from this point of view we treat conditional expectations with respect to general $B $, which we apply to non-relativistic spin 1/2-particles. We derive the dynamics of the conditional expectations of momentum and spin with respect to position and the third spin component. These dynamics can be interpreted in terms of classical continuum mechanics as a two-component fluid whose components carry intrinsic angular momentum. Interpreting the joint spectrum of the conditioning operators as a space of beables, we can introduce a classical-stochastic particle dynamics on this space which is compatible with the time-evolution of the Born probability, by combining the de Broglie-Bohm guidance condition with a Markov jump process, following an idea of J. Bell. This results in a new Bohm-type model for particles with spin. A basic problem is that such auxiliary particle dynamics are far from unique. We finally examine the relation of our conditional expectations with the conditional expectations of the theory of $C^* $-algebras and, as an application, derive a general evolution equation for conditional expectations for operators acting on finite dimensional Hilbert spaces. Two appendices re-interpret the classical Bohm model as an integrable constrained Hamiltonian system, and provide the details of the two-fluid interpretation.
Abstract In part I (Brummelhuis R 2025 J. Phys. A: Math. Theor. ) of this paper we defined the conditional expectation of a quantum mechanical observable with respect to a commuting family of observables, for a given quantum state. Here we determine the dynamics of the conditional expectations of the momentum and spin operators with respect to the position operators and a spin component, for which we choose the third component, for quantum states which are solutions of the time-dependent Pauli equation. We show that this dynamics can be re-written, Madelung-style, as those of a two-component polar fluid. We also give a de Broglie–Bohm–Bell interpretation with the position and third spin-component as beables and a particle dynamics in the form of a piece-wise deterministic Markov process given by an explicit SDE.
An extension of the conditional expectations (those under a given subalgebra of events and not the simple ones under a single event) from the classical to the quantum case is presented. In the classical case, the conditional expectations always exist; in the quantum case, however, they exist only if a certain weak compatibility criterion is satisfied. This compatibility criterion was introduced among others in a recent paper by the author. Then, state-independent conditional expectations and quantum Markov processes are studied. A classical Markov process is a probability measure, together with a system of random variables, satisfying the Markov property and can equivalently be described by a system of Markovian kernels (often forming a semigroup). This equivalence is partly extended to quantum probabilities. It is shown that a dynamical (semi)group can be derived from a given system of quantum observables satisfying the Markov property, and the group generators are studied. The results are presented in the framework of Jordan operator algebras, and a very general type of observables (including the usual real-valued observables or self-adjoint operators) is considered.
de Broglie-Bohm theory (dBBT), treating quantum particles as point objects moving along well defined (Bohmian) trajectories, offers an appealing solution of the measurement problem in quantum mechanics; it has, however, problems relating to spin, relativity and lack of proper integration with the Hilbert space based framework. In this work, we present a consistent formalism which has the traditional state-observable framework integrated with the desirable features of dBBT. We adopt ensemble interpretation for the Schrodinger wave function
ψ. Given a Schrodinger wave function
ψ, we use its value
ψ0 at some fixed time (say,
t=0) to define the probability measure
∣ψ0∣2dx on the system configuration space
M (
=Rn). On the resulting probability space
M0, we introduce a stochastic process
ξ(t) corresponding to the Heisenberg position operator
XH(t) such that, in the Heisenberg state
∣ψh⟩ corresponding to
ψ0, the expectation value of
XH(t) equals that of
ξ(t) in
M0. This condition leads to the de Broglie-Bohm guidance equation for the sample paths of the process
ξ(t) which are, therefore, Bohmian trajectories supposedly representing time-evolutions of individual members of the
ψ0-ensemble. Stochastic processes and Bohmian trajectories corresponding to observables with discrete eigenvalues (in particular spin) are treated by extending the configuration space to the spectral space of the commutative algebra obtained by adding appropriate discrete observables to the position observables. Pauli's equation is treated as an example. A straightforward derivation of von Neumann's projection rule employing the Schrodinger-Bohm evolution of individual systems along their Bohmian trajectories is given. Some comments on the potential application of the formalism developed here to quantum mechanics of the universe are included.
In classical probability theory, the best predictor of a future observation
of a random variable
X, is its expected value
EP[X] when no other
information is available, whereas if information consisting in the observation
of another random variable is available, then the best predictor is is another
random variable
EP[X∣Y]. It is the purpose of this note to explore the
analogue of this in the case of quantum mechanics. we shall see that when the
result of an observation is taken into account by means of a non-commutative
conditional expectation, exactly as in classical prediction theory, some of the
usual paradoxes cease to be so. The moral of this note is that the mystery of
the probabilistic interpretation of quantum mechanics lies in the superposition
principle
Among the many quasiprobability representations of quantum mechanics, the family of Kirkwood-Dirac (KD) representations has come to the foreground in recent years. Each such KD representation is determined by the choice of two complementary complete sets of commuting observables
A^ and
B^ with respect to which it is Born-compatible, meaning that it correctly reproduces their Born probabilities for every state. We identify in this paper what property uniquely characterizes the KD representations among all such
A^ and
B^ Born-compatible quasiprobability representations. For that purpose, we first define a natural notion of \emph{quantum conditional expectation} of an observable
X^, given an observable
Y^, in a state
ρ^, as a best estimator and we show that it has the basic properties generally expected of a conditional expectation. We then show that only the KD representations provide a notion of conditional expectation, given
B^ (or given
A^) that coincides with the above quantum conditional expectation. As a byproduct of our analysis, we show a state-dependent no-go theorem. We prove that, if the quantum conditional expectation of an observable
X^, given an observable
Y^ in a state
ρ^ admits an anomalous value, then there cannot exist a Born-compatible joint probability distribution
μ(x,y) for
X^ and
Y^ in the state
ρ^ for which the associated conditional probability
μ(x∣y) yields a conditional expectation that coincides with the quantum conditional expectation. We further apply our findings to revisit a standard model for phase estimation in quantum metrology. We show in particular that, within the real sector of a given KD representation, the classical Fisher information of this phase estimation problem vanishes identically.