A quantum framework for likelihood ratios

Rachael Louise Bond, Yang‐Hui He, Thomas Caton Ormerod

Published Dec 12, 2015• 3 citations

Abstract

The ability to calculate precise likelihood ratios is fundamental to science, from Quantum Information Theory through to Quantum State Estimation. However, there is no assumption-free statistical methodology to achieve this. For instance, in the absence of data relating to covariate overlap, the widely used Bayes' theorem either defaults to the marginal probability driven "naive Bayes' classifier", or requires the use of compensatory expectation-maximization techniques. This article takes an information-theoretic approach in developing a new statistical formula for the calculation of likelihood ratios based on the principles of quantum entanglement, and demonstrates that Bayes' theorem is a special case of a more general quantum mechanical expression.

Related papers

A quantum framework for likelihood ratios

Rachael L. Bond, Yang‐Hui He, Thomas C. Ormerod

The ability to calculate precise likelihood ratios is fundamental to science, from Quantum Information Theory through to Quantum State Estimation. However, there is no assumption-free statistical methodology to achieve this. For instance, in the absence of data relating to covariate overlap, the widely used Bayes’ theorem either defaults to the marginal probability driven “naive Bayes’ classifier”, or requires the use of compensatory expectation-maximization techniques. This paper takes an information-theoretic approach in developing a new statistical formula for the calculation of likelihood ratios based on the principles of quantum entanglement, and demonstrates that Bayes’ theorem is a special case of a more general quantum mechanical expression.

arXiv:1508.00936International Journal of Quantum InformationDec 12, 20173 citations

A Bayes Rule for Density Matrices

Manfred K. Warmuth

The classical Bayes rule computes the posterior model probability from the prior probability and the data likelihood. We generalize this rule to the case when the prior is a density matrix (symmetric positive definite and trace one) and the data likelihood a covariance matrix. The classical Bayes rule is retained as the special case when the matrices are diagonal. In the classical setting, the calculation of the probability of the data is an expected likelihood, where the expectation is over the prior distribution. In the generalized setting, this is replaced by an expected variance calculation where the variance is computed along the eigenvectors of the prior density matrix and the expectation is over the eigenvalues of the density matrix (which form a probability vector). The variances along any direction is determined by the covariance matrix. Curiously enough this expected variance calculation is a quantum measurement where the co-variance matrix specifies the instrument and the prior density matrix the mixture state of the particle. We motivate both the classical and the generalized Bayes rule with a minimum relative entropy principle, where the Kullbach-Leibler version gives the classical Bayes rule and Umegaki’s quantum relative entropy the new Bayes rule for density matrices. 1

neural information processing systemsDec 5, 200518 citations

Quantum Bayes rule

Rüdiger Schack, Todd A. Brun, Carlton M. Caves

We state a quantum version of the Bayes rule for statistical inference and give a simple general derivation within the framework of generalized measurements. The rule can be applied to measurements on N copies of a system if the initial state of the N copies is exchangeable. As an illustration, we apply the rule to N qubits. Finally, we show that quantum state estimates derived via the principle of maximum entropy are fundamentally different from those obtained via the quantum Bayes rule.

arXiv:quant-ph/0008113Physical Review AJun 13, 2001153 citations

Quantum Statistical Inference

James D. Malley, John S. Hornstein

The three main points of this article are: 1. Quantum mechanical data differ from conventional data: for example, joint distributions usually cannot be defined conventionally; 2. rigorous methods have been developed for analyzing such data; the methods often use quantum-consistent analogs of classical statistical procedures; 3. with these procedures, statisticians, both data-analytic and more theoretically oriented, can become active participants in many new and emerging areas of science and biotechnology. In the physical realm described by quantum mechanics, many conventional statistical and probabilistic assumptions no longer hold. Probabilistic ideas are central to quantum theory but the standard Kolmogorov axioms are not uniformly applicable. Studying such phenomena requires an altered model for sample spaces, for random variables and for inference and decision making. The appropriate decision theory has been in development since the mid-1960s. It is both mathematically and statistically rigorous and conforms to the requirements of the known physical results. This article provides a tour of the structure and current applications of quantum-consistent statistical inference and decision theory. It presents examples, outlines the theory and considers applications and open problems. Certain central concepts of quantum theory are more clearly apprehended in terms of the quantum-consistent statistical decision theory. For example, the Heisenberg uncertainty principle can be obtained as a consequence of the quantum version of the Cramer-Rao inequality. This places concepts of statistical estimation and decision theory, and thus the statistician, at the center of the quantum measurement process. Quantum statistical inference offers considerable scope for participation by the statistical community, in both applications and foundational questions.

Statistical ScienceNov 1, 199383 citations

The quantum Bayes rule and generalizations from the quantum maximum entropy method

Kevin Vanslette

The recent article 'Entropic Updating of Probability and Density Matrices' [ 1 ] derives and demonstrates the inferential origins of both the standard and quantum relative entropies in unison. Operationally, the standard and quantum relative entropies are shown to be designed for the purpose of inferentially updating probability distributions and density matrices, respectively, when faced with incomplete information. We call the inferential updating procedure for density matrices the 'quantum maximum entropy method'. Standard inference techniques in probability theory can be criticized for lacking concrete physical consequences in physics; but here, because we are updating quantum mechanical density matrices, the quantum maximum entropy method has direct physical and experimental consequences. The present article gives a new derivation of the Quantum Bayes Rule, and some generalizations, using the quantum maximum entropy method while discuss some of the limitations the quantum maximum entropy method puts on the measurement process in Quantum Mechanics.

arXiv:1710.10949Journal of Physics CommunicationsJan 23, 20188 citations

Maximum Likelihood Estimators of Quantum Probabilities

Mirko Navara, Jan Ševic

Classical probability theory is based on assumptions which are often violated in practice. Therefore quantum probability is a proposed alternative not only in quantum physics, but also in other sciences. However, so far it mostly criticizes the classical approach, but does not suggest a working alternative. Maximum likelihood estimators were given very low attention in this context. We show that they can be correctly defined and their computation in closed form is feasible at least in some cases.

arXiv:2401.11253Jan 20, 20240 citations