arXiv:1111.1364 · Journal of Mathematical Physics

Quantal effects and MaxEnt

Federico Holik, Angelo Plastino

Published Jul 1, 2012• 7 citations

Abstract

Convex operational models (COMs) are considered as great extrapolations to larger settings of any statistical theory. In this article, we generalize the maximum entropy principle (MaxEnt) of Jaynes’ to any COM. After expressing MaxEnt in a geometrical and lattice theoretical setting, we are able to cast it for any COM. This scope-amplification opens the door to a new systematization of the principle and sheds light into its geometrical structure.

DOI: 10.1063/1.4731769

Related papers

Geometric probability theory and Jaynes’s methodology

Federico Holik, César Massri, Angel Ricardo Plastino

We provide a generalization of the approach to geometric probability advanced by the great mathematician Gian Carlo Rota, in order to apply it to generalized probabilistic physical theories. In particular, we use this generalization to provide an improvement of the Jaynes’ MaxEnt method. The improvement consists in providing a framework for the introduction of symmetry constraints. This allows us to include group theory within MaxEnt. Some examples are provided.

International Journal of Geometric Methods in Modern PhysicsDec 2, 20158 citations

The introduction of symmetry constraints within MaxEnt Jaynes's methodology

Federico Holik, César Massri, Angelo Plastino

We provide a generalization of the approach to geometric probability advanced by the great mathematician Gian Carlo Rota, in order to apply it to generalized probabilistic physical theories. In particular, we use this generalization to provide an improvement of the Jaynes' MaxEnt method. The improvement consists in providing a framework for the introduction of symmetry constrains. This allows us to include group theory within MaxEnt. Some examples are provided.

arXiv:1501.00074Dec 31, 20141 citation

Maximum Entropy on the Complex Probability Framework

Francisco Javier Tapiador

Jaynes' maximum entropy (MaxEnt) principle selects, from all probability distributions consistent with a set of constraints, the one that maximizes the Shannon entropy. The principle is well-defined for classical, real-valued probabilities, but extending it to complex-valued probability theories requires care. Youssef's complex probability framework, in which quantum mechanics is reformulated as a Bayesian theory with complex amplitudes and the observable probability is the squared modulus (Born rule), does not admit a natural MaxEnt extension: the L2 normalization of that framework is incompatible with the L1 normalization assumed by Shannon entropy, and the resulting complex-valued entropy functional cannot be maximized without additional structure absent from Youssef's axioms. The present paper proposes a different extension of Kolmogorov's axioms to the complex domain, replacing non-negativity with the condition that the real part of every probability be non-negative. This framework, which retains L1 normalization and recovers classical probability when the imaginary part vanishes, admits a natural MaxEnt principle: the real part of the complex Shannon entropy is a well-posed real functional, its Euler-Lagrange equations produce an explicit complex Gibbs distribution with complex Lagrange multipliers, and the classical Gibbs distribution is recovered as the special case of real multipliers. The die problem (Jaynes' Brandeis dice example) is worked out in detail for both the fair and the loaded cases, illustrating how imaginary constraints redistribute the observable probability mass in a way that has no counterpart in classical MaxEnt.

EntropySep 25, 20260 citations

Dual representations of classical and quantum entropies: Theory and perspectives: Invited keynote

Olivier Rioul

The MAXENT (maximum entropy) principle gives a natural correspondance between (classical and quantum) statistical mechanics and information theory. Its general formulation leverages on log-concavity (or Klein's inequality) and the celebrated information inequality, which is equivalent to Gibbs' inequality. The resulting convex optimization allows one to relate entropy to the log-canonical partition function by Legendre-Fenchel duality. This can be further generalized to dual variational characterization of relative entropy or Kullback-Leibler divergence, relating Gibbs variationnal principle to Donsker-Vardhan variational representations.From an information theoretical point of view, the Gibbs principle and its associated evidence lower bound serves as the basis of modern machine learning algorithms, such as the expectation-maximization (EM) algorithm and its restriction to parameters output by a neural network. Interestingly, a large class of alternating optimization algorithms including EM and Blahut-Arimoto for computing channel capacity and source rate-distortion functions can be cast in a generic information geometric alternating projections on convex sets of measures. On the other hand, Donsker-Vardhan representations, when restricted to the output of a neural network, allows one to efficiently estimate information measures, and when applied to parametric estimators with quadratic risk, provide HCR-like and CRB-like statistical lower bounds. An alternative derivation on such lower bounds in the Bayesian setting makes use of the Weyl-Heisenberg uncertainty principle, which opens up new perspectives.In this keynote, I will select and review several of the aforementioned topics, and discuss the interactions between classical and quantum interpretations.

Jul 1, 20260 citations

On a differential geometric viewpoint of Jaynes' MaxEnt method and its quantum extension

Sean Alan Ali, Carlo Cafaro, Adom Giffin +2 more

We present a differential geometric viewpoint of the quantum MaxEnt estimate of a density operator when only incomplete knowledge encoded in the expectation values of a set of quantum observables is available. Finally, the additional possibility of considering some prior bias towards a certain density operator (the prior) is taken into account and the unsolved issues with its quantum relative entropic inference criterion are pointed out.

arXiv:1110.6712AIP conference proceedingsJan 1, 20128 citations

A Proposito del Principio di Massima Entropia

Carlo Sempi

The maximum-entropy principle has recently been discussed in this journal by R. Rosa. The present note stresses a few points made or touched upon there. First it is shown how to derive, by means of the principle under discussion, the quantal statistics, along with the intermediate ones. Then the point is made that the correct application of the principle and its ultimate acceptance by the scientific community require that one uses an appropriate representation for the entropy. Thus great importance is attributed to the characterizations of the various entropies.

Jan 1, 19860 citations