arXiv:1804.04168 · Physical Review A

Differentiable learning of quantum circuit Born machines

Jin-Guo Liu, Lei Wang

Published Dec 19, 2018• 279 citations

Abstract

Quantum circuit Born machines are generative models which represent the probability distribution of classical dataset as quantum pure states. Computational complexity considerations of the quantum sampling problem suggest that the quantum circuits exhibit stronger expressibility compared to classical neural networks. One can efficiently draw samples from the quantum circuits via projective measurements on qubits. However, similar to the leading implicit generative models in deep learning, such as the generative adversarial networks, the quantum circuits cannot provide the likelihood of the generated samples, which poses a challenge to the training. We devise an efficient gradient-based learning algorithm for the quantum circuit Born machine by minimizing the kerneled maximum mean discrepancy loss. We simulated generative modeling of the BARS-AND-STRIPES dataset and Gaussian mixture distributions using deep quantum circuits. Our experiments show the importance of circuit depth and the gradient-based optimization algorithm. The proposed learning algorithm is runnable on near-term quantum device and can exhibit quantum advantages for probabilistic generative modeling.

DOI: 10.1103/physreva.98.062324

Related papers

Learning and inference on generative adversarial quantum circuits

Jinfeng Zeng, Yufeng Wu, Jin-Guo Liu +2 more

Quantum mechanics is inherently probabilistic in light of Born's rule. Using quantum circuits as probabilistic generative models for classical data exploits their superior expressibility and efficient direct sampling ability. However, training of quantum circuits can be more challenging compared to classical neural networks due to the lack of an efficient differentiable learning algorithm. We devise an adversarial quantum-classical hybrid training scheme via coupling a quantum circuit generator and a classical neural network discriminator together. After training, the quantum circuit generative model can infer missing data with quadratic speed-up via amplitude amplification. We numerically simulate the learning and inference of generative adversarial quantum circuits using the prototypical bars-and-stripes dataset. Generative adversarial quantum circuits are a fresh approach to machine learning which may enjoy the practically useful quantum advantage of near-term quantum devices.

arXiv:1808.03425Physical Review AMay 6, 201994 citations

Adversarial training of quantum Born machine

Haozhen Situ, Zhimin He, Lvzhou Li +1 more

Generative adversarial network (GAN) is an effective machine learning framework to train unsupervised generative models, and has drawn lots of attention in recent years. In the meantime, there are some researches that use parameterized quantum circuits to generate simple patterns. In this paper, we present a quantum version of GAN, where parameterized quantum circuits are trained by an adversarial discriminator, to generate new samples that follows the probability distribution of a given training dataset. Two families of quantum circuits, both composed of simple one-qubit rotation and two-qubit controlled-phase gates, are considered. The parameters are learned through classical gradient descent optimization. The results of a small-scale proof-of-principle numerical experiment demonstrate that quantum circuits can be trained in an adversarial way for generative tasks.

Jul 3, 20182 citations

The Born supremacy: quantum advantage and training of an Ising Born machine

Brian Coyle, Daniel Mills, Vincent Danos A +1 more

Abstract The search for an application of near-term quantum devices is widespread. Quantum machine learning is touted as a potential utilisation of such devices, particularly those out of reach of the simulation capabilities of classical computers. In this work, we study such an application in generative modelling, focussing on a class of quantum circuits known as Born machines. Specifically, we define a subset of this class based on Ising Hamiltonians and show that the circuits encountered during gradient-based training cannot be efficiently sampled from classically up to multiplicative error in the worst case. Our gradient-based training methods use cost functions known as the Sinkhorn divergence and the Stein discrepancy, which have not previously been used in the gradient-based training of quantum circuits, and we also introduce quantum kernels to generative modelling. We show that these methods outperform the previous standard method, which used maximum mean discrepancy (MMD) as a cost function, and achieve this with minimal overhead. Finally, we discuss the ability of the model to learn hard distributions and provide formal definitions for ‘quantum learning supremacy’. We also exemplify the work of this paper by using generative modelling to perform quantum circuit compilation.

arXiv:1904.02214npj Quantum InformationJul 8, 2020155 citations

Non‐Differentiable Leaning of Quantum Circuit Born Machine with Genetic Algorithm

Alex Kondratyev

The Quantum Circuit Born Machine (QCBM) is a generative quantum machine learning model that can be efficiently trained and run on the NISQ-era quantum processors. It is likely that QCBM will be one of the first quantum machine learning models to find productive applications in quantitative finance as a powerful market generator. In this paper we test QCBM performance on a dataset of spot FX log-returns (heavy-tailed distribution) as well as specially constructed mixture of Normal distributions (which models spiky light-tailed distribution). The QCBM has greater expressive power than comparable classical neural networks such as restricted Boltzmann machine (RBM) and, therefore, has potential to demonstrate quantum advantage by generating high-quality samples from the learned empirical distribution of the market risk factors while using less computational resources than its classical counterpart. However, efficient training of QCBM remains a challenging problem. Traditional differentiable learning approach may not work well when the loss function is highly non-smooth. In such cases it may be more efficient to use the non-differentiable learning methods. This paper proposes a non-differentiable learning approach to the training of QCBM based on genetic glgorithm (GA). The paper also presents results of the numerical experiments which compare performance of QCBM trained with GA against performance of the equivalent classical RBM and investigates the question of GA convergence as a function of QCBM architecture and the choice of algorithm's hyperparameters.

WilmottJul 1, 20218 citations

Trainability of IQP Quantum Circuit Born Machines Under Gaussian Initialization

Gennaro De Luca, Vinayak Sharma, Aviral Shrivastava

Quantum Circuit Born Machines (QCBMs) offer a natural approach to generative machine learning by leveraging the Born rule. Recent work has provided a method to classically train QCBMs with Instantaneous Quantum Polynomial (IQP) circuits via the Maximum Mean Discrepancy (MMD) loss. Despite the assumed intractability of sampling from IQP circuits classically, their expectation values can be computed classically, enabling training of these IQP QCBMs. However, quantum machine learning (QML) models have various other challenges, including trainability issues caused by exponential concentration or barren plateaus. While these issues have been explored for parameters sampled from a uniform distribution, little work has been done to rigorously treat the use of arbitrary Gaussian initialization schemes. This work leverages Stein's lemma and Lipschitz concentration bounds for Gaussian random variables to provide an analytical lower bound of the variance of the gradient and a probabilistic concentration bound of the deviation of the gradient from its mean. It discusses strategies to either avoid or encourage exponential concentration, as well as the conditions under which barren plateaus are more likely to occur.

quant-pharXiv:2606.10179Jun 10, 20260 citations

Quantum Generative Modeling using Parameterized Quantum Circuits

Soumyadip Sarkar

Quantum generative models use the intrinsic probabilistic nature of quantum mechanics to learn and reproduce complex probability distributions. In this paper, we present an implementation of a 3-qubit quantum circuit Born machine trained to model a 3-bit Gaussian distribution using a Kullback-Leibler (KL) divergence loss and parameter-shift gradient optimization. The variational quantum circuit consists of layers of parameterized rotations and entangling gates, and is optimized such that the Born rule output distribution closely matches the target distribution. We detail the mathematical formulation of the model distribution, the KL divergence cost function, and the parameter-shift rule for gradient evaluation. Training results on a statevector simulator show that the KL divergence is minimized to near zero, and the final generated distribution aligns quantitatively with the target probabilities. We analyze the convergence behavior and discuss the implications for scalability and quantum advantage. Our results demonstrate the feasibility of small-scale quantum generative learning and provide insight into the training dynamics of quantum circuit models.

arXiv:2303.16955Mar 25, 20230 citations