The learnability of quantum neural network, which includes its convergence behavior in optimization and the ability to efficiently learn classes of computationally hard concepts is investigated, providing theoretical guidance for developing advanced protocols in the NISQ era.
Abstract Quantum neural network (QNN), or equivalently, the variational quantum circuits with a gradient-based classical optimizer, has been broadly applied to many experimental proposals for noisy intermediate scale quantum (NISQ) devices. However, the learning capability of QNN remains largely unknown due to the non-convex optimization landscape, the measurement error, and the unavoidable gate noise introduced by NISQ machines. In this study, we theoretically explore the learnability of QNN from the perspective of the trainability and generalization. Particularly, we derive the convergence performance of QNN under the NISQ setting, and identify classes of computationally hard concepts that can be efficiently learned by QNN. Our results demonstrate that large gate noise, few quantum measurements, and deep circuit depth will lead to poor convergence rates of QNN towards the empirical risk minimization. Moreover, we prove that any concept class, which is efficiently learnable by a restricted quantum statistical query (QSQ) learning model, can also be efficiently learned by QNN. Since the restricted QSQ learning model can tackle certain problems such as parity learning with a runtime speedup, our result suggests that QNN established on NISQ devices will retain the quantum advantage. Our work provides the theoretical guidance for developing advanced QNNs and opens up avenues for exploring quantum advantages using NISQ devices.
We consider the learnability of the quantum neural network (QNN) built on the variational hybrid quantum-classical scheme, which remains largely unknown due to the non-convex optimization landscape, the measurement error, and the unavoidable gate errors introduced by noisy intermediate-scale quantum (NISQ) machines. Our contributions in this paper are multi-fold. First, we derive the utility bounds of QNN towards empirical risk minimization, and show that large gate noise, few quantum measurements, and deep circuit depth will lead to the poor utility bounds. This result also applies to the variational quantum circuits with gradient-based classical optimization, and can be of independent interest. We then prove that QNN can be treated as a differentially private (DP) model. Thirdly, we show that if a concept class can be efficiently learned by QNN, then it can also be effectively learned by QNN even with gate noise. This result implies the same learnability of QNN whether it is implemented on noiseless or noisy quantum machines. We last exhibit that the quantum statistical query (QSQ) model can be effectively simulated by noisy QNN. Since the QSQ model can tackle certain tasks with runtime speedup, our result suggests that the modified QNN implemented on NISQ devices will retain the quantum advantage. Numerical simulations support the theoretical results.
Quantum neural networks (QNNs) play an important role as an emerging technology in the rapidly growing field of quantum machine learning. While their empirical success is evident, the theoretical explorations of QNNs, particularly their generalization properties, are less developed and primarily focus on the uniform convergence approach. In this paper, we exploit an advanced tool in classical learning theory, i.e., algorithmic stability, to study the generalization of QNNs. We first establish high-probability generalization bounds for QNNs via uniform stability. Our bounds shed light on the key factors influencing the generalization performance of QNNs and provide practical insights into both the design and training processes. We next explore the generalization of QNNs on near-term noisy intermediate-scale quantum (NISQ) devices, highlighting the potential benefits of quantum noise. Moreover, we argue that our previous analysis characterizes worst-case generalization guarantees, and we establish a refined optimization-dependent generalization bound for QNNs via on-average stability. Numerical experiments on various real-world datasets support our theoretical findings.
A quantum neural network (QNN) is a parameterized mapping efficiently implementable on near-term Noisy Intermediate-Scale Quantum (NISQ) computers. It can be used for supervised learning when combined with classical gradient-based optimizers. Despite the existing empirical and theoretical investigations, the convergence of QNN training is not fully understood. Inspired by the success of the neural tangent kernels (NTKs) in probing into the dynamics of classical neural networks, a recent line of works proposes to study over-parameterized QNNs by examining a quantum version of tangent kernels. In this work, we study the dynamics of QNNs and show that contrary to popular belief it is qualitatively different from that of any kernel regression: due to the unitarity of quantum operations, there is a non-negligible deviation from the tangent kernel regression derived at the random initialization. As a result of the deviation, we prove the at-most sublinear convergence for QNNs with Pauli measurements, which is beyond the explanatory power of any kernel regression dynamics. We then present the actual dynamics of QNNs in the limit of over-parameterization. The new dynamics capture the change of convergence rate during training and implies that the range of measurements is crucial to the fast QNN convergence.
A promising combination of artificial intelligence and quantum computing, quantum neural networks (QNNs) have the potential to completely transform the way neural networks interpret and learn from data. QNNs can outperform classical neural networks in terms of speed, efficiency, and scalability by utilizing the special qualities of quantum physics, such as superposition, entanglement, and quantum parallelism. The basic ideas of QNNs, their structures, and the ways in which quantum algorithms can be incorporated into machine learning processes to improve problem-solving skills are all examined in this study. current developments in QNNs, emphasizing how they can be used for challenging applications including pattern recognition, optimization, and high-dimensional data space decision-making. We also go over the difficulties in creating scalable QNN models and the possible future applications of QNNs in artificial intelligence. By utilizing the potential of quantum computing, QNNs have the potential to advance artificial intelligence by providing answers to issues that are now intractable through traditional methods.
This paper explores the potential of quantum neural networks (QNNs) leveraging self-organization to achieve superior performance in pattern recognition and classification tasks. The core concept involves constructing a QNN utilizing quantum phenomena like decoherence and entanglement, followed by employing self-organizing learning algorithms to dynamically adjust the network's connection weights and topology. We posit that this combination can significantly enhance learning efficiency and accuracy compared to classical neural networks. The theoretical framework presented outlines a novel approach, and while experimental validation is not included, the proposed architecture and learning process provide a foundational understanding for future research and development in this emerging field. Key elements include the mathematical formulation of the QNN's dynamics, the self-organization learning algorithm, and the evaluation metrics used to assess performance. The primary goal is to demonstrate a theoretical pathway toward a more efficient and robust QNN through self-adaptive learning.