arXiv:2109.03786 · Quantum Science and Technology

Quantum-classical hybrid neural networks in the neural tangent kernel regime

Kouhei Nakaji, Hiroyuki Tezuka, Naoki Yamamoto

Published Dec 7, 2023• 12 citations

Abstract

Abstract Recently, quantum neural networks or quantum–classical neural networks (qcNN) have been actively studied, as a possible alternative to the conventional classical neural network (cNN), but their practical and theoretically-guaranteed performance is still to be investigated. In contrast, cNNs and especially deep cNNs, have acquired several solid theoretical basis; one of those basis is the neural tangent kernel (NTK) theory, which can successfully explain the mechanism of various desirable properties of cNNs, particularly the global convergence in the training process. In this paper, we study a class of qcNN composed of a quantum data-encoder followed by a cNN. The quantum part is randomly initialized according to unitary 2-designs, which is an effective feature extraction process for quantum states, and the classical part is also randomly initialized according to Gaussian distributions; then, in the NTK regime where the number of nodes of the cNN becomes infinitely large, the output of the entire qcNN becomes a nonlinear function of the so-called projected quantum kernel. That is, the NTK theory is used to construct an effective quantum kernel, which is in general nontrivial to design. Moreover, NTK defined for the qcNN is identical to the covariance matrix of a Gaussian process, which allows us to analytically study the learning process. These properties are investigated in thorough numerical experiments; particularly, we demonstrate that the qcNN shows a clear advantage over fully classical NNs and qNNs for the problem of learning the quantum data-generating process.

DOI: 10.1088/2058-9565/ad133e

Related papers

Efficient classical computation of the neural tangent kernel of quantum neural networks

Anderson Melchor Hernandez, Davide Pastorello, Giacomo De Palma

We propose an efficient classical algorithm to estimate the Neural Tangent Kernel (NTK) associated with a broad class of quantum neural networks. These networks consist of arbitrary unitary operators belonging to the Clifford group interleaved with parametric gates given by the time evolution generated by an arbitrary Hamiltonian belonging to the Pauli group. The proposed algorithm leverages a key insight: the average over the distribution of initialization parameters in the NTK definition can be exactly replaced by an average over just four discrete values, chosen such that the corresponding parametric gates are Clifford operations. This reduction enables an efficient classical simulation of the circuit. Combined with recent results establishing the equivalence between wide quantum neural networks and Gaussian processes [Girardi et al., Comm. Math. Phys. 406, 92 (2025); Melchor Hernandez et al., Ann. Henri Poincaré (2025)], our method enables efficient computation of the expected output of wide, trained quantum neural networks, and therefore shows that such networks cannot achieve quantum advantage.

arXiv:2508.04498QuantumMay 29, 20260 citations

Analyzing Convergence in Quantum Neural Networks: Deviations from Neural Tangent Kernels

Xuchen You, Shouvanik Chakrabarti, Boyang Chen +1 more

A quantum neural network (QNN) is a parameterized mapping efficiently implementable on near-term Noisy Intermediate-Scale Quantum (NISQ) computers. It can be used for supervised learning when combined with classical gradient-based optimizers. Despite the existing empirical and theoretical investigations, the convergence of QNN training is not fully understood. Inspired by the success of the neural tangent kernels (NTKs) in probing into the dynamics of classical neural networks, a recent line of works proposes to study over-parameterized QNNs by examining a quantum version of tangent kernels. In this work, we study the dynamics of QNNs and show that contrary to popular belief it is qualitatively different from that of any kernel regression: due to the unitarity of quantum operations, there is a non-negligible deviation from the tangent kernel regression derived at the random initialization. As a result of the deviation, we prove the at-most sublinear convergence for QNNs with Pauli measurements, which is beyond the explanatory power of any kernel regression dynamics. We then present the actual dynamics of QNNs in the limit of over-parameterization. The new dynamics capture the change of convergence rate during training and implies that the range of measurements is crucial to the fast QNN convergence.

arXiv:2303.14844Mar 26, 20233 citations

Towards practical quantum neural network diagnostics with neural tangent kernels

Francesco Scala, Christa Zoufal, Dario Gerace +1 more

Abstract Predicting the performance of a Quantum Neural Network (QNN) on a given dataset before its training can save critical resources. However, obtaining such a priori information is, in general, very challenging. The Quantum Neural Tangent Kernel (QNTK) has recently emerged as a tool to mathematically describe the behavior of QNNs. Here, we provide practical guidelines for using the QNTK to diagnose the performance of a given QNN model. In particular, we link QNTK spectral features to the training dynamics, and we show how a first-order kernel approximation can predict the expected inference performance. By analyzing the interplay between the number of model parameters and of training samples, we identify a mismatch at the interpolation threshold: while the QNTK exhibits a double descent in generalization error, we observe that QNNs do not show this behavior in practice. This suggests that QNTK diagnostics are mostly reliable for overparametrized models well above the interpolation regime. Extensive numerical simulations across different architectures and datasets validate our approach. Our results demonstrate that QNTK diagnostics yields useful information about QNN behavior for sufficiently deep circuits, and enable detecting and addressing potential shortcomings in model design.

arXiv:2503.01966npj Quantum InformationJun 10, 20262 citations

Neural quantum kernels: Training quantum kernels with quantum neural networks

Pablo Rodriguez-Grasa, Yue Ban, Mikel Sanz

Quantum and classical machine learning have been naturally connected through kernel methods, which have also served as proof-of-concept for quantum advantage. Quantum embeddings encode classical data into quantum feature states, enabling the construction of embedding quantum kernels (EQKs) by measuring vector similarities and projected quantum kernels (PQKs) through projections of these states. However, in both approaches, the model is influenced by the choice of the embedding. In this work, we propose using the training of a quantum neural network (QNN) to construct neural quantum kernels, specifically neural EQKs and neural PQKs—problem-inspired kernel functions. Unlike previous approaches, our method requires the kernel matrix to be constructed only once, significantly reducing computational overhead. To achieve this, we introduce a scalable training method for an n -qubit data reuploading QNN. Furthermore, we demonstrate neural quantum kernels can alleviate exponential concentration and enhance generalization capabilities compared to problem-agnostic kernels, positioning them as a scalable and robust solution for quantum machine learning applications.

arXiv:2401.04642Physical Review ResearchMay 20, 202515 citations

The Quantum Path Kernel: A Generalized Neural Tangent Kernel for Deep Quantum Machine Learning

Massimiliano Incudini, Michele Grossi, Antonio Mandarino +3 more

Building a quantum analog of classical deep neural networks represents a fundamental challenge in quantum computing. A key issue is how to address the inherent non-linearity of classical deep learning, a problem in the quantum domain due to the fact that the composition of an arbitrary number of quantum gates, consisting of a series of sequential unitary transformations, is intrinsically linear. This problem has been variously approached in the literature, principally via the introduction of measurements between layers of unitary transformations. In this paper, we introduce the Quantum Path Kernel, a formulation of quantum machine learning capable of replicating those aspects of deep machine learning typically associated with superior generalization performance in the classical domain, specifically,hierarchical feature learning. Our approach generalizes the notion of Quantum Neural Tangent Kernel, which has been used to study the dynamics of classical and quantum machine learning models. The Quantum Path Kernel exploits the parameter trajectory, i.e. the curve delineated by model parameters as they evolve during training, enabling the representation of differential layer-wise convergence behaviors, or the formation of hierarchical parametric dependencies, in terms of their manifestation in the gradient space of the predictor function. We evaluate our approach with respect to variants of the classification of Gaussian XOR mixtures - an artificial but emblematic problem that intrinsically requires multilevel learning in order to achieve optimal class separation.

arXiv:2212.11826IEEE Transactions on Quantum EngineeringJan 1, 202322 citations

Design and Implementation of Quantum Kernel Convolution for Hybrid Neural Networks

Erdem Şeker, Yusuf Kağan Bayraktaroğlu, Deniz Eren Çam +2 more

Classical convolutional neural networks (CNNs) have achieved notable success in image classification but face challenges in scalability, interpretability, and computational cost. With the growing availability of Noisy Intermediate-Scale Quantum (NISQ) devices, hybrid quantum-classical models offer a promising alternative by leveraging quantum parallelism and entanglement. In this work, we present a hybrid Quantum Convolutional Neural Network (QCNN) that integrates quantum convolutional layers into classical image classification pipeline for the MNIST dataset. Our architecture features a modular, low-depth Quantum Kernel Convolution (QKC) design suitable for near-term hardware. We implement the system using Qiskit and evaluate in terms of classification accuracy, circuit efficiency, and integration feasibility. Our results demonstrate that (i) the hybrid QCNN achieves similar accuracy to classical models while reducing the number of classical parameters, and (ii) quantum layers can successfully perform dimensionality reduction through entanglement-based pooling. This study highlights the potential of hybrid QCNN as a practical quantum-enhanced model for real-world image recognition tasks.

Sep 17, 20251 citation