Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2109.11676 · Nature Computational Science

Theory of overparametrization in quantum neural networks

Martín Larocca, Nathan Ju, Diego García-Martín, Patrick J. Coles, Marco Cerezo

Published Jun 26, 2023• 177 citations
arXivHTMLPDF
DOI
10.1038/s43588-023-00467-6

Related papers

Simulations of quantum neural networks

Elizabeth Behrman, L.R. Nash, James E. Steck +2 more

Information Sciences•Oct 1, 2000•123 citations

Effects of noise on the overparametrization of quantum neural networks

Diego García-Martín, Martín Larocca, Marco Cerezo

Overparametrization is one of the most surprising and notorious phenomena in machine learning. Recently, there have been several efforts to study if, and how, quantum neural networks (QNNs) acting in the absence of hardware noise can be overparametrized. In particular, it has been proposed that a QNN can be defined as overparametrized if it has enough parameters to explore all available directions in state space. That is, if the rank of the quantum Fisher information matrix (QFIM) for the QNN's output state is saturated. Here, we explore how the presence of noise affects the overparametrization phenomenon. Our results show that noise can “turn on” previously zero eigenvalues of the QFIM. This enables the parametrized state to explore directions that were otherwise inaccessible, thus potentially turning an overparametrized QNN into an underparametrized one. For small noise levels, the QNN is quasioverparametrized, as large eigenvalues coexists with small ones. Then, we prove that as the magnitude of noise increases all the eigenvalues of the QFIM become exponentially suppressed, indicating that the state becomes insensitive to any change in the parameters. As such, there is a pull-and-tug effect where noise can enable new directions but also suppress the sensitivity to parameter updates. Finally, our results imply that current QNN capacity measures are ill-defined when hardware noise is present. Published by the American Physical Society 2024

arXiv:2302.05059•Physical Review Research•Mar 18, 2024•24 citations

A General Approach to Dropout in Quantum Neural Networks

Francesco Scala, Andrea Ceschini, Massimo Panella +1 more

Abstract In classical machine learning (ML), “overfitting” is the phenomenon occurring when a given model learns the training data excessively well, and it thus performs poorly on unseen data. A commonly employed technique in ML is the so called “dropout,” which prevents computational units from becoming too specialized, hence reducing the risk of overfitting. With the advent of quantum neural networks (QNNs) as learning models, overfitting might soon become an issue, owing to the increasing depth of quantum circuits as well as multiple embedding of classical features, which are employed to give the computational nonlinearity. Here, a generalized approach is presented to apply the dropout technique in QNN models, defining and analyzing different quantum dropout strategies to avoid overfitting and achieve a high level of generalization. This study allows to envision the power of quantum dropout in enabling generalization, providing useful guidelines on determining the maximal dropout probability for a given model, based on overparametrization theory. It also highlights how quantum dropout does not impact the features of the QNN models, such as expressibility and entanglement. All these conclusions are supported by extensive numerical simulations and may pave the way to efficiently employing deep quantum machine learning (QML) models based on state‐of‐the‐art QNNs.

arXiv:2310.04120•Advanced Quantum Technologies•Dec 10, 2023•19 citations

Network of Quantum Neural Networks

Emre Tokgoz, Sharmendra Desiboyina

Communications in computer and information science•Sep 2, 2026•0 citations

Towards practical quantum neural network diagnostics with neural tangent kernels

Francesco Scala, Christa Zoufal, Dario Gerace +1 more

Abstract Predicting the performance of a Quantum Neural Network (QNN) on a given dataset before its training can save critical resources. However, obtaining such a priori information is, in general, very challenging. The Quantum Neural Tangent Kernel (QNTK) has recently emerged as a tool to mathematically describe the behavior of QNNs. Here, we provide practical guidelines for using the QNTK to diagnose the performance of a given QNN model. In particular, we link QNTK spectral features to the training dynamics, and we show how a first-order kernel approximation can predict the expected inference performance. By analyzing the interplay between the number of model parameters and of training samples, we identify a mismatch at the interpolation threshold: while the QNTK exhibits a double descent in generalization error, we observe that QNNs do not show this behavior in practice. This suggests that QNTK diagnostics are mostly reliable for overparametrized models well above the interpolation regime. Extensive numerical simulations across different architectures and datasets validate our approach. Our results demonstrate that QNTK diagnostics yields useful information about QNN behavior for sufficiently deep circuits, and enable detecting and addressing potential shortcomings in model design.

arXiv:2503.01966•npj Quantum Information•Jun 10, 2026•2 citations

Quantum effects in neural networks

秀稔 西森, Hidetoshi Nishimori, Yoshihiko Nonomura

•Dec 1, 1996•0 citations
Overparametrization is one of the most surprising and notorious phenomena in machine learning. Recently, there have been several efforts to study if, and how, quantum neural networks (QNNs) acting in the absence of hardware noise can be overparametrized. In particular, it has been proposed that a QNN can be defined as overparametrized if it has enough parameters to explore all available directions in state space. That is, if the rank of the quantum Fisher information matrix (QFIM) for the QNN's output state is saturated. Here, we explore how the presence of noise affects the overparametrization phenomenon. Our results show that noise can “turn on” previously zero eigenvalues of the QFIM. This enables the parametrized state to explore directions that were otherwise inaccessible, thus potentially turning an overparametrized QNN into an underparametrized one. For small noise levels, the QNN is quasioverparametrized, as large eigenvalues coexists with small ones. Then, we prove that as the magnitude of noise increases all the eigenvalues of the QFIM become exponentially suppressed, indicating that the state becomes insensitive to any change in the parameters. As such, there is a pull-and-tug effect where noise can enable new directions but also suppress the sensitivity to parameter updates. Finally, our results imply that current QNN capacity measures are ill-defined when hardware noise is present. Published by the American Physical Society 2024
Abstract In classical machine learning (ML), “overfitting” is the phenomenon occurring when a given model learns the training data excessively well, and it thus performs poorly on unseen data. A commonly employed technique in ML is the so called “dropout,” which prevents computational units from becoming too specialized, hence reducing the risk of overfitting. With the advent of quantum neural networks (QNNs) as learning models, overfitting might soon become an issue, owing to the increasing depth of quantum circuits as well as multiple embedding of classical features, which are employed to give the computational nonlinearity. Here, a generalized approach is presented to apply the dropout technique in QNN models, defining and analyzing different quantum dropout strategies to avoid overfitting and achieve a high level of generalization. This study allows to envision the power of quantum dropout in enabling generalization, providing useful guidelines on determining the maximal dropout probability for a given model, based on overparametrization theory. It also highlights how quantum dropout does not impact the features of the QNN models, such as expressibility and entanglement. All these conclusions are supported by extensive numerical simulations and may pave the way to efficiently employing deep quantum machine learning (QML) models based on state‐of‐the‐art QNNs.
Abstract Predicting the performance of a Quantum Neural Network (QNN) on a given dataset before its training can save critical resources. However, obtaining such a priori information is, in general, very challenging. The Quantum Neural Tangent Kernel (QNTK) has recently emerged as a tool to mathematically describe the behavior of QNNs. Here, we provide practical guidelines for using the QNTK to diagnose the performance of a given QNN model. In particular, we link QNTK spectral features to the training dynamics, and we show how a first-order kernel approximation can predict the expected inference performance. By analyzing the interplay between the number of model parameters and of training samples, we identify a mismatch at the interpolation threshold: while the QNTK exhibits a double descent in generalization error, we observe that QNNs do not show this behavior in practice. This suggests that QNTK diagnostics are mostly reliable for overparametrized models well above the interpolation regime. Extensive numerical simulations across different architectures and datasets validate our approach. Our results demonstrate that QNTK diagnostics yields useful information about QNN behavior for sufficiently deep circuits, and enable detecting and addressing potential shortcomings in model design.