Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2303.13462 · Physical Review Letters

Generalization of Quantum Machine Learning Models Using Quantum Fisher Information Metric

Tobias Haug, M. S. Kim

Published Jul 31, 2024• 25 citations
arXivHTMLPDF

Abstract

Generalization is the ability of machine learning models to make accurate predictions on new data by learning from training data. However, understanding generalization of quantum machine learning models has been a major challenge. Here, we introduce the data quantum Fisher information metric (DQFIM). It describes the capacity of variational quantum algorithms depending on variational ansatz, training data, and their symmetries. We apply the DQFIM to quantify circuit parameters and training data needed to successfully train and generalize. Using the dynamical Lie algebra, we explain how to generalize using a low number of training states. Counterintuitively, breaking symmetries of the training data can help to improve generalization. Finally, we find that out-of-distribution generalization, where training and testing data are drawn from different data distributions, can be better than using the same distribution. Our work provides a useful framework to explore the power of quantum machine learning models.

DOI
10.1103/physrevlett.133.050603

Related papers

Generalization in quantum machine learning from few training data

Matthias C. Caro, Hsin-Yuan Huang, Marco Cerezo +4 more

Modern quantum machine learning (QML) methods involve variationally optimizing a parameterized quantum circuit on a training data set, and subsequently making predictions on a testing data set (i.e., generalizing). In this work, we provide a comprehensive study of generalization performance in QML after training on a limited number N of training data points. We show that the generalization error of a quantum machine learning model with T trainable gates scales at worst as [Formula: see text]. When only K ≪ T gates have undergone substantial change in the optimization process, we prove that the generalization error improves to [Formula: see text]. Our results imply that the compiling of unitaries into a polynomial number of native gates, a crucial application for the quantum computing industry that typically uses exponential-size training data, can be sped up significantly. We also show that classification of quantum states across a phase transition with a quantum convolutional neural network requires only a very small training data set. Other potential applications include learning quantum error correcting codes or quantum dynamical simulation. Our work injects new hope into the field of QML, as good generalization is guaranteed from few training data.

arXiv:2111.05292•Nature Communications•Aug 22, 2022•480 citations

Out-of-distribution generalization for learning quantum dynamics

Matthias C. Caro, Hsin-Yuan Huang, Nic Ezzell +5 more

Generalization bounds are a critical tool to assess the training data requirements of Quantum Machine Learning (QML). Recent work has established guarantees for in-distribution generalization of quantum neural networks (QNNs), where training and testing data are drawn from the same data distribution. However, there are currently no results on out-of-distribution generalization in QML, where we require a trained model to perform well even on data drawn from a different distribution to the training distribution. Here, we prove out-of-distribution generalization for the task of learning an unknown unitary. In particular, we show that one can learn the action of a unitary on entangled states having trained only product states. Since product states can be prepared using only single-qubit gates, this advances the prospects of learning quantum dynamics on near term quantum hardware, and further opens up new methods for both the classical and quantum compilation of quantum circuits.

arXiv:2204.10268•Nature Communications•Jul 5, 2023•78 citations

Understanding quantum machine learning also requires rethinking generalization

Elies Gil-Fuster, Jens Eisert, Carlos Bravo-Prieto

Quantum machine learning models have shown successful generalization performance even when trained with few data. In this work, through systematic randomization experiments, we show that traditional approaches to understanding generalization fail to explain the behavior of such quantum models. Our experiments reveal that state-of-the-art quantum neural networks accurately fit random states and random labeling of training data. This ability to memorize random data defies current notions of small generalization error, problematizing approaches that build on complexity measures such as the VC dimension, the Rademacher complexity, and all their uniform relatives. We complement our empirical results with a theoretical construction showing that quantum neural networks can fit arbitrary labels to quantum states, hinting at their memorization ability. Our results do not preclude the possibility of good generalization with few training data but rather rule out any possible guarantees based only on the properties of the model family. These findings expose a fundamental challenge in the conventional understanding of generalization in quantum machine learning and highlight the need for a paradigm shift in the study of quantum models for machine learning tasks.

arXiv:2306.13461•Jun 23, 2023•1 citation

Understanding quantum machine learning also requires rethinking generalization

Elies Gil-Fuster, Jens Eisert, Carlos Bravo-Prieto

Quantum machine learning models have shown successful generalization performance even when trained with few data. In this work, through systematic randomization experiments, we show that traditional approaches to understanding generalization fail to explain the behavior of such quantum models. Our experiments reveal that state-of-the-art quantum neural networks accurately fit random states and random labeling of training data. This ability to memorize random data defies current notions of small generalization error, problematizing approaches that build on complexity measures such as the VC dimension, the Rademacher complexity, and all their uniform relatives. We complement our empirical results with a theoretical construction showing that quantum neural networks can fit arbitrary labels to quantum states, hinting at their memorization ability. Our results do not preclude the possibility of good generalization with few training data but rather rule out any possible guarantees based only on the properties of the model family. These findings expose a fundamental challenge in the conventional understanding of generalization in quantum machine learning and highlight the need for a paradigm shift in the study of quantum models for machine learning tasks.

Nature Communications•Mar 13, 2024•82 citations

Quantum Machine Learning: A Theoretical Framework for Generalization

Jincheng Zhang

This paper delves into the nascent field of quantum machine learning (QML) by establishing a theoretical framework for understanding and predicting the generalization capabilities of QML algorithms. Currently, the practical success of QML algorithms is often attributed to empirical observation, lacking a robust theoretical underpinning. This work addresses this gap by leveraging concepts from quantum information theory to analyze the generalization performance of various QML algorithms. We propose a model that connects algorithm parameters, dataset characteristics, and the resulting generalization error, expressed mathematically as: Γ(θ, D) = ED[|f(x) - ψ(x)|] where: Γ(θ, D) represents the generalization error; θ represents the algorithm's parameters; D represents the dataset; ED[ ] denotes the expected value with respect to the dataset D; f(x) is the model's prediction; ψ(x) is the true label or target. Furthermore, we explore the potential for quantum advantage in generalization, considering the impact of quantum entanglement and superposition on reducing the risk of overfitting. The core contribution lies in providing a methodological approach for quantifying and improving generalization performance in QML, moving beyond purely experimental evaluations. We introduce a novel metric, the Quantum Generalization Index (QGI), defined as: QGI = (1 - Γ(θ, D)) / (1 + Γ(θ, D)) This index provides a normalized measure of generalization performance, allowing for comparative analysis of different QML algorithms and parameter settings. Ultimately, this research aims to provide a foundational understanding for the design and development of more reliable and robust quantum machine learning systems.

•Aug 29, 2026•0 citations

A Brief Survey on Efficient Models for Qubits Encoding Using Quantum Machine Learning With Multi Level Time Series Data Classification

Singaraju Srinivasulu, G. Nagarajan

When it comes to realizing immediate quantum advantages in practical applications like machine learning and optimization techniques, numerous methods have emerged as a frontrunner technique. Such algorithms often involve quantum circuits for data encoding and the training of Quantum Neural Networks (QNNs) to minimize target functions when applied to tasks involving classical data. Quantum Machine Learning (QML) is a promising area of quantum computing because it may effectively handle difficult learning tasks by taking advantage of the high dimensional Hilbert space to train better representations from limited data. Despite QML's rising popularity, few academic works have addressed the language's security features. There has been a lot of buzz about the promising new discipline of quantum machine learning. Training a parameterized quantum circuit is a common practice in contemporary QML for performing data analysis on classical or quantum datasets. To make accurate predictions on an independent test dataset, state-of-the-art QML techniques first variationally optimize a parameterized quantum circuit using the training dataset. Quantum modeling in QML has also been shown to offer an exponential benefit in sample complexity. In the realms of pattern recognition, machine learning, and data mining, feature dimensionality reduction as a crucial link in the process has become one hot and tough spot. Most academics have gravitated towards this topic because of the difficulty of its studies. The goal of this research is to learn how to implement low loss in the procedure of feature dimension reduction, preserve the integrity of the original data, locate the most effective mapping, and obtain the best possible low-dimensional data. Preliminary findings suggest that QML models may offer advantages over classical models for classical data analysis. In this paper, a thorough investigation into generalization performance in QML is performed. This paper presents a brief survey on Qubits Encoding using Quantum Machine Learning models that help researchers to identify the limitations of the existing models and to design new efficient models for better performance levels.

Innovations in Power and Advanced Computing Technologies (i-PACT)•Dec 8, 2023•36 citations
Generalization is the ability of machine learning models to make accurate predictions on new data by learning from training data. However, understanding generalization of quantum machine learning models has been a major challenge. Here, we introduce the data quantum Fisher information metric (DQFIM). It describes the capacity of variational quantum algorithms depending on variational ansatz, training data, and their symmetries. We apply the DQFIM to quantify circuit parameters and training data needed to successfully train and generalize. Using the dynamical Lie algebra, we explain how to generalize using a low number of training states. Counterintuitively, breaking symmetries of the training data can help to improve generalization. Finally, we find that out-of-distribution generalization, where training and testing data are drawn from different data distributions, can be better than using the same distribution. Our work provides a useful framework to explore the power of quantum machine learning models.
Modern quantum machine learning (QML) methods involve variationally optimizing a parameterized quantum circuit on a training data set, and subsequently making predictions on a testing data set (i.e., generalizing). In this work, we provide a comprehensive study of generalization performance in QML after training on a limited number N of training data points. We show that the generalization error of a quantum machine learning model with T trainable gates scales at worst as [Formula: see text]. When only K ≪ T gates have undergone substantial change in the optimization process, we prove that the generalization error improves to [Formula: see text]. Our results imply that the compiling of unitaries into a polynomial number of native gates, a crucial application for the quantum computing industry that typically uses exponential-size training data, can be sped up significantly. We also show that classification of quantum states across a phase transition with a quantum convolutional neural network requires only a very small training data set. Other potential applications include learning quantum error correcting codes or quantum dynamical simulation. Our work injects new hope into the field of QML, as good generalization is guaranteed from few training data.
Generalization bounds are a critical tool to assess the training data requirements of Quantum Machine Learning (QML). Recent work has established guarantees for in-distribution generalization of quantum neural networks (QNNs), where training and testing data are drawn from the same data distribution. However, there are currently no results on out-of-distribution generalization in QML, where we require a trained model to perform well even on data drawn from a different distribution to the training distribution. Here, we prove out-of-distribution generalization for the task of learning an unknown unitary. In particular, we show that one can learn the action of a unitary on entangled states having trained only product states. Since product states can be prepared using only single-qubit gates, this advances the prospects of learning quantum dynamics on near term quantum hardware, and further opens up new methods for both the classical and quantum compilation of quantum circuits.
Quantum machine learning models have shown successful generalization performance even when trained with few data. In this work, through systematic randomization experiments, we show that traditional approaches to understanding generalization fail to explain the behavior of such quantum models. Our experiments reveal that state-of-the-art quantum neural networks accurately fit random states and random labeling of training data. This ability to memorize random data defies current notions of small generalization error, problematizing approaches that build on complexity measures such as the VC dimension, the Rademacher complexity, and all their uniform relatives. We complement our empirical results with a theoretical construction showing that quantum neural networks can fit arbitrary labels to quantum states, hinting at their memorization ability. Our results do not preclude the possibility of good generalization with few training data but rather rule out any possible guarantees based only on the properties of the model family. These findings expose a fundamental challenge in the conventional understanding of generalization in quantum machine learning and highlight the need for a paradigm shift in the study of quantum models for machine learning tasks.
Quantum machine learning models have shown successful generalization performance even when trained with few data. In this work, through systematic randomization experiments, we show that traditional approaches to understanding generalization fail to explain the behavior of such quantum models. Our experiments reveal that state-of-the-art quantum neural networks accurately fit random states and random labeling of training data. This ability to memorize random data defies current notions of small generalization error, problematizing approaches that build on complexity measures such as the VC dimension, the Rademacher complexity, and all their uniform relatives. We complement our empirical results with a theoretical construction showing that quantum neural networks can fit arbitrary labels to quantum states, hinting at their memorization ability. Our results do not preclude the possibility of good generalization with few training data but rather rule out any possible guarantees based only on the properties of the model family. These findings expose a fundamental challenge in the conventional understanding of generalization in quantum machine learning and highlight the need for a paradigm shift in the study of quantum models for machine learning tasks.
This paper delves into the nascent field of quantum machine learning (QML) by establishing a theoretical framework for understanding and predicting the generalization capabilities of QML algorithms. Currently, the practical success of QML algorithms is often attributed to empirical observation, lacking a robust theoretical underpinning. This work addresses this gap by leveraging concepts from quantum information theory to analyze the generalization performance of various QML algorithms. We propose a model that connects algorithm parameters, dataset characteristics, and the resulting generalization error, expressed mathematically as: Γ(θ, D) = ED[|f(x) - ψ(x)|] where: Γ(θ, D) represents the generalization error; θ represents the algorithm's parameters; D represents the dataset; ED[ ] denotes the expected value with respect to the dataset D; f(x) is the model's prediction; ψ(x) is the true label or target. Furthermore, we explore the potential for quantum advantage in generalization, considering the impact of quantum entanglement and superposition on reducing the risk of overfitting. The core contribution lies in providing a methodological approach for quantifying and improving generalization performance in QML, moving beyond purely experimental evaluations. We introduce a novel metric, the Quantum Generalization Index (QGI), defined as: QGI = (1 - Γ(θ, D)) / (1 + Γ(θ, D)) This index provides a normalized measure of generalization performance, allowing for comparative analysis of different QML algorithms and parameter settings. Ultimately, this research aims to provide a foundational understanding for the design and development of more reliable and robust quantum machine learning systems.
When it comes to realizing immediate quantum advantages in practical applications like machine learning and optimization techniques, numerous methods have emerged as a frontrunner technique. Such algorithms often involve quantum circuits for data encoding and the training of Quantum Neural Networks (QNNs) to minimize target functions when applied to tasks involving classical data. Quantum Machine Learning (QML) is a promising area of quantum computing because it may effectively handle difficult learning tasks by taking advantage of the high dimensional Hilbert space to train better representations from limited data. Despite QML's rising popularity, few academic works have addressed the language's security features. There has been a lot of buzz about the promising new discipline of quantum machine learning. Training a parameterized quantum circuit is a common practice in contemporary QML for performing data analysis on classical or quantum datasets. To make accurate predictions on an independent test dataset, state-of-the-art QML techniques first variationally optimize a parameterized quantum circuit using the training dataset. Quantum modeling in QML has also been shown to offer an exponential benefit in sample complexity. In the realms of pattern recognition, machine learning, and data mining, feature dimensionality reduction as a crucial link in the process has become one hot and tough spot. Most academics have gravitated towards this topic because of the difficulty of its studies. The goal of this research is to learn how to implement low loss in the procedure of feature dimension reduction, preserve the integrity of the original data, locate the most effective mapping, and obtain the best possible low-dimensional data. Preliminary findings suggest that QML models may offer advantages over classical models for classical data analysis. In this paper, a thorough investigation into generalization performance in QML is performed. This paper presents a brief survey on Qubits Encoding using Quantum Machine Learning models that help researchers to identify the limitations of the existing models and to design new efficient models for better performance levels.