arXiv:2306.05042 · International Conference on Agents and Artificial Intelligence (ICAART)
Benchmarking Quantum Surrogate Models on Scarce and Noisy Data
Jonas Stein, M H POPPEL, Philip Adamczyk, Ramona Fabry, Zixin Wu, Michael Kölle, Jonas Nüßlein, Daniëlle Schuman, Philipp J. Altmann, Thomas Ehmer, Vijay Kris Narasimhan, Claudia Linnhoff–Popien
Surrogate models are ubiquitously used in industry and academia to efficiently approximate given black box functions. As state-of-the-art methods from classical machine learning frequently struggle to solve this problem accurately for the often scarce and noisy data sets in practical applications, investigating novel approaches is of great interest. Motivated by recent theoretical results indicating that quantum neural networks (QNNs) have the potential to outperform their classical analogs in the presence of scarce and noisy data, we benchmark their qualitative performance for this scenario empirically. Our contribution displays the first application-centered approach of using QNNs as surrogate models on higher dimensional, real world data. When compared to a classical artificial neural network with a similar number of parameters, our QNN demonstrates significantly better results for noisy and scarce data, and thus motivates future work to explore this potential quantum advantage in surrogate modelling. Finally, we demonstrate the performance of current NISQ hardware experimentally and estimate the gate fidelities necessary to replicate our simulation results.
Surrogate models are ubiquitously used in industry and academia to efficiently approximate given black box functions. As state-of-the-art methods from classical machine learning frequently struggle to solve this problem accurately for the often scarce and noisy data sets in practical applications, investigating novel approaches is of great interest. Motivated by recent theoretical results indicating that quantum neural networks (QNNs) have the potential to outperform their classical analogs in the presence of scarce and noisy data, we benchmark their qualitative performance for this scenario empirically. Our contribution displays the first application-centered approach of using QNNs as surrogate models on higher dimensional, real world data. When compared to a classical artificial neural network with a similar number of parameters, our QNN demonstrates significantly better results for noisy and scarce data, and thus motivates future work to explore this potential quantum advantage in surrogate modelling. Finally, we demonstrate the performance of current NISQ hardware experimentally and estimate the gate fidelities necessary to replicate our simulation results.
For quantum machine learning, the exact boundary between classical and quantum advantage is still poorly understood. Direct comparison between quantum neural networks (QNNs) and existing classical models, which encompass fundamentally different function classes, often fails to provide broader insight into the difference between the two. Inspired by the techniques of Neural Quantum States and Random Fourier Features, this work introduces Neural Fourier Surrogates (NFS), a stochastic classical neural network architecture for efficiently learning coefficients over the same finite Fourier series support as quantum neural networks. Testing on a selection of tabular benchmark datasets, we find that NFS is an effective classifier architecture broadly competitive with established classical baselines, including a comparable Random Fourier Features model, and possessing comparable performance to data-reuploading QNNs; combined with additional analysis comparing the learned Fourier spectra of QNNs and NFS on synthetic data, these results establish NFS as a natural classical baseline for evaluating QNN performance.
The core of quantum machine learning is to devise quantum models with good trainability and low generalization error bounds than their classical counterparts to ensure better reliability and interpretability. Recent studies confirmed that quantum neural networks (QNNs) have the ability to achieve this goal on specific datasets. In this regard, it is of great importance to understand whether these advantages are still preserved on real-world tasks. Through systematic numerical experiments, we empirically observe that current QNNs fail to provide any benefit over classical learning models. Concretely, our results deliver two key messages. First, QNNs suffer from the severely limited effective model capacity, which incurs poor generalization on real-world datasets. Second, the trainability of QNNs is insensitive to regularization techniques, which sharply contrasts with the classical scenario. These empirical results force us to rethink the role of current QNNs and to design novel protocols for solving real-world problems with quantum advantages.
Quantum machine learning (QML) is an emerging research area that combines quantum computation with classical machine learning (ML). The primary objective of QML is to enhance the performance of traditional ML algorithms by harnessing quantum phenomena. Inspired by the success of classical neural networks (NNs), their quantum analog, commonly known as quantum neural networks (QNNs), are widely being investigated. Despite the significant interest, the literature still lacks some concrete evidence about QNN's superiority over their classical counterparts, especially in practical applications. This paper empirically demonstrates a greater capacity in hybrid quantum neural networks (HQNNs) for a practical application, namely multi-class classification. In particular, we train both the HQNNs and their equivalent classical counterparts on the same data. We then benchmark the models' accuracy for quantifying model's capacity, where greater accuracy typically implies greater capacity. The results demonstrate a clear quantum advantage, i.e., greater capacity of HQNNs over their classical counterparts, where the HQNN models constantly achieve better accuracy. This superiority in performance by HQNNs serves as a foundational study for further investigation to magnify the quantum advantage in real-world applications of HQNNs.
Quantum machine learning (QML) has emerged as a promising interdisciplinary field that integrates principles of quantum computing with machine learning techniques to address complex computational challenges. By leveraging quantum phenomena such as superposition and entanglement, QML aims to enhance learning efficiency, improve model performance, and enable the exploration of high-dimensional feature spaces that are intractable for classical methods. This paper presents a comprehensive review of recent developments in QML, covering fundamental concepts, algorithmic taxonomies, data encoding techniques, implementation challenges, and real-world applications. Key approaches, including quantum support vector machines (QSVM), variational quantum circuits (VQC), and quantum neural networks (QNN), are systematically analyzed. Furthermore, critical challenges, including noisy intermediate-scale quantum (NISQ) limitations, barren plateaus, data encoding bottlenecks, and the lack of demonstrated quantum advantage, are discussed in detail. The review also highlights emerging applications in material informatics, energy systems, healthcare, and optimization problems. Finally, future research directions are outlined, emphasizing the need for advancements in quantum hardware, scalable algorithms, hybrid frameworks, and standardized benchmarking. This work aims to provide a structured perspective on the current state of QML and to identify opportunities in deploy it effectively in solve real-world problems.
Quantum neural networks (QNNs) are a revolutionary paradigm placed at the frontier of machine learning and quantum computing. By utilizing quantum mechanical principles like superposition, entanglement, and quantum parallelism, QNNs facilitate the solution of complex machine learning problems that were thought to be impossible according to conventional models. This chapter provides a detailed study of QNNs, from elementary principles to practical applications. It begins with a rundown of the most significant concepts in machine learning and quantum computing, followed by QNN architecture, with important points including quantum gates and parameterized quantum circuits. The chapter addresses challenges in training QNNs, with special attention given to hybrid quantum-classical optimization algorithms and their utility in successful model training. It also examines multiple applications of QNNs, including simulation in quantum chemistry, optimization problems, and real-world machine learning applications, to demonstrate how they have the potential to outperform conventional algorithms in high dimensional or highly entangled data environments. This chapter provides a comparative assessment of quantum machine learning frameworks, quantum hardware platforms, and hybrid optimization methods and aids in determining the most suitable tools to design QNNs. It finally discusses possible areas of future research and research issues in the field, emphasizing the urgent need to improve quantum hardware, increase noise tolerance, and scale up. As quantum computing technology evolves, QNNs are expected to be at the center of solving some of the most complex and computationally intensive problems encountered in various industries.
Quantum machine learning has gained significant momentum in recent years, particularly with the use of parameterized quantum circuits that exhibit a certain level of resilience to noise in current NISQ devices. However, the real-world applicability of QML remains an active field of research as transitioning from idealized simulations to real quantum hardware introduces challenges related to data size and noise. Our study empirically analyzes the performance of popular quantum neural networks in ideal, noise-free conditions, but also in the presence of realistic noise, which was modeled to mimic the noisy behavior of current IBM quantum devices. We carefully selected three medical classification tasks that cover common data modalities with varying numbers of features-from tabular cell data to signal sampling points and image pixels. Our findings statistically show that while complex parameterized circuits perform well in noise-free simulations, their performance significantly deteriorates with increasing qubit numbers under noisy conditions. Our study suggests that parameterized quantum circuits of moderate complexity are a favorable choice for future experiments on noisy quantum devices.