Abstract Quantum machine learning has become an area of growing interest but has certain theoretical and hardware-specific limitations. Notably, the problem of vanishing gradients, or barren plateaus, renders the training impossible for circuits with high qubit counts, imposing a limit on the number of qubits that data scientists can use for solving problems. Independently, angle-embedded supervised quantum neural networks were shown to produce truncated Fourier series with a degree directly dependent on two factors: the depth of the encoding and the number of parallel qubits the encoding applied to. The degree of the Fourier series limits the model expressivity. This work introduces two new architectures whose Fourier degrees grow exponentially: the sequential and parallel exponential quantum machine learning architectures. This is done by efficiently using the available Hilbert space when encoding, increasing the expressivity of the quantum encoding. Therefore, the exponential growth allows staying at the low-qubit limit to create highly expressive circuits avoiding barren plateaus. Practically, parallel exponential architecture was shown to outperform the existing linear architectures by reducing their final mean square error value by up to 44.7% in a one-dimensional test problem. Furthermore, the feasibility of this technique was also shown on a trapped ion quantum processing unit.
Abstract Quantum machine learning has become an area of growing interest but has certain theoretical and hardware-specific limitations. Notably, the problem of vanishing gradients, or barren plateaus, renders the training impossible for circuits with high qubit counts, imposing a limit on the number of qubits that data scientists can use for solving problems. Independently, angle-embedded supervised quantum neural networks were shown to produce truncated Fourier series with a degree directly dependent on two factors: the depth of the encoding and the number of parallel qubits the encoding applied to. The degree of the Fourier series limits the model expressivity. This work introduces two new architectures whose Fourier degrees grow exponentially: the sequential and parallel exponential quantum machine learning architectures. This is done by efficiently using the available Hilbert space when encoding, increasing the expressivity of the quantum encoding. Therefore, the exponential growth allows staying at the low-qubit limit to create highly expressive circuits avoiding barren plateaus. Practically, parallel exponential architecture was shown to outperform the existing linear architectures by reducing their final mean square error value by up to 44.7% in a one-dimensional test problem. Furthermore, the feasibility of this technique was also shown on a trapped ion quantum processing unit.
Quantum machine learning is the field that aims to integrate machine learning with quantum computation. In recent years, the field has emerged as an active research area with the potential to bring new insights to classical machine learning problems. One of the challenges in the field is to explore the expressibility of parametrized quantum circuits and their ability to be universal function approximators, as classical neural networks are. Recent works have shown that, with a quantum supervised learning model, we can fit any one-dimensional Fourier series, proving their universality. However, models for multidimensional functions have not been explored in the same level of detail. In this work, we study the expressibility of various types of circuit Ans\"atze that generate multidimensional Fourier series. We found that, for some Ans\"atze, the degrees of freedom required for fitting such functions grow faster than the available degrees in the Hilbert space generated by the circuits. For example, single-qudit models have limited power to represent arbitrary multidimensional Fourier series. Despite this, we show that we can enlarge the Hilbert space of the circuit by using more qudits or higher local dimensions to meet the degrees of freedom requirements, thus ensuring the universality of the models.
In this study, we apply 1D quantum convolution to address the task of time series forecasting. By encoding multiple points into the quantum circuit to predict subsequent data, each point becomes a feature, transforming the problem into a multidimensional one. Building on theoretical foundations from prior research, which demonstrated that Variational Quantum Circuits (VQCs) can be expressed as multidimensional Fourier series, we explore the capabilities of different architectures and ansatz. This analysis considers the concepts of circuit expressibility and the presence of barren plateaus. Analyzing the problem within the framework of the Fourier series enabled the design of an architecture that incorporates data reuploading, resulting in enhanced performance. Rather than a strict requirement for the number of free parameters to exceed the degrees of freedom of the Fourier series, our findings suggest that even a limited number of parameters can produce Fourier functions of higher degrees. This highlights the remarkable expressive power of quantum circuits. This observation is also significant in reducing training times. The ansatz with greater expressibility and number of non-zero Fourier coefficients consistently delivers favorable results across different scenarios, with performance metrics improving as the number of qubits increases.
Recent advancements in machine learning have revolutionised research across various fields. Despite their success, conventional learning techniques are hindered by their significant computational resources and energy requirements. Prompted by recent experimental breakthroughs in quantum computing, variational quantum machine learning (QML) – machine learning integrated with variational quantum circuits (VQCs) – has emerged as a promising alternative. Nonetheless, the theoretical framework underpinning the advantages of variational QML is still rudimentary. Specifically, the training of VQCs faces several challenges, such as the barren plateau problem, where the gradient diminishes exponentially with an increasing qubits. A related issue arises in variational QML training, where the convergence rate is exponentially small. In this thesis, we present theoretically guaranteed solutions to these challenges. First, we construct innovative circuit architectures to address the vanishing gradient problem in deep VQCs. We propose quantum controlled-layer and quantum ResNet structures, demonstrating that the expected gradient norm's lower bound is unaffected by the increase in qubits and circuit depth. Next, we introduce an initialization strategy to mitigate the vanishing gradient issue in general deep quantum circuits. We prove that Gaussian-initialized parameters ensure the gradient norm's decay rate remains inversely polynomial despite the increase in qubit numbers and circuit depth. Finally, we propose a novel and effective theory for analysing the training of quantum neural networks with moderate depths. We prove that, under certain randomness conditions in the circuits and datasets, training converges linearly with a rate inversely proportional to the dataset size. Our approach surpasses previous results, achieving exponentially larger convergence rates with modest depth, or conversely, requiring exponentially less depth for equivalent rates.
Abstract In this work, we apply 1D quantum convolution in the task of time series forecasting. By encoding multiple points into the quantum circuit to predict subsequent data, each point becomes a feature and the problem becomes a multidimensional one. Taking as basis previous theoretical works which demonstrated that Variational Quantum Circuits (VQCs) can be expressed as multidimensional Fourier series, the capabilities of different architectures and ansatz are explored. This analysis considers the concepts of circuit expressivity and the presence of barren plateaus. Analyzing the problem within the framework of the Fourier series enabled the incorporation of data reuploading in the architecture, resulting in enhanced performance. Rather than a strict requirement for the number of free parameters to exceed the degrees of freedom of the Fourier series, our findings suggest that even a limited number of parameters can produce Fourier functions of higher degrees. This highlights the remarkable expressive power of quantum circuits. This observation is also significant in reducing training times. The ansatz with greater expressivity and number of non-zero Fourier coefficients consistently delivers favorable results across different scenarios, with performance metrics improving as the number of qubits increases.
Abstract In this work, we explore the application of 1D quantum convolutional layers for time series forecasting, framing the problem within the context of machine learning and quantum circuit expressivity. By encoding multiple time steps as features into a quantum circuit, the forecasting task becomes intrinsically multidimensional. We leverage the recent theoretical results that describe Variational Quantum Circuits (VQCs) as multidimensional Fourier series, to design a more expressive 1D quantum convolutional neural network in which an enhanced performance is obtained by reuploading the data. We aim to relate the number of accessible coefficients in each architecture design with the obtained metrics. Our analysis incorporates key machine learning concepts such as expressivity and the presence of barren plateaus, evaluating their impact on generalization and training efficiency. Notably, we show that even with a limited number of trainable parameters, quantum circuits can approximate high-degree Fourier functions, underscoring their expressive capacity and computational efficiency. Our results demonstrate that more expressive ansatz, characterized by richer Fourier spectra, consistently yield improved predictive performance as the number of qubits increases. This study bridges theoretical insights from quantum physics with practical advances in machine learning model design for time series forecasting.
Abstract—Quantum Machine Learning (QML) operating on Noisy Intermediate-Scale Quantum (NISQ) hardware represents an emerging computational paradigm to address high-dimensional optimization problems that challenge classical Von Neumann supercomputing architectures. By mapping complex feature vectors into exponentially large 2^N Hilbert state spaces via Parameterized Quantum Circuits (PQCs) and Variational Quantum Algorithms (VQAs), QML targets computational advantages in combinatorial optimization, high-dimensional classification, and quantum-enhanced molecular modeling. However, the theoretical promise of NISQ-era variational computing is severely constrained by three fundamental bottlenecks: (1) Barren Plateaus, characterized by the exponential concentration of measure and vanishing variance of cost function gradients; (2) Hardware Decoherece Noise and readout error rates that corrupt quantum state fidelity; and (3) Classical-to-Quantum State Preparation bottlenecks that can erase theoretical computational speedups. This paper delivers an exhaustive, mathematically formal technical investigation and empirical benchmark of QML architectures for high-dimensional optimization. We formalize the Haar-distributed geometric mechanics of barren plateaus under 2-design unitary assumptions, evaluate barren plateau mitigation through shallow local cost operators and layer-by-layer parameter initialization, and contrast Variational Quantum Eigensolvers (VQE) with Quantum Kernel Support Vector Machines (Q-SVM). Furthermore, we construct an empirical benchmarking testbed executing across both state-vector simulators and superconducting quantum backends (IBM Quantum Heron / Eagle architectures), evaluating 127-qubit Hamiltonian optimization and high-dimensional financial portfolio allocation. Our findings demonstrate that while global cost functions suffer exponential gradient decay Var[grad] ~ O(2^-N) across circuit depth d >= 4, local Hamiltonian decomposition maintains trainable variance, achieving a 98.2% ground-state fidelity under zero-noise extrapolation (ZNE) error mitigation. Finally, we formulate open challenges in quantum error mitigation scaling, non-perturbative barren plateau escapes, and quantum data loading efficiency. Index Terms—Quantum Machine Learning (QML), Parameterized Quantum Circuits (PQCs), Variational Quantum Eigensolver (VQE), Barren Plateaus, Quantum Kernel Methods, NISQ Computing, Error Mitigation, Hilbert Space.