This work presents a formulation to express and optimize stochastic neural networks as quantum circuits in gate-based quantum computing. Motivated by a classical perceptron, stochastic neurons are introduced and combined into a quantum neural network. The Kiefer-Wolfowitz algorithm in combination with simulated annealing is used for training the network weights. Several topologies and models are presented, including shallow fully connected networks, Hopfield Networks, Restricted Boltzmann Machines, Autoencoders and convolutional neural networks. We also demonstrate the combination of our optimized neural networks as an oracle for the Grover algorithm to realize a quantum generative AI model.
This work presents a formulation to express and optimize stochastic neural networks as quantum circuits in gate-based quantum computing. Motivated by a classical perceptron, stochastic neurons are introduced and combined into a quantum neural network. The Kiefer-Wolfowitz algorithm in combination with simulated annealing is used for training the network weights. Several topologies and models are presented, including shallow fully connected networks, Hopfield Networks, Restricted Boltzmann Machines, Autoencoders and convolutional neural networks. We also demonstrate the combination of our optimized neural networks as an oracle for the Grover algorithm to realize a quantum generative AI model.
Even the most sophisticated artificial neural networks are built by aggregating substantially identical units called neurons. A neuron receives multiple signals, internally combines them, and applies a non-linear function to the resulting weighted sum. Several attempts to generalize neurons to the quantum regime have been proposed, but all proposals collided with the difficulty of implementing non-linear activation functions, which is essential for classical neurons, due to the linear nature of quantum mechanics. Here we propose a solution to this roadblock in the form of a small quantum circuit that naturally simulates neurons with threshold activation. Our quantum circuit defines a building block, the "quantum neuron", that can reproduce a variety of classical neural network constructions while maintaining the ability to process superpositions of inputs and preserve quantum coherence and entanglement. In the construction of feedforward networks of quantum neurons, we provide numerical evidence that the network not only can learn a function when trained with superposition of inputs and the corresponding output, but that this training suffices to learn the function on all individual inputs separately. When arranged to mimic Hopfield networks, quantum neural networks exhibit properties of associative memory. Patterns are encoded using the simple Hebbian rule for the weights and we demonstrate attractor dynamics from corrupted inputs. Finally, the fact that our quantum model closely captures (traditional) neural network dynamics implies that the vast body of literature and results on neural networks becomes directly relevant in the context of quantum machine learning.
This paper highlights the possibility of creating quantum neural networks that are trained by Grover's Search Algorithm. The purpose of this work is to propose the concept of combining the training process of a neural network, which is performed on the principles of Grover's algorithm, with the functional structure of that neural network, interpreted as a quantum circuit. As a simple example of a neural network, to showcase the concept, a perceptron with one trainable parameter - the weight of a synapse connected to a hidden neuron.
This paper highlights a practical research of the possibility of forming quantum circuits for training neural networks. The demonstrated quantum circuits were based on the principles of Grover's Search Algorithm. The perceptron was chosen as the architecture for the example neural network. The multilayer perceptron is a popular neural network architecture due to its scalability and applicability for solving a wide range of problems. Large scale neural networks can require significant computing resources for training purposes, therefore Grover’s quantum search algorithm could be used as a way to speed up this process, thanks to its ability of simultaneously processing multiple input values of a given function.
Quantum Neural Networks (QNNs) have emerged as a promising avenue in the quest for next-generation machine learning capabilities.By harnessing the principles of quantum mechanics and quantum computing, QNNs offer the potential for exponential speedup and enhanced computational power compared to classical machine learning algorithms.This paper presents a comprehensive exploration of Quantum Neural Networks, covering their foundational concepts, various architectures, novel quantum-enhanced machine learning algorithms, practical implementations, advantages, and challenges.We begin with an overview of related work in Quantum Machine Learning, highlighting the achievements and progress in the field.Subsequently, we delve into the fundamental principles of Quantum Mechanics and Quantum Computing to provide a solid grounding for understanding QNNs.We then introduce the basics of Quantum Neural Networks, including quantum neurons, quantum gates, and quantum circuits for machine learning tasks.Various QNN architectures, such as Variational Quantum Circuits and Quantum Convolutional Neural Networks, are explored along with their potential applications.Additionally, quantum-enhanced machine learning algorithms, like Quantum Support Vector Machines and Quantum Generative Adversarial Networks, are discussed for a deeper understanding of QNN capabilities.Practical aspects, including hardware implementations, noise mitigation, and experimental results, are presented to shed light on the feasibility of QNNs in real-world scenarios.The paper concludes by discussing the advantages and challenges of Quantum Neural Networks and their potential implications for the future of machine learning and artificial intelligence.
The idea of quantum artificial neural networks, first formulated in [34], unites the artificial neural network concept with the quantum computation paradigm. Quantum artificial neural networks were first systematically considered in the PhD thesis by T. Menneer (1998). Based on the works of Menneer and Narayanan [42, 43], Kouda, Matsui, and Nishimura [35, 36], Altaisky [2, 68], Zhou [67], and others, quantum-inspired learning algorithms for neural networks were developed, and are now used in various training programs and computer games [29, 30]. The first practically realizable scaled hardware-implemented model of the quantum artificial neural network is obtained by D-Wave Systems, Inc. [33]. It is a quantum Hopfield network implemented on the basis of superconducting quantum interference devices (SQUIDs). In this work we analyze possibilities and underlying principles of an alternative way to implement quantum neural networks on the basis of quantum dots. A possibility of using quantum neural network algorithms in automated control systems, associative memory devices, and in modeling biological and social networks is examined.
Training deep neural networks remains a computationally intensive and often challenging process. Traditional optimization methods, such as stochastic gradient descent (SGD) and its variants, frequently struggle to escape local minima and converge to optimal solutions, leading to suboptimal network performance. This paper proposes a novel approach to neural network training that leverages principles inspired by quantum mechanics. Specifically, we investigate the application of quantum-inspired optimization techniques, including simulated annealing and quantum walks, to dynamically adjust the training process. The core idea is to mimic the probabilistic exploration inherent in quantum systems to effectively navigate the complex loss landscape of neural networks. We formulate the training process as a quantum-inspired optimization problem, where the network's weights are treated as quantum bits (Qubits) and the optimization algorithm seeks to find the lowest energy state, analogous to finding the minimum loss. The proposed method demonstrates the potential for accelerating convergence and improving the overall accuracy of neural networks compared to conventional optimization strategies. Our analysis focuses on the key aspects of the approach, including the mathematical formulation of the quantum-inspired optimization problem and the selection of appropriate parameters to govern the exploration and exploitation phases. We present a theoretical framework for understanding the dynamics of this approach and discuss potential avenues for further research, including hybrid quantum-classical algorithms and the integration of quantum computing hardware.