arXiv:1804.07633 · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics

A Simple Quantum Neural Net with a Periodic Activation Function

Ammar Daskin

Published Oct 1, 2018• 28 citations

arXiv HTML PDF

Abstract

In this paper, we propose a simple neural net that requires only O(n log_2k) number of qubits and O(nk) quantum gates: Here, N is the number of input parameters, and k is the number of weights applied to these parameters in the proposed neural net. We describe the network in terms of a quantum circuit, and then draw its equivalent classical neural net which involves O(k^n) nodes in the hidden layer. Then, we show that the network uses a periodic activation function of cosine values of the linear combinations of the inputs and weights. The backpropagation is described through the gradient descent, and then iris and breast cancer datasets are used for the simulations. The numerical results indicate the network can be used in machine learning problems and it may provide exponential speedup over the same structured classical neural net.

DOI: 10.1109/smc.2018.00491

Related papers

Towards a Real Quantum Neuron

Wei Hu

Google’s AlphaGo represents the impressive performance of deep learning and the backbone of deep learning is the workhorse of highly versatile neural networks. Each network is made up of layers of interconnected neurons and the nonlinear activation function inside each neuron is one of the key factors that account for the unprecedented achievement of deep learning. Learning how to create quantum neural networks has been a long time pursuit since 1990’s from many researchers, unfortunately without much success. The main challenge is to know how to design a nonlinear activation function inside the quantum neuron, because the laws in quantum mechanics require the operations on quantum neurons be unitary and linear. A recent discovery uses a special quantum circuit technique called repeat-until-success to make a nonlinear activation function inside a quantum neuron, which is the hard part of creating this neuron. However, the activation function used in that work is based on the periodic tangent function. Because of this periodicity, the input to this function has to be restricted to the range of [0, π/2), which is a serious constraint for its applications in real world problems. The function’s periodicity also makes its neurons not suited for being trained with gradient descent as its derivatives oscillate. The purpose of our study is to propose a new nonlinear activation function that is not periodic so it can take any real numbers and its neurons can be trained with efficient gradient descent. Our quantum neuron offers the full benefit as a quantum entity to support superposition, entanglement, interference, while also enjoys the full benefit as a classical entity to take any real numbers as its input and can be trained with gradient descent. The performance of the quantum neurons with our new activation function is analyzed on IBM’s 5Q quantum computer and IBM’s quantum simulator.

Natural ScienceJan 1, 201828 citations

Quantum Neuron: an elementary building block for machine learning on quantum computers

Yudong Cao, Gian Giacomo Guerreschi, Alán Aspuru‐Guzik

Even the most sophisticated artificial neural networks are built by aggregating substantially identical units called neurons. A neuron receives multiple signals, internally combines them, and applies a non-linear function to the resulting weighted sum. Several attempts to generalize neurons to the quantum regime have been proposed, but all proposals collided with the difficulty of implementing non-linear activation functions, which is essential for classical neurons, due to the linear nature of quantum mechanics. Here we propose a solution to this roadblock in the form of a small quantum circuit that naturally simulates neurons with threshold activation. Our quantum circuit defines a building block, the "quantum neuron", that can reproduce a variety of classical neural network constructions while maintaining the ability to process superpositions of inputs and preserve quantum coherence and entanglement. In the construction of feedforward networks of quantum neurons, we provide numerical evidence that the network not only can learn a function when trained with superposition of inputs and the corresponding output, but that this training suffices to learn the function on all individual inputs separately. When arranged to mimic Hopfield networks, quantum neural networks exhibit properties of associative memory. Patterns are encoded using the simple Hebbian rule for the weights and we demonstrate attractor dynamics from corrupted inputs. Finally, the fact that our quantum model closely captures (traditional) neural network dynamics implies that the vast body of literature and results on neural networks becomes directly relevant in the context of quantum machine learning.

arXiv:1711.11240Nov 30, 2017113 citations

A Quantum Activation Function for Neural Networks: Proposal and Implementation

Saurabh Kumar, Siddharth Dangwal, Soumik Adhikary +1 more

A non-linear activation function is an integral component of neural network algorithms used for various tasks such as data classification and pattern recognition. In neu-romorphic/emerging-hardware-based implementations of neural network algorithms, the non-linear activation function is often implemented through dedicated analog electronics. This enables faster execution of the activation function during training and inference of neural networks compared to conventional digital implementation. Here, with a similar motivation, we propose a novel non-linear activation function that can be used in a neural network for data classification. Our activation function can be implemented by taking advantage of the inherent nonlinearity in qubit preparation and SU(2) operation in quantum mechanics. These operations are directly implementable on quantum hardware through single-qubit quantum gates as we show here. In addition, the SU(2) parameters are adjustable here making the activation function adaptable; we adjust the parameters through classical feedback like in a variational algorithm in quantum machine learning. Using our proposed quantum activation function, we report accurate classification using popular machine learning data sets like Fisher's Iris, Wisconsin's Breast Cancer (WBC), Abalone, and MNIST on three different platforms: simulations on a classical computer, simulations on a quantum simulation framework like Qiskit, and experimental implementation on quantum hardware (IBM-Q). Then we use a Bloch-sphere-based approach to intuitively explain how our proposed quantum activation function, with its adaptability, helps in data classification.

International Joint Conference on Neural Networks (IJCNN)Jul 18, 20214 citations

NISQ-Friendly Non-Linear Activation Functions for Quantum Neural Networks

Sohrab Sajadimanesh, Jean Paul Latyr Faye, Ehsan Atoofian

The current generation of quantum computers calls for quantum algorithms that require a limited number of quantum gates and are resilient to noises. A suitable design strategy is variational circuits where parameters of circuits are determined through training, an approach that conforms with characteristics of machine learning applications. In this paper, we propose a low-depth and implementation-efficient non-linear activation function for quantum neural networks (QNNs). The building block of a quantum circuit is quantum gate which is a unitary operation. Thus, building a non-linear component out of quantum gates is challenging. While the majority of prior works used measurement as the source of non-linearity, this method has limited ability in classifying datasets. We propose a quantum circuit for the popular Rectified Linear Unit (ReLU) activation function. Our proposed circuit is based on low-cost quantum gates that can be synthesized into primitive gates in contemporary quantum computers. We exploit QNNs that rely on quantum rotation to define decision boundaries for classification problems. In addition, we use controlled quantum gates to detect correlation in data through entanglement of qubits. Our evaluations reveal that QNNs equipped with our proposed quantum ReLU perform well on standard benchmark datasets while requiring dramatically fewer number of epochs for training compared with classical neural networks. In addition, we run QNNs with different number of quantum layers on an IBM quantum computer and show that our proposed circuits are practical and generate meaningful results on real quantum computers.

IEEE International Conference on Networking, Architecture and Storage (NAS)Oct 1, 20227 citations

A 1-Gate, 1-Qubit Quantum Neural Network

Nur Hidayat, Mirza, Faruq Nuruddinsyah, Muhammad

In this study, we construct a single-qubit quantum neural network using only one rotation gate to implement all Boolean logic functions and to classify the Iris dataset. This rotation gate serves simultaneously as both a quantum feature map and an ansatz. The ansatz parameters are optimised using gradient descent, with the mean squared error as the loss function. Results confirm that the circuit successfully implements all Boolean logic functions and classifies the Iris dataset.

Nov 4, 20250 citations

Coherent feed-forward quantum neural network

Utkarsh Singh, Aaron Z. Goldberg, Khabat Heshami

Abstract Quantum machine learning, focusing on quantum neural networks (QNNs), remains a vastly uncharted field of study. Current QNN models primarily employ variational circuits on an ansatz or a quantum feature map, often requiring multiple entanglement layers. This methodology not only increases the computational cost of the circuit beyond what is practical on near-term quantum devices but also misleadingly labels these models as neural networks, given their divergence from the structure of a typical feed-forward neural network (FFNN). Moreover, the circuit depth and qubit needs of these models scale poorly with the number of data features, resulting in an efficiency challenge for real-world machine learning tasks. We introduce a bona fide QNN model, which seamlessly aligns with the versatility of a traditional FFNN in terms of its adaptable intermediate layers and nodes, absent from intermediate measurements such that our entire model is coherent. This model stands out with its reduced circuit depth and number of requisite CNOT gates, achieving a more than 50% reduction in both compared to prevailing QNN models. Furthermore, the qubit count in our model remains unaffected by the data’s feature quantity. We test our proposed model on various benchmarking datasets such as the breast cancer diagnostic (Wisconsin) and credit card fraud detection datasets. Our model achieved an accuracy of 91% on the breast cancer dataset and 85% on the credit card fraud detection dataset, outperforming existing QNN methods by 5–10% while requiring approximately 50% fewer quantum resources. These results showcase the advantageous efficacy of our approach, paving the way for the application of quantum neural networks to relevant real-world machine learning problems.

arXiv:2402.00653Quantum Machine IntelligenceDec 1, 20244 citations