IEEE International Conference on Quantum Computing and Engineering (QCE)

Grover's Implementation of Quantum Binary Neural Networks

Brody Wrighter, Sonia López Alarcón

Published Sep 17, 2023• 2 citations

Abstract

Binary Neural Networks (BNNs) are the result of a simplification of network parameters in Artificial Neural Networks (ANNs). The computational complexity of training ANNs increases significantly as the size of the network increases. This complexity can be greatly reduced if the parameters of the network are binarized. Binarization, which is a one bit quantization, can also come with complications including error and information loss. The implementation of BNNs on quantum hardware could potentially provide a computational advantage over its classical counterpart. This is due to the fact that binarized parameters fit nicely to the nature of quantum hardware. Quantum superposition allows the network to be trained more efficiently, without using back propagation techniques, with the application of Grover's Algorithm for the training process. This paper looks into two BNN designs that utilize only quantum hardware, as opposed to hybrid quantum-classical implementations. It also provides practical implementations for both of them. Looking into their scalability, improvements on the design are proposed to reduce complexity even further.

DOI: 10.1109/qce57702.2023.00043

Related papers

Training Ensembles of Quantum Binary Neural Networks

Daivid V. Leal, Tiago De Lima, Adenilton José da Silva

Artificial Neural Networks (NNs) are applied to solve problems in several fields such as translation, image processing, and diagnosis of diseases. Training NNs and searching weights parameters for them is a costly task that depends on weights initialization. This problem cost increases when it is necessary to train an Ensemble of Neural Networks (ENNs). Some works explore ways to train Binary Neural Networks (BNNs) using quantum techniques with success. This paper shows a hybrid approach to train an Ensemble of Binary Neural Networks with the same computational cost to train one variational quantum circuit.

International Joint Conference on Neural Networks (IJCNN)Jul 18, 20213 citations

Grover’s Algorithm for Neural Networks

Andrew Haverly, Shahram Rahimi, M. A. Novotny

This paper introduces an application of Grover’s algorithm to optimize neural network training by eliminating the computationally demanding backward propagation. It clarifies previous assertions regarding training neural networks with Grover’s algorithm. The paper introduces parallel data training and training on exponentially seeded datasets. A quantum binary neural network is created to more efficiently implement neural networks on quantum computers. This trained discriminatory quantum binary neural network is shown to behave as a generative quantum binary neural network. We present methods that both simplify and enhance the process of neural network development and training through Grover’s algorithm. The quantum binary neural network has the potential to far outpace classical neural network training in terms of training time and energy.

International Conference on Quantum Communications, Networking, and Computing (QCNC)Mar 31, 20252 citations

Quantum advantage in training binary neural networks

Yidong Liao, Daniel Ebler, Feiyang Liu +1 more

The performance of a neural network for a given task is largely determined by the initial calibration of the network parameters. Yet, it has been shown that the calibration, also referred to as training, is generally NP-complete. This includes networks with binary weights, an important class of networks due to their practical hardware implementations. We therefore suggest an alternative approach to training binary neural networks. It utilizes a quantum superposition of weight configurations. We show that the quantum training guarantees with high probability convergence towards the globally optimal set of network parameters. This resolves two prominent issues of classical training: (1) the vanishing gradient problem and (2) common convergence to suboptimal network parameters. Moreover we achieve a provable polynomial---sometimes exponential---speedup over classical training for certain classes of tasks. We design an explicit training algorithm and implement it in numerical simulations.

arXiv:1810.12948Oct 30, 20183 citations

Training an Artificial Neural Network Using Qubits as Artificial Neurons: A Quantum Computing Approach

Avinash Chalumuri, Raghavendra Kune, B. S. B. S. Manoj

Artificial neural networks (ANN) proved to be efficient in solving many problems for big data analytics using machine learning. The complex and non-linear features of the input data can be learned and generalized by ANN. In the big data era, enormous amounts of data arrive from multiple sources. A stage is expected to be reached where even supercomputers are likely inundated with the big data. Training an ANN in such a situation is a challenging task due to the size and dimension of the big data. Also, a large number of parameters are to be used and optimized in the network to learn the patterns and analyze such data. Quantum computing is emerging as a field that provides a solution to this problem as a quantum computer can represent data differently using qubits. Qubits on quantum computers can be used to detect the hidden patterns in data that are difficult for a classical computer to find. Hence, there exists a huge scope for application in the area of artificial neural networks. In this work, we primarily focused on training an artificial neural network using qubits as artificial neurons. The simulation results show that our quantum computing approach for ANN (QC ANN) is efficient when compared to classical ANN. The model with qubits as artificial neurons can learn the features of data using fewer parameters for a binary classification task. We demonstrate our experiment using a quantum simulator and optimization of the quantum parameters used in QC ANN is carried out on a classical computer.

Procedia Computer ScienceJan 1, 202018 citations

An artificial neuron implemented on an actual quantum processor

Francesco Tacchino, Chiara Macchiavello, Dario Gerace +1 more

Abstract Artificial neural networks are the heart of machine learning algorithms and artificial intelligence. Historically, the simplest implementation of an artificial neuron traces back to the classical Rosenblatt’s “perceptron”, but its long term practical applications may be hindered by the fast scaling up of computational complexity, especially relevant for the training of multilayered perceptron networks. Here we introduce a quantum information-based algorithm implementing the quantum computer version of a binary-valued perceptron, which shows exponential advantage in storage resources over alternative realizations. We experimentally test a few qubits version of this model on an actual small-scale quantum processor, which gives answers consistent with the expected results. We show that this quantum model of a perceptron can be trained in a hybrid quantum-classical scheme employing a modified version of the perceptron update rule and used as an elementary nonlinear classifier of simple patterns, as a first step towards practical quantum neural networks efficiently implemented on near-term quantum processing hardware.

arXiv:1811.02266npj Quantum InformationMar 29, 2019278 citations

A Hybrid Quantum-Classical Neural Network Architecture for Binary Classification

Davis Arthur, Prasanna Date

Deep learning is one of the most successful and far-reaching strategies used in machine learning today. However, the scale and utility of neural networks is still greatly limited by the current hardware used to train them. These concerns have become increasingly pressing as conventional computers quickly approach physical limitations that will slow performance improvements in years to come. For these reasons, scientists have begun to explore alternative computing platforms, like quantum computers, for training neural networks. In recent years, variational quantum circuits have emerged as one of the most successful approaches to quantum deep learning on noisy intermediate scale quantum devices. We propose a hybrid quantum-classical neural network architecture where each neuron is a variational quantum circuit. We empirically analyze the performance of this hybrid neural network on a series of binary classification data sets using a simulated universal quantum computer and a state of the art universal quantum computer. On simulated hardware, we observe that the hybrid neural network achieves roughly 10% higher classification accuracy and 20% better minimization of cost than an individual variational quantum circuit. On quantum hardware, we observe that each model only performs well when the qubit and gate count is sufficiently small.

arXiv:2201.01820Jan 5, 202220 citations