IEEE Aerospace Conference (AERO)

Quantum Image Fusion Methods for Remote Sensing

Leslie Miller, Glen S. Uehara, Andreas Spanias

Published Mar 2, 2024• 12 citations

Abstract

This paper presents algorithms, simulations, and results using machine learning and quantum image fusion algorithms for radar and remote sensing applications. Previous efforts in the classification of synthetic aperture radar (SAR) images using quantum machine learning provided encouraging results but, nevertheless modest accuracy. In this paper, we propose a novel quantum image fusion technique used for identifying and classifying objects obtained from C-band SAR and optical images. More specifically, we design a four-qubit quantum circuit to process the SAR image dataset. This method enhances the spectral details otherwise not seen when using the raw SAR dataset. In addition to the quantum circuit, we design deep neural networks (NN) to improve classification results. The Visual Geometry Group 16 (VGG16), a convolutional neural network that is sixteen layers deep, is customized and used for classification. The merit of quantum fusion as well as the promising results in improving the overall system and the potential of lowering size, weight, power, and cost (SWaP-C) is described.

DOI: 10.1109/aero58975.2024.10521113

Related papers

Image Fusion With Quantum Processing for Scene Classification Using the BigEarthNet Dataset

Leslie Miller, Glen S. Uehara, Niraj Anil Babar +1 more

This paper presents algorithms, simulations, and results on the use of optical and Synthetic Aperture Radar (SAR) quantum image fusion and machine learning algorithms for radar and remote sensing applications. We propose novel quantum image fusion techniques that extract meaningful features for identifying and classifying scenes obtained from the BigEarthNet dataset. Specifically, this work focuses on multi-label scene classification using quantum image fusion of C-band SAR and optical imagery from the BigEarthNet dataset. The proposed fusion techniques enhance and sharpen structural and textural details that are not readily observable in raw SAR imagery, thereby improving downstream classification performance. To enable quantum image fusion, we design new quantum circuits that employ unitary and Pauli gates for phase encoding of pixel intensity values. These circuits allow optical and SAR image information to be encoded and fused within a quantum processing framework. Three fusion strategies are investigated, resulting in three distinct quantum image fusion models. Comparative evaluation of these models demonstrates that pixel-averaging–based quantum fusion yields improved classification accuracy relative to alternative fusion approaches. The fused images are subsequently processed using deep classical neural networks to perform scene classification. Our neural network study begins by customizing the Visual Geometry Group 16 (VGG16) architecture for multi-label remote sensing classification tasks. In addition, we examine the use of a Residual Network 50 (ResNet-50) architecture and provide comparative performance analysis between the two models. The effects of quantum noise on the fusion and classification pipeline are also studied to assess robustness under realistic quantum processing conditions. To evaluate classification performance, we employ standard metrics such as F1 and F2 scores, and additionally introduce false discovery rate and false negative rate metrics to provide a more comprehensive assessment of classification accuracy, particularly in multi-label settings. Overall, the results demonstrate the effectiveness of optical and SAR quantum image fusion in enhancing scene classification performance and highlight the potential of integrating quantum image processing with deep learning for advanced remote sensing applications.

IEEE AccessJan 1, 20261 citation

Quantum Machine Learning for Optical and SAR Classification

Leslie Miller, Glen S. Uehara, Aradhita Sharma +1 more

We present in this paper a method to compare scene classification accuracy of C-band Synthetic aperture radar (SAR) and optical images utilizing both classical and quantum computing algorithms. This REU study uses data from the Sentinel satellite. The dataset contains (i) synthetic aperture radar images collected from the Sentinel-1 satellite and (ii) optical images for the same area as the SAR images collected from the Sentinel-2 satellite. We examine classical neural networks to classify four classes of images. We then explore Quantum Convolutional Neural Networks and deep learning techniques in terms of their training and classification performance. A hybrid Quantum-classical model that is trained on the Sentinel1-2 dataset is proposed, and its performance is then compared against the classical model in terms of classification accuracy.

IEEE International Conference on Digital Signal Processing (DSP)Jun 11, 202310 citations

Quantum classification for synthetic aperture radar

Salil Naik, Nolan Vaughn, Glen S. Uehara +2 more

The field of quantum computing, especially quantum machine learning (QML), has been the subject of much research in recent years. Leveraging the quantum properties of superposition and entanglement promises exponential decrease in computation costs. With the promises of increased speed and accuracy in the quantum paradigm, many classical machine learning algorithms have been adapted to run on quantum computers, typically using a quantum-classical hybrid model. While some work has been done to compare classical and quantum classification algorithms in the Electro-Optical (EO) image domain, this paper will compare the performance of classical and quantum-hybrid classification algorithms in their applications on Synthetic Aperture Radar (SAR) data using the MSTAR dataset. We find that there is no significant difference in classification performance when training with quantum algorithms in ideal simulators as compared to their classical counterparts. However, the true performance benefits will become more apparent as the hardware matures.

Automatic target recognition. ConferenceJun 7, 20242 citations

Remote Sensing Imagery Classification Techniques Using Quantum Deep Learning

Puneet Anchalia, G.S. Smrithy, D. Kavitha +1 more

Remote sensing imagery classification remains a formidable challenge, primarily attributed to the high dimensionality and complexity inherent in the data. While deep learning has demonstrated efficacy in this domain, its computational demands and reliance on extensive training data pose significant hurdles. This research investigates how quantum computing could be able to overcome these constraints and improve deep learning’s capacity for classifying remote sensing data. The study provides an extensive review of recent developments in quantum deep learning techniques specifically tailored for remote sensing applications. Various quantum algorithms designed for image feature extraction and classification are discussed, shedding light on their potential to revolutionize the field. As a practical demonstration, the chapter presents a case study focused on leveraging quantum deep learning for land cover classification using Sentinel-2 imagery. This chapter’s main focus is on hybrid quantum convolutional neural networks (QCNNs) based on circuits as effective tools for remote sensing picture classification. These hybrid models integrate quantum layers within traditional neural networks, introducing a novel paradigm for image analysis. To evaluate the efficacy of this approach, the proposed QCNN architecture is applied to land-use and land-cover classification, employing the Euro SAT dataset as a benchmark.

Auerbach Publications eBooksMar 3, 20250 citations

On the potentials of Tensor-based Quantum Machine Learning for SAR land-cover classification

Sreejit Dutta, Sigurd Huber, Gerhard Krieger

Synthetic Aperture Radar (SAR) data, characterised by its high-dimensionality and complex spatial correlations, poses significant challenges in terms of efficient processing and meaningful interpretation. Classical algorithms, while effective, often struggle with the sheer volume and intricacy of the data. This paper introduces a novel approach employing tensor quantum machine learning (QML) to tackle the intricacies of SAR data. By harnessing the computational advantages of quantum mechanics and the representational efficiency of tensor networks, we try to achieve enhanced feature extraction and pattern recognition. We look at various Tensor decomposition schemes to reduce data dimensionality as well as Tensor based quantum circuits to perform land-cover classification. Preliminary results, based on simulations, demonstrate the potential of our tensor QML framework. For the scope of this research so far, we worked with simulated amplitude and phase data, but we will be applying the same for real world data in the future. This interdisciplinary study not only opens avenues for improved SAR data analysis but also enriches the burgeoning field of quantum machine learning by highlighting its applicability in remote sensing domains.

Apr 1, 20240 citations

Quanv4EO: Empowering Earth Observation by Means of Quanvolutional Neural Networks

Alessandro Sebastianelli, Francesco Mauro, Giulia Ciabatti +4 more

A significant amount of remotely sensed data is generated daily by many Earth observation (EO) spaceborne and airborne sensors over different countries of our planet. Different applications use those data, such as natural hazard monitoring, global climate change, urban planning, and more. Many challenges are brought by the use of these big data in the context of remote sensing (RS) applications. In recent years, the employment of machine learning (ML) and deep learning (DL)-based algorithms has allowed a more efficient use of these data, but the issues in managing, processing, and efficiently exploiting them have even increased as classical computers have reached their limits. This article highlights a significant shift toward leveraging quantum computing (QC) techniques in processing large volumes of RS data. The proposed Quanv4EO framework introduces a quanvolution method for (pre)processing multidimensional EO data. Its effectiveness was first demonstrated on standard image classification datasets (MNIST and FashionMNIST), achieving accuracies of 99.84% and 96.81%, respectively, with a significantly reduced model size of 42 k parameters and 16 frozen qubits. Its capabilities were then checked on EO datasets, such as EuroSAT, with a mean accuracy of 96% using balanced iterative reducing and clustering using hierarchies (BIRCHs) clustering and 93% using automated DL (AutoDL), surpassing or matching state-of-the-art (SOTA) classical nonquantum models. Applying the framework to synthetic aperture radar (SAR) data, the QSPeckleFilter demonstrates notable improvements in speckle noise reduction, achieving a peak signal-to-noise ratio (PSNR) of 21.72 and a structural similarity index measure (SSIM) of 0.81, surpassing all tested classical counterparts. The proposed results underscore the potential of quantum-enhanced approaches in RS data analysis, paving the way for more efficient and effective solutions for wide geographical area EO data exploitation.

arXiv:2407.17108IEEE Transactions on Geoscience and Remote SensingJan 1, 202519 citations