Human emotions play a fundamental role in social interaction and effective communication between individuals. In the healthcare context, tools based on emotion recognition are promising for therapeutic applications, especially for patients with difficulties in expressing their emotions, who are often unable to communicate the discomfort associated with treatments. This work presents a comparison between hybrid architectures composed of a Quantum Wavelet Neural Network (QWNN) and a Random Forest, using the FER2013 database for training and testing. Our best configuration, with a four-layer QWNN and Random Forest, achieved 70.77% accuracy in the training phase and 81.21% in the testing phase, even using only 34.06% of the features extracted by the QWNN (436 out of 1.280). In addition to its high performance in feature extraction, the QWNN has great potential for synergy with quantum computing due to its ability to represent information at multiple scales and frequencies simultaneously. Finally, the proposed architecture aims to integrate an emotion recognition system based on facial expressions in elderly people (with and without dementia) for personalizing therapies, paving the way for future research that explores Wavelet-based neural networks and Quantum Computing in the health area.
Human emotions play a fundamental role in social interaction and effective communication between individuals. In the healthcare context, tools based on emotion recognition are promising for therapeutic applications, especially for patients with difficulties in expressing their emotions, who are often unable to communicate the discomfort associated with treatments. This work presents a comparison between hybrid architectures composed of a Quantum Wavelet Neural Network (QWNN) and a Random Forest, using the FER2013 database for training and testing. Our best configuration, with a four-layer QWNN and Random Forest, achieved 70.77% accuracy in the training phase and 81.21% in the testing phase, even using only 34.06% of the features extracted by the QWNN (436 out of 1.280). In addition to its high performance in feature extraction, the QWNN has great potential for synergy with quantum computing due to its ability to represent information at multiple scales and frequencies simultaneously. Finally, the proposed architecture aims to integrate an emotion recognition system based on facial expressions in elderly people (with and without dementia) for personalizing therapies, paving the way for future research that explores Wavelet-based neural networks and Quantum Computing in the health area.
Abstract This study explores Quantum AI’s potential in enhancing Speech Emotion Recognition (SER) systems. Our primary objective is to evaluate the performance of quantum-inspired algorithms compared to classical machine-learning approaches in accurately identifying and classifying emotions from speech signals. We hypothesise that quantum computing techniques can improve the efficiency and accuracy of emotion recognition, particularly in handling complex, highdimensional acoustic data. We developed a hybrid quantum-classical model that combines quantum-inspired neural networks with traditional feature extraction techniques. Our approach utilises quantum circuits for data encoding and quantum variational algorithms for classification. We implemented quantum versions of support vector machines (QSVM) and quantum approximate optimisation algorithms (QAOA) for emotion classification tasks. These quantum methods were compared against a hybrid Convolutional Neural Network and Long Short Term (LSTM). The hybrid network is called a Convolutional Long Short Term network(CLSTM). The study employed a custom dataset for speech emotion recognition. We prepossessed the audio data to extract relevant acoustic features, including mel-frequency cepstral coefficients (MFCCs), pitch, and energy. In contrast, our implemented quantum-inspired model for this corpus showed lower performance, with the highest training accuracy of 30%, struggling with most emotions but performing best with ’Trust’. These varied results across different implementations suggest that while Quantum AI techniques show promise in advancing speech emotion recognition, their effectiveness may depend on the specific dataset, language, and model architecture used. Finally, the speed of a simulated quantum network is shown to outperform current methods in terms of matrix multiplication by leaps and bounds.
This Facial emotion recognition plays a pivotal role in human-computer interaction, with far-reaching implications spanning psychology, healthcare, and human computer interaction. Conventional approaches, primarily utilizing classical machine learning methods, frequently face challenges in effectively interpreting intricate facial expressions under diverse environmental circumstances. However, the burgeoning paradigm of quantum machine learning (QML) presents a transformative approach, leveraging the principles of quantum computing to potentially revolutionize the landscape of emotion detection from facial expressions. This abstract explores the convergence of quantum computing and facial emotion recognition, proposing a novel framework wherein facial features undergo encoding into quantum states, undergo processing through quantum circuits, and ultimately translate into predictions of emotional states. Within this context, quantum algorithms like variational algorithms and quantum neural networks emerge as promising avenues for both training and inference tasks, presenting unparalleled opportunities to improve the accuracy and efficiency of emotion recognition systems. Despite the immense potential offered by QML, practical implementation encounters formidable challenges, including noise, decoherence, and scalability constraints inherent in existing quantum devices. However, ongoing research endeavors persist in addressing these obstacles, driven by the promise of transforming emotion recognition systems into more nuanced and robust entities. As the integration of quantum computing principles advances, it holds the promise of facilitating deeper insights into human emotions, thereby fostering more seamless and intuitive human-computer interaction experiences. By bridging the gap between quantum computing and facial emotion recognition, this abstract underscores the transformative potential of QML in reshaping the future of emotion recognition systems, paving the way for more empathetic and responsive technological interfaces.
The purpose of this work is to analyze how new technologies can enhance clinical practice while also examining the physical traits of emotional expressiveness of face expression in a number of psychiatric illnesses. Hence, in this work, an automatic facial expression recognition system has been proposed that analyzes static, sequential, or video facial images from medical healthcare data to detect emotions in people's facial regions. The proposed method has been implemented in five steps. The first step is image preprocessing, where a facial region of interest has been segmented from the input image. The second component includes a classical deep feature representation and the quantum part that involves successive sets of quantum convolutional layers followed by random quantum variational circuits for feature learning. Here, the proposed system has attained a faster training approach using the proposed quantum convolutional neural network approach that takes [Formula: see text] time. In contrast, the classical convolutional neural network models have [Formula: see text] time. Additionally, some performance improvement techniques, such as image augmentation, fine-tuning, matrix normalization, and transfer learning methods, have been applied to the recognition system. Finally, the scores due to classical and quantum deep learning models are fused to improve the performance of the proposed method. Extensive experimentation with Karolinska-directed emotional faces (KDEF), Static Facial Expressions in the Wild (SFEW 2.0), and Facial Expression Recognition 2013 (FER-2013) benchmark databases and compared with other state-of-the-art methods that show the improvement of the proposed system.
Emotion recognition seeks to identify a person’s state by examining signals such as facial expressions, speech, physiological signals and conversational content. Yet accurate emotion recognition presents obstacles because these signals can be complex, noisy, nonlinear and heavily affected by surrounding context. This paper investigates quantum-based representations combined with machine learning techniques to enhance emotion classification. The research examines emotion sources, including facial expressions, speech, EEG signals and conversational data. It explores how quantum-inspired techniques can merge with established deep learning methods to produce representations. The design presented fuses a neural network with a four qubit ZZFeatureMap component enabling the system to learn data from both conventional and quantum derived feature spaces. Experiments examined EEG segments for each participant and the system achieved average recognition rates of seventy nine point six percent for valence and eighty one point five percent for arousal across ten repeated trials. These findings show that quantum derived features can add information when combined with conventional deep learning methods. Nevertheless because experiments used simulated circuits the results do not prove a performance advantage over conventional techniques on actual quantum computers. The study also highlights difficulties such as quantum noise, computational scalability, experimental assessment, data privacy and real world deployment.
This paper proposes hybrid quantum machine learning (QML) models for automatic emotion recognition from human speech signals. The proposed quantum support vector machine (QSVM) and hybrid quantum neural network (HQNN) models use Mel-Frequency Cepstral Coefficients (MFCC) as the features extracted from the speech data. We present a detailed analysis comparing the performance of QML models to conventional machine learning models for human speech-based emotion recognition, which is a multi-class classification problem. Our results illustrate that QSVM can achieve higher classification accuracy with a much reduced number of speech signal variables compared to traditional SVMs. Furthermore, the proposed HQNN classifier outperforms classical neural networks (NN) in terms of classification accuracy while utilizing a reduced number of training parameters. We have tested the performance of the HQNN model on a real IBM quantum computer. The results indicate that QML models provide a more effective and precise method for classification tasks involving the recognition of human emotions.
Applications in behavioural research, human-computer interaction, and mental health depend on the ability to recognize emotions. In order to improve the accuracy of emotion recognition using electroencephalography (EEG) data, this work presents a hybrid quantum deep learning technique. Conventional EEG-based emotion recognition techniques are limited by noise and high-dimensional data complexity, which make feature extraction difficult. To tackle these issues, our method combines traditional deep learning classification with quantum-enhanced feature extraction. To identify important brain wave patterns, Bandpass filtering and Welch method are used as preprocessing techniques on EEG data. Intricate inter-band interactions that are essential for determining emotional states are captured by mapping frequency band power attributes (delta, theta, alpha, and beta) to quantum representations. Entanglement and rotation gates are used in a hybrid quantum circuit to maximize the model's sensitivity to EEG patterns associated with different emotions. Promising results from evaluation on a test dataset indicate the model's potential for accurate emotion recognition. The model will be extended for real-time applications and multi-class categorization in future study, which could improve EEG-based mental health screening instruments. This method offers a promising tool for applications in adaptive human-computer systems and mental health monitoring by showcasing the possibilities of fusing traditional deep learning with quantum processing for reliable, scalable emotion recognition.