Quantum-inspired models have demonstrated superior performance in many downstream language tasks, such as question answering and sentiment analysis. However, recent models have primarily focused on embedding and measurement operations, overlooking the significance of the quantum evolution process. In this work, we present a novel quantum-inspired neural network, LME-QNN, which integrates the Lindblad Master Equation (LME) to model the evolution process. LME-QNN is able to capture rich correlations among words, ensuring a potent representation of the sentence. We conduct comprehensive experiments on six sentiment analysis datasets. Compared to the traditional models, including TextCNN, GRU, ELMo, BERT and RoBERTa, and quantum-inspired models, such as ComplexCNN and ComplexQNN, the proposed method demonstrates superior performance in accuracy and F1-score on six commonly used datasets for sentiment analysis. Additional ablation tests verify the effectiveness of LME.
Quantum-inspired models have demonstrated superior performance in many downstream language tasks, such as question answering and sentiment analysis. However, recent models have primarily focused on embedding and measurement operations, overlooking the significance of the quantum evolution process. In this work, we present a novel quantum-inspired neural network, LME-QNN, which integrates the Lindblad Master Equation (LME) to model the evolution process. LME-QNN is able to capture rich correlations among words, ensuring a potent representation of the sentence. We conduct comprehensive experiments on six sentiment analysis datasets. Compared to the traditional models, including TextCNN, GRU, ELMo, BERT and RoBERTa, and quantum-inspired models, such as ComplexCNN and ComplexQNN, the proposed method demonstrates superior performance in accuracy and F1-score on six commonly used datasets for sentiment analysis. Additional ablation tests verify the effectiveness of LME.
Most of the existing quantum-inspired models are based on amplitude-phase embedding to model natural language, which maps words into Hilbert space. In quantum-computing theory, the vectors corresponding to quantum states are all complex values, so there is a gap between these two areas. Presently, complex-valued neural networks have been studied, but their practical applications are few, let alone in the downstream tasks of natural language processing such as sentiment analysis and language modeling. In fact, the complex-valued neural network can use the imaginary part information to embed hidden information and can express more complex information, which is suitable for modeling complex natural language. Meanwhile, quantum-inspired models are defined in Hilbert space, which is also a complex space. So it is natural to construct quantum-inspired models based on complex-valued neural networks. Therefore, we propose a new quantum-inspired model for NLP, ComplexQNN, which contains a complex-valued embedding layer, a quantum encoding layer, and a measurement layer. The modules of ComplexQNN are fully based on complex-valued neural networks. It is more in line with quantum-computing theory and easier to transfer to quantum computers in the future to achieve exponential acceleration. We conducted experiments on six sentiment-classification datasets comparing with five classical models (TextCNN, GRU, ELMo, BERT, and RoBERTa). The results show that our model has improved by 10% in accuracy metric compared with TextCNN and GRU, and has competitive experimental results with ELMo, BERT, and RoBERTa.
Quantum-inspired models have shown enhanced capabilities in various language tasks, including question answering and sentiment analysis. However, current complex-valued-based models primarily focus on sentence embedding, overlooking the significance of the quantum evolution process and the extra time cost incurred by complex expressions. In this work, we present a novel quantum-inspired neural network, SSS-QNN, which integrates the Stochastic Liouville-von Neumann Equation (SLE) to simulate the evolution process and the complex-valued simple recurrent unit (SRU) to reduce the time cost, offering the model physical meaning, thus enhancing the interpretability. We conduct comprehensive experiments on both sentence-level and document-level sentiment classification datasets. Compared to traditional models, large language models, and quantum-inspired models, SSS-QNN demonstrates competitive performance in accuracy and time cost. Additional ablation tests verify the effectiveness of the proposed modules.
This paper presents SentiQNN (Sentiment Quantum Neural Network), a novel quantum-inspired neural network architecture specifically designed for sentiment analysis tasks in natural language processing. SentiQNN leverages quantum computing principles including superposition, entanglement, and quantum measurement to enhance traditional neural network capabilities for text classification. The model incorporates complex-valued embeddings, quantum mixture operations, and multi-task learning with sentiment lexicon integration to achieve superior performance in sentiment classification tasks. Through extensive experimentation across multiple benchmark datasets, SentiQNN demonstrates state-of-the-art performance with 88.11% accuracy, outperforming traditional classical approaches by 3-7%. The architecture introduces innovative quantum state preparation layers, quantum circuit operations, and quantum measurement mechanisms specifically optimized for natural language understanding. Our comprehensive evaluation reveals that quantum-inspired approaches can significantly enhance sentiment analysis performance while maintaining computational efficiency. The findings contribute to the emerging field of quantum machine learning and provide a foundation for future research in quantum-enhanced natural language processing systems.
Quantum computing has emerged as a breakthrough technology for sentiment and emotion analysis, providing computational efficiency and interpretability benefits. This paper compares three quantum-inspired methods: fully complex-valued neural networks, multimodal sentiment analysis models, and quantum affective computing. This paper compares three quantum-inspired methods: fully complex-valued neural networks, multimodal sentiment analysis models, and quantum affective computing models. The research uses six benchmark sentiment datasets (CR, MPQA, MR, SST-2, SUBJ, and SST-5) to compare the performance of the methods. The approach involves representing textual and multimodal data as complex quantum states, using quantum-inspired feature representations, and using quantum measurement methods for classification. The results show that the Complex Quantum Neural Network (QNN) performs better than baseline models such as BERT and RoBERTa, with the best F1-scores on all datasets. Specifically, it has an F1-score of 86 on CR, 86 on MPQA, 90 on MR, 88 on SST-2, 97 on SUBJ, and 53 on SST-5, outperforming baseline deep learning methods. These results show the potential of quantum computing to revolutionize sentiment analysis, providing more efficient and interpretable models with better contextual understanding and scalability.
Sentiment analysis aims to study, analyse and identify the sentiment polarity contained in subjective documents. In the realm of natural language processing (NLP), the study of sentiment analysis and its subtask research is a hot topic, which has very important significance. The existing sentiment analysis methods based on sentiment lexicon and machine learning take into account contextual semantic information, but these methods still lack the ability to utilize context information, so they cannot effectively encode context information. Inspired by the concept of density matrix in quantum mechanics, we propose a sentiment analysis method, named Complex-valued Quantum-enhanced Long Short-term Memory Neural Network (CQLSTM). It leverages complex-valued embedding to incorporate more semantic information and utilizes the Complex-valued Quantum-enhanced Long Short-term Memory Neural Network for feature extraction. Specifically, a complex-valued neural network based on density matrix is used to capture interactions between words (i.e., the correlation between words). Additionally, the Complex-valued Quantum-enhanced Long Short-term Memory Neural Network, which is inspired by the quantum measurement theory and quantum long short-term memory neural network, is developed to learn interactions between sentences (i.e., contextual semantic information). This approach effectively encodes semantic dependencies, which reflects the dispersion of words in the embedded space of sentences and comprehensively captures interactive information and long-term dependencies among the emotional features between words. Comparative experiments were performed on four sentiment analysis datasets using five traditional models, showcasing the effectiveness of the CQLSTM model.
Natural language processing (NLP) may face the inexplicable "black-box" problem of parameters and unreasonable modeling for lack of embedding of some characteristics of natural language, while the quantum-inspired models based on quantum theory may provide a potential solution. However, the essential prior knowledge and pretrained text features are often ignored at the early stage of the development of quantum-inspired models. To attacking the above challenges, a pretrained quantum-inspired deep neural network is proposed in this work, which is constructed based on quantum theory for carrying out strong performance and great interpretability in related NLP fields. Concretely, a quantum-inspired pretrained feature embedding (QPFE) method is first developed to model superposition states for words to embed more textual features. Then, a QPFE-ERNIE model is designed by merging the semantic features learned from the prevalent pretrained model ERNIE, which is verified with two NLP downstream tasks: 1) sentiment classification and 2) word sense disambiguation (WSD). In addition, schematic quantum circuit diagrams are provided, which has potential impetus for the future realization of quantum NLP with quantum device. Finally, the experiment results demonstrate QPFE-ERNIE is significantly better for sentiment classification than gated recurrent unit (GRU), BiLSTM, and TextCNN on five datasets in all metrics and achieves better results than ERNIE in accuracy, F1-score, and precision on two datasets (CR and SST), and it also has advantage for WSD over the classical models, including BERT (improves F1-score by 5.2 on average) and ERNIE (improves F1-score by 4.2 on average) and improves the F1-score by 8.7 on average compared with a previous quantum-inspired model QWSD. QPFE-ERNIE provides a novel pretrained quantum-inspired model for solving NLP problems, and it lays a foundation for exploring more quantum-inspired models in the future.