Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Proceedings of the AAAI Conference on Artificial Intelligence

Exploring Relevance Judgement Inspired by Quantum Weak Measurement

Tianshu Wang, Yuexian Hou, Panpan Wang, Xiaolei Niu

Published Apr 29, 2018• 3 citations
Publisher

Abstract

Quantum Theory (QT) has been applied in a number of fields outside physics, e.g. Information Retrieval (IR). A series of pioneering works have verified the necessity to employ QT in IR user models. In this paper, we explore the process of relevance judgement from a novel perspective of the two state vector quantum weak measurement (WM) by considering context information in time domain. Experiments are carried out to verify our arguments.

DOI
10.1609/aaai.v32i1.12167

Related papers

Investigation and Modelling of Quantum-like User Cognitive Behaviour in Information Access and Retrieval

Sagar Uprety

This thesis is fundamentally about using conceptual and mathematical constructs from the area of Quantum Theory in Information Retrieval (IR). The need and motivation for this is two-fold – firstly, it has been increasingly shown in decision sciences that human decision-making does not always conform to the norms of traditional probability and logic framework. The quantum framework offers a generalised probability and logic framework which can model decisions or judgements under dynamic context and ambiguity. Secondly, there is a need in IR for theories and models which improve our understanding of user behaviour. Hence it is worth exploring the combination of the quantum framework and IR, especially focused on the user aspects of IR. The overarching research question is whether there is evidence of user behaviour in IR scenarios which warrants the need for a quantum based approach by way of showing the limitations of the traditional (classical) approach. The methodology involves analysing data to detect quantum-like phenomena of interference, contextuality, incompatibility, etc. from two common data sources in IR–standard datasets like query log data, and through crowdsourced user studies designed similar to some quantum physics or cognitive science experiments. While the evidence of quantum-like phenomena from standard datasets is not convincing, we find that some of the user studies reveal the quantum-like structure of document judgements. One of the key findings which has implication for IR is the dynamic interactions between the different dimensions of relevance. For example, a user’s judgement of reliability of a document depends significantly on whether they found it understandable or not. Thus, the consideration of one relevance dimension or document feature can provide a context for another dimension, contrary to the current IR models which consider these features to be independent of each other and an objective property of the document. The quantum framework has been especially designed to deal with such scenarios where properties of systems or objects do not exist independent of measurement context. The thesis concludes with suggestions about incorporating quantum mathematical constructs into state-of-art IR algorithms.

•Jan 1, 2021•0 citations

Modelling Dynamic Interactions Between Relevance Dimensions

Sagar Uprety, Shahram Dehdashti, Lauren Fell +2 more

Relevance is an underlying concept in the field of Information Science and Retrieval. It is a cognitive notion consisting of several different criteria or dimensions. Theoretical models of relevance allude to interdependence between these dimensions, where their interaction and fusion leads to the final inference of relevance. We study the interaction between the relevance dimensions using the mathematical framework of Quantum Theory. It is considered a generalised framework to model decision making under uncertainty, involving multiple perspectives and influenced by context. Specifically, we conduct a user study by constructing the cognitive analogue of a famous experiment in Quantum Physics. The data is used to construct a complex-valued vector space model of the user's cognitive state, which is used to explain incompatibility and interference between relevance dimensions. The implications of our findings to inform the design of Information Retrieval systems are also discussed.

arXiv:1907.10943•ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR)•Sep 26, 2019•4 citations

Exploration of Quantum Interference in Document Relevance Judgement Discrepancy

Benyou Wang, Peng Zhang, Jingfei Li +3 more

Quantum theory has been applied in a number of fields outside physics, e.g., cognitive science and information retrieval (IR). Recently, it has been shown that quantum theory can subsume various key IR models into a single mathematical formalism of Hilbert vector spaces. While a series of quantum-inspired IR models has been proposed, limited effort has been devoted to verify the existence of the quantum-like phenomenon in real users’ information retrieval processes, from a real user study perspective. In this paper, we aim to explore and model the quantum interference in users’ relevance judgement about documents, caused by the presentation order of documents. A user study in the context of IR tasks have been carried out. The existence of the quantum interference is tested by the violation of the law of total probability and the validity of the order effect. Our main findings are: (1) there is an apparent judging discrepancy across different users and document presentation orders, and empirical data have violated the law of total probability; (2) most search trials recorded in the user study show the existence of the order effect, and the incompatible decision perspectives in the quantum question (QQ) model are valid in some trials. We further explain the judgement discrepancy in more depth, in terms of four effects (comparison, unfamiliarity, attraction and repulsion) and also analyse the dynamics of document relevance judgement in terms of the evolution of the information need subspace.

Entropy•Apr 18, 2016•43 citations

Explanation of Relevance Judgement Discrepancy with Quantum Interference

Jun Wang, Dawei Song, Peng Zhang +2 more

A key concept in many Information Retrieval (IR) tasks, e.g. document indexing, query language modelling, aspect and diversity retrieval, is the relevance measurement of topics, i.e. to what extent an information object (e.g. a document or a query) is about the topics. This paper investigates the interference of relevance measurement of a topic caused by another topic. For example, consider that two user groups are required to judge whether a topic q is relevant to a document d, and q is presented together with another topic (referred to as a companion topic). If different companion topics are used for different groups, interestingly different relevance probabilities of q given d can be reached. In this paper, we present empirical results showing that the relevance of a topic to a document is greatly affected by the companion topic’s relevance to the same document, and the extent of the impact differs with respect to different companion topics. We further analyse the phenomenon from classical and quantum-like interference perspectives, and connect the phenomenon to nonreality and contextuality in quantum mechanics. We demonstrate that quantum like model fits in the empirical data, could be potentially used for predicting the relevance when interference exists.

National Conference on Artificial Intelligence•Nov 1, 2010•3 citations

Explanation of relevance judgement discrepancy with quantum interference

Peter Bruza, Jun Wang, Dawei Song +2 more

A key concept in many Information Retrieval (IR) tasks, e.g. document indexing, query language modelling, aspect and diversity retrieval, is the relevance measurement of topics, i.e. to what extent an information object (e.g. a document or a query) is about the topics. This paper investigates the interference of relevance measurement of a topic caused by another topic. For example, consider that two user groups are required to judge whether a topic q is relevant to a document d, and q is presented together with another topic (referred to as a companion topic). If different companion topics are used for different groups, interestingly different relevance probabilities of q given d can be reached. In this paper, we present empirical results showing that the relevance of a topic to a document is greatly affected by the companion topic’s relevance to the same document, and the extent of the impact differs with respect to different companion topics. We further analyse the phenomenon from classical and quantum-like interference perspectives, and connect the phenomenon to nonreality and contextuality in quantum mechanics. We demonstrate that quantum like model fits in the empirical data, could be potentially used for predicting the relevance when interference exists.

Science & Engineering Faculty•Jan 1, 2010•0 citations

How quantum theory is developing the field of Information Retrieval

Dawei Song, Mounia Lalmas, C. J. van Rijsbergen +13 more

This position paper provides an overview of work conducted and an outlook of future directions within the field of Information Retrieval (IR) that aims to develop novel models, methods and frameworks inspired by Quantum Theory (QT).

ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam)•Nov 1, 2010•22 citations
Quantum Theory (QT) has been applied in a number of fields outside physics, e.g. Information Retrieval (IR). A series of pioneering works have verified the necessity to employ QT in IR user models. In this paper, we explore the process of relevance judgement from a novel perspective of the two state vector quantum weak measurement (WM) by considering context information in time domain. Experiments are carried out to verify our arguments.
This thesis is fundamentally about using conceptual and mathematical constructs from the area of Quantum Theory in Information Retrieval (IR). The need and motivation for this is two-fold – firstly, it has been increasingly shown in decision sciences that human decision-making does not always conform to the norms of traditional probability and logic framework. The quantum framework offers a generalised probability and logic framework which can model decisions or judgements under dynamic context and ambiguity. Secondly, there is a need in IR for theories and models which improve our understanding of user behaviour. Hence it is worth exploring the combination of the quantum framework and IR, especially focused on the user aspects of IR. The overarching research question is whether there is evidence of user behaviour in IR scenarios which warrants the need for a quantum based approach by way of showing the limitations of the traditional (classical) approach. The methodology involves analysing data to detect quantum-like phenomena of interference, contextuality, incompatibility, etc. from two common data sources in IR–standard datasets like query log data, and through crowdsourced user studies designed similar to some quantum physics or cognitive science experiments. While the evidence of quantum-like phenomena from standard datasets is not convincing, we find that some of the user studies reveal the quantum-like structure of document judgements. One of the key findings which has implication for IR is the dynamic interactions between the different dimensions of relevance. For example, a user’s judgement of reliability of a document depends significantly on whether they found it understandable or not. Thus, the consideration of one relevance dimension or document feature can provide a context for another dimension, contrary to the current IR models which consider these features to be independent of each other and an objective property of the document. The quantum framework has been especially designed to deal with such scenarios where properties of systems or objects do not exist independent of measurement context. The thesis concludes with suggestions about incorporating quantum mathematical constructs into state-of-art IR algorithms.
Relevance is an underlying concept in the field of Information Science and Retrieval. It is a cognitive notion consisting of several different criteria or dimensions. Theoretical models of relevance allude to interdependence between these dimensions, where their interaction and fusion leads to the final inference of relevance. We study the interaction between the relevance dimensions using the mathematical framework of Quantum Theory. It is considered a generalised framework to model decision making under uncertainty, involving multiple perspectives and influenced by context. Specifically, we conduct a user study by constructing the cognitive analogue of a famous experiment in Quantum Physics. The data is used to construct a complex-valued vector space model of the user's cognitive state, which is used to explain incompatibility and interference between relevance dimensions. The implications of our findings to inform the design of Information Retrieval systems are also discussed.
Quantum theory has been applied in a number of fields outside physics, e.g., cognitive science and information retrieval (IR). Recently, it has been shown that quantum theory can subsume various key IR models into a single mathematical formalism of Hilbert vector spaces. While a series of quantum-inspired IR models has been proposed, limited effort has been devoted to verify the existence of the quantum-like phenomenon in real users’ information retrieval processes, from a real user study perspective. In this paper, we aim to explore and model the quantum interference in users’ relevance judgement about documents, caused by the presentation order of documents. A user study in the context of IR tasks have been carried out. The existence of the quantum interference is tested by the violation of the law of total probability and the validity of the order effect. Our main findings are: (1) there is an apparent judging discrepancy across different users and document presentation orders, and empirical data have violated the law of total probability; (2) most search trials recorded in the user study show the existence of the order effect, and the incompatible decision perspectives in the quantum question (QQ) model are valid in some trials. We further explain the judgement discrepancy in more depth, in terms of four effects (comparison, unfamiliarity, attraction and repulsion) and also analyse the dynamics of document relevance judgement in terms of the evolution of the information need subspace.
A key concept in many Information Retrieval (IR) tasks, e.g. document indexing, query language modelling, aspect and diversity retrieval, is the relevance measurement of topics, i.e. to what extent an information object (e.g. a document or a query) is about the topics. This paper investigates the interference of relevance measurement of a topic caused by another topic. For example, consider that two user groups are required to judge whether a topic q is relevant to a document d, and q is presented together with another topic (referred to as a companion topic). If different companion topics are used for different groups, interestingly different relevance probabilities of q given d can be reached. In this paper, we present empirical results showing that the relevance of a topic to a document is greatly affected by the companion topic’s relevance to the same document, and the extent of the impact differs with respect to different companion topics. We further analyse the phenomenon from classical and quantum-like interference perspectives, and connect the phenomenon to nonreality and contextuality in quantum mechanics. We demonstrate that quantum like model fits in the empirical data, could be potentially used for predicting the relevance when interference exists.
A key concept in many Information Retrieval (IR) tasks, e.g. document indexing, query language modelling, aspect and diversity retrieval, is the relevance measurement of topics, i.e. to what extent an information object (e.g. a document or a query) is about the topics. This paper investigates the interference of relevance measurement of a topic caused by another topic. For example, consider that two user groups are required to judge whether a topic q is relevant to a document d, and q is presented together with another topic (referred to as a companion topic). If different companion topics are used for different groups, interestingly different relevance probabilities of q given d can be reached. In this paper, we present empirical results showing that the relevance of a topic to a document is greatly affected by the companion topic’s relevance to the same document, and the extent of the impact differs with respect to different companion topics. We further analyse the phenomenon from classical and quantum-like interference perspectives, and connect the phenomenon to nonreality and contextuality in quantum mechanics. We demonstrate that quantum like model fits in the empirical data, could be potentially used for predicting the relevance when interference exists.