Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1704.05848 · Physical review. B./Physical review. B

Kernel methods for interpretable machine learning of order parameters

Pedro Ponte, Roger G. Melko

Published Nov 27, 2017• 136 citations
arXivHTMLPDF

Abstract

Machine learning is capable of discriminating phases of matter, and finding associated phase transitions, directly from large data sets of raw state configurations. In the context of condensed matter physics, most progress in the field of supervised learning has come from employing neural networks as classifiers. Although very powerful, such algorithms suffer from a lack of interpretability, which is usually desired in scientific applications in order to associate learned features with physical phenomena. In this paper, we explore support vector machines (SVMs), which are a class of supervised kernel methods that provide interpretable decision functions. We find that SVMs can learn the mathematical form of physical discriminators, such as order parameters and Hamiltonian constraints, for a set of two-dimensional spin models: the ferromagnetic Ising model, a conserved-order-parameter Ising model, and the Ising gauge theory. The ability of SVMs to provide interpretable classification highlights their potential for automating feature detection in both synthetic and experimental data sets for condensed matter and other many-body systems.

DOI
10.1103/physrevb.96.205146

Related papers

Learning multiple order parameters with interpretable machines

Ke Liu, Jonas Greitemann, Lode Pollet

Machine-learning techniques are evolving into a subsidiary tool for studying phase transitions in many-body systems. However, most studies are tied to situations involving only one phase transition and one order parameter. Systems that accommodate multiple phases of coexisting and competing orders, which are common in condensed matter physics, remain largely unexplored from a machine-learning perspective. In this paper, we investigate multiclassification of phases using support vector machines (SVMs) and apply a recently introduced kernel method for detecting hidden spin and orbital orders to learn multiple phases and their analytical order parameters. Our focus is on multipolar orders and their tensorial order parameters whose identification is difficult with traditional methods. The importance of interpretability is emphasized for physical applications of multiclassification. Furthermore, we discuss an intrinsic parameter of SVM, the bias, which allows for a special interpretation in the classification of phases, and its utility in diagnosing the existence of phase transitions. We show that it can be exploited as an efficient way to explore the topology of unknown phase diagrams where the supervision is entirely delegated to the machine.

arXiv:1810.05538•Physical review. B./Physical review. B•Mar 8, 2019•61 citations

Phase classification

Anna Dawid, Julian Arnold, Borja Requena +26 more

Distinguishing between different phases of matter and detecting phase transitions are some of the most central tasks in many-body physics. Traditionally, these tasks are accomplished by searching for a small set of low-dimensional quantities capturing the macroscopic properties of each phase of the system, so-called order parameters. Because of the large state space underlying many-body systems, success generally requires a great deal of human intuition and understanding. In particular, it can be challenging to define an appropriate order parameter if the symmetry breaking pattern is unknown or the phase is of topological nature and thus exhibits nonlocal order. In this chapter, we explore the use of machine learning to automate the task of classifying phases of matter and detecting phase transitions. We discuss the application of various machine learning techniques, ranging from clustering to supervised learning and anomaly detection, to different physical systems, including the prototypical Ising model that features a symmetry-breaking phase transition and the Ising gauge theory which hosts a topological phase of matter.

Cambridge University Press eBooks•Jun 12, 2025•0 citations

Machine Learning-Driven Prediction of Phase Transitions in Advanced Condensed Matter Systems: A Review of Methods, Applications, and Open Challenges

Amit Ghas et al.

The identification and characterization of phase transitions is one of the oldest and most central problems in condensed matter physics, traditionally approached through order parameters, free-energy expansions, renormalization-group analysis, and direct numerical simulation. Over the past decade, machine learning (ML) has emerged as a complementary and, in some regimes, transformative methodology for this task. Supervised classifiers can learn to distinguish phases directly from raw configurations without an a priori order parameter; unsupervised and self-supervised techniques such as principal component analysis, autoencoders, and learning-by-confusion can locate transition points with minimal or no labeled data; and generative and variational architectures, including neural-network quantum states, now approximate ground-state wavefunctions of strongly correlated systems well beyond the reach of exact diagonalization. This paper reviews the theoretical foundations of phase transitions relevant to machine-learning applications, surveys the principal families of algorithms used to detect and classify phases, and examines their application across classical spin systems, percolation, topological and quantum phases, strongly correlated electron systems, and experimentally measured spectroscopic data. Representative case studies are discussed, including convolutional and graph-neural-network classifiers of lattice configurations, explainable-ML detection of thermodynamic transitions in photoemission spectra, and deep-learning-guided discovery of high-temperature superconductors. The review closes with a critical discussion of persistent challenges interpretability, data scarcity in correlated-electron experiments, generalization across Hamiltonians, and the reliability of learned order parameters near criticality and outlines directions for future research, including physics-informed architectures, uncertainty quantification, and closed-loop integration with autonomous experimentation.

The International Journal of Multiphysics•Dec 31, 2021•0 citations

A classification technique for condensed matter phases using a combination of PCA and SVM

Waleed K. Badawi, Z. M. Osman, Maha Sharkas +1 more

In quantum mechanical systems with exponentially large Hilbert space, the need to represent and identify states of quantum many-body system with few variables is of significant importance. The representation and identification of the states are based on the spin configurations of the ferromagnetic Ising model without knowledge of the respective Hamiltonian. The state identification process is of high importance in quantum technology applications and testing such as D-wave machine comparison to classical optimization algorithms using large number of qubits. This paper proposes a new method to classify phases and phase transitions in condensed matter systems, which can further be used in quantum technologies to identify the state of qubits. The proposed method is based on the combination of Principle component analysis (PCA) and support vector machine (SVM). The simulation results of the proposed method show that the trained model is able to identify the phase and phase transition with high accuracy in different Ising spin topologies with a variety of lattice sizes, while reducing the dimensionality of the feature space compared to existing optimization methods.

Photonics & Electromagnetics Research Symposium - Spring (PIERS-Spring)•May 1, 2017•6 citations

Machine learning phases in statistical physics

Qi Chen

Conventionally, the study of phases in statistical mechan- ics is performed with the help of random sampling tools. Among the most powerful are Monte Carlo simulations consisting of a stochastic importance sampling over state space and evaluation of estimators for physical quantities. The ability of modern machine learning techniques to classify, identify, or in- terpret massive data sets provides a complementary paradigm to the above approach to analyze the exponentially large number of states in statistical physics. In this report, it is demonstrated by application on Ising-type models that deep learning has potential wide applications in solving many-body statis- tical physics problems. In application of supervised learning, we showed that the feed-forward neural network can identify phases and phase transitions in the ferromagnetic Ising model and the convolutional neural network (CNN) is extremely powerful in classifying T = 0 and T = ∞ phases in the Ising gauge model; In application of unsupervised learning, we illustrated that a deep auto-encoder constructed by stacked restricted Boltzmann machines (RBM)\nis closely related to the renormalization group (RG) method well understood in modern physics and our reconstruction of Ising spin configurations in the ferromagnetic Ising model is similar to the hand-written digits reconstruction.

•Jan 1, 2017•0 citations

Machine learning of explicit order parameters: From the Ising model to SU(2) lattice gauge theory

Sebastian J. Wetzel, Manuel Scherzer

We present a solution to the problem of interpreting neural networks classifying phases of matter. We devise a procedure for reconstructing the decision function of an artificial neural network as a simple function of the input, provided the decision function is sufficiently symmetric. In this case one can easily deduce the quantity by which the neural network classifies the input. The method is applied to the Ising model and SU(2) lattice gauge theory. In both systems we deduce the explicit expressions of the order parameters from the decision functions of the neural networks. We assume no prior knowledge about the Hamiltonian or the order parameters except Monte Carlo--sampled configurations.

arXiv:1705.05582•Physical review. B./Physical review. B•Nov 8, 2017•137 citations
Machine learning is capable of discriminating phases of matter, and finding associated phase transitions, directly from large data sets of raw state configurations. In the context of condensed matter physics, most progress in the field of supervised learning has come from employing neural networks as classifiers. Although very powerful, such algorithms suffer from a lack of interpretability, which is usually desired in scientific applications in order to associate learned features with physical phenomena. In this paper, we explore support vector machines (SVMs), which are a class of supervised kernel methods that provide interpretable decision functions. We find that SVMs can learn the mathematical form of physical discriminators, such as order parameters and Hamiltonian constraints, for a set of two-dimensional spin models: the ferromagnetic Ising model, a conserved-order-parameter Ising model, and the Ising gauge theory. The ability of SVMs to provide interpretable classification highlights their potential for automating feature detection in both synthetic and experimental data sets for condensed matter and other many-body systems.
Machine-learning techniques are evolving into a subsidiary tool for studying phase transitions in many-body systems. However, most studies are tied to situations involving only one phase transition and one order parameter. Systems that accommodate multiple phases of coexisting and competing orders, which are common in condensed matter physics, remain largely unexplored from a machine-learning perspective. In this paper, we investigate multiclassification of phases using support vector machines (SVMs) and apply a recently introduced kernel method for detecting hidden spin and orbital orders to learn multiple phases and their analytical order parameters. Our focus is on multipolar orders and their tensorial order parameters whose identification is difficult with traditional methods. The importance of interpretability is emphasized for physical applications of multiclassification. Furthermore, we discuss an intrinsic parameter of SVM, the bias, which allows for a special interpretation in the classification of phases, and its utility in diagnosing the existence of phase transitions. We show that it can be exploited as an efficient way to explore the topology of unknown phase diagrams where the supervision is entirely delegated to the machine.
Distinguishing between different phases of matter and detecting phase transitions are some of the most central tasks in many-body physics. Traditionally, these tasks are accomplished by searching for a small set of low-dimensional quantities capturing the macroscopic properties of each phase of the system, so-called order parameters. Because of the large state space underlying many-body systems, success generally requires a great deal of human intuition and understanding. In particular, it can be challenging to define an appropriate order parameter if the symmetry breaking pattern is unknown or the phase is of topological nature and thus exhibits nonlocal order. In this chapter, we explore the use of machine learning to automate the task of classifying phases of matter and detecting phase transitions. We discuss the application of various machine learning techniques, ranging from clustering to supervised learning and anomaly detection, to different physical systems, including the prototypical Ising model that features a symmetry-breaking phase transition and the Ising gauge theory which hosts a topological phase of matter.
The identification and characterization of phase transitions is one of the oldest and most central problems in condensed matter physics, traditionally approached through order parameters, free-energy expansions, renormalization-group analysis, and direct numerical simulation. Over the past decade, machine learning (ML) has emerged as a complementary and, in some regimes, transformative methodology for this task. Supervised classifiers can learn to distinguish phases directly from raw configurations without an a priori order parameter; unsupervised and self-supervised techniques such as principal component analysis, autoencoders, and learning-by-confusion can locate transition points with minimal or no labeled data; and generative and variational architectures, including neural-network quantum states, now approximate ground-state wavefunctions of strongly correlated systems well beyond the reach of exact diagonalization. This paper reviews the theoretical foundations of phase transitions relevant to machine-learning applications, surveys the principal families of algorithms used to detect and classify phases, and examines their application across classical spin systems, percolation, topological and quantum phases, strongly correlated electron systems, and experimentally measured spectroscopic data. Representative case studies are discussed, including convolutional and graph-neural-network classifiers of lattice configurations, explainable-ML detection of thermodynamic transitions in photoemission spectra, and deep-learning-guided discovery of high-temperature superconductors. The review closes with a critical discussion of persistent challenges interpretability, data scarcity in correlated-electron experiments, generalization across Hamiltonians, and the reliability of learned order parameters near criticality and outlines directions for future research, including physics-informed architectures, uncertainty quantification, and closed-loop integration with autonomous experimentation.
In quantum mechanical systems with exponentially large Hilbert space, the need to represent and identify states of quantum many-body system with few variables is of significant importance. The representation and identification of the states are based on the spin configurations of the ferromagnetic Ising model without knowledge of the respective Hamiltonian. The state identification process is of high importance in quantum technology applications and testing such as D-wave machine comparison to classical optimization algorithms using large number of qubits. This paper proposes a new method to classify phases and phase transitions in condensed matter systems, which can further be used in quantum technologies to identify the state of qubits. The proposed method is based on the combination of Principle component analysis (PCA) and support vector machine (SVM). The simulation results of the proposed method show that the trained model is able to identify the phase and phase transition with high accuracy in different Ising spin topologies with a variety of lattice sizes, while reducing the dimensionality of the feature space compared to existing optimization methods.
Conventionally, the study of phases in statistical mechan- ics is performed with the help of random sampling tools. Among the most powerful are Monte Carlo simulations consisting of a stochastic importance sampling over state space and evaluation of estimators for physical quantities. The ability of modern machine learning techniques to classify, identify, or in- terpret massive data sets provides a complementary paradigm to the above approach to analyze the exponentially large number of states in statistical physics. In this report, it is demonstrated by application on Ising-type models that deep learning has potential wide applications in solving many-body statis- tical physics problems. In application of supervised learning, we showed that the feed-forward neural network can identify phases and phase transitions in the ferromagnetic Ising model and the convolutional neural network (CNN) is extremely powerful in classifying T = 0 and T = ∞ phases in the Ising gauge model; In application of unsupervised learning, we illustrated that a deep auto-encoder constructed by stacked restricted Boltzmann machines (RBM)\nis closely related to the renormalization group (RG) method well understood in modern physics and our reconstruction of Ising spin configurations in the ferromagnetic Ising model is similar to the hand-written digits reconstruction.
We present a solution to the problem of interpreting neural networks classifying phases of matter. We devise a procedure for reconstructing the decision function of an artificial neural network as a simple function of the input, provided the decision function is sufficiently symmetric. In this case one can easily deduce the quantity by which the neural network classifies the input. The method is applied to the Ising model and SU(2) lattice gauge theory. In both systems we deduce the explicit expressions of the order parameters from the decision functions of the neural networks. We assume no prior knowledge about the Hamiltonian or the order parameters except Monte Carlo--sampled configurations.