Abstract For performing regression tasks involved in various physics problems, enhancing the precision or equivalently reducing the uncertainty of regression results is undoubtedly one of the central goals. Here, somewhat surprisingly, the unfavorable regression uncertainty in performing the regression tasks of inverse statistical problems is found to contain hidden information concerning the phase transitions of the system under consideration. By utilizing this hidden information, a new unsupervised machine learning approach was developed in this work for automated detection of phases of matter, dubbed learning from regression uncertainty. This is achieved by revealing an intrinsic connection between regression uncertainty and response properties of the system, thus making the outputs of this machine learning approach directly interpretable via conventional notions of physics. It is demonstrated by identifying the critical points of the ferromagnetic Ising model and the three-state clock model, and revealing the existence of the intermediate phase in the six-state and seven-state clock models. Comparing to the widely-used classification-based approaches developed so far, although successful, their recognized classes of patterns are essentially abstract, which hinders their straightforward relation to conventional notions of physics. These challenges persist even when one employs the state-of-the-art deep neural networks (NNs) that excel at classification tasks. In contrast, with the core working horse being an NN performing regression tasks, our new approach is not only practically more efficient, but also paves the way towards intriguing possibilities for unveiling new physics via machine learning in a physically interpretable manner.
Abstract For performing regression tasks involved in various physics problems, enhancing the precision or equivalently reducing the uncertainty of regression results is undoubtedly one of the central goals. Here, somewhat surprisingly, the unfavorable regression uncertainty in performing the regression tasks of inverse statistical problems is found to contain hidden information concerning the phase transitions of the system under consideration. By utilizing this hidden information, a new unsupervised machine learning approach was developed in this work for automated detection of phases of matter, dubbed learning from regression uncertainty. This is achieved by revealing an intrinsic connection between regression uncertainty and response properties of the system, thus making the outputs of this machine learning approach directly interpretable via conventional notions of physics. It is demonstrated by identifying the critical points of the ferromagnetic Ising model and the three-state clock model, and revealing the existence of the intermediate phase in the six-state and seven-state clock models. Comparing to the widely-used classification-based approaches developed so far, although successful, their recognized classes of patterns are essentially abstract, which hinders their straightforward relation to conventional notions of physics. These challenges persist even when one employs the state-of-the-art deep neural networks (NNs) that excel at classification tasks. In contrast, with the core working horse being an NN performing regression tasks, our new approach is not only practically more efficient, but also paves the way towards intriguing possibilities for unveiling new physics via machine learning in a physically interpretable manner.
We develop the neural network based “learning from regression uncertainty” approach for the automatic detection of phases of matter in nonequilibrium active systems. Taking the flocking phase transition of self-propelled active particles described by the Vicsek model for example, we find that after training a neural network for solving the inverse statistical problem, i.e. for performing the regression task of reconstructing the noise level from given samples of such a nonequilibrium many-body complex system’s steady state configurations, the uncertainty of regression results obtained by the well-trained network can actually be utilized to reveal possible phase transitions in the system under study. The noise level dependence of regression uncertainty is assumed to be in a non-trivial M-shape, and its valley appears at the critical point of the flocking phase transition. By directly comparing this regression-based approach with the widely-used classification-based “learning by confusion” and “learning with blanking” approaches, we show that our approach has practical effectiveness, efficiency, good generality for various physical systems across interdisciplinary fields, and a greater possibility of being interpretable via conventional notions of physics. These approaches can complement each other to serve as a promising generic toolbox for investigating rich critical phenomena and providing data-driven evidence on the existence of various phase transitions, especially for those complex scenarios associated with first-order phase transitions or nonequilibrium active systems where traditional research methods in physics could face difficulties.
The classification of phase transitions is a central and challenging task in condensed matter physics. Typically, it relies on the identification of order parameters and the analysis of singularities in the free energy and its derivatives. Here, we propose an alternative framework to identify quantum phase transitions, employing both unsupervised and supervised machine learning techniques. Using the axial next-nearest-neighbor Ising (ANNNI) model as a benchmark, we show how unsupervised learning can detect three phases (ferromagnetic, paramagnetic, and a cluster of the antiphase with the floating phase) as well as two distinct regions within the paramagnetic phase. Employing supervised learning we show that transfer learning becomes possible: a machine trained only with nearest-neighbor interactions can learn to identify a new type of phase occurring when next-nearest-neighbor interactions are introduced. All our results rely on few- and low-dimensional input data (up to twelve lattice sites), thus providing a computational friendly and general framework for the study of phase transitions in many-body systems.
Identifying phase transitions and classifying phases of matter is central to understanding the properties and behavior of a broad range of material systems. In recent years, machine-learning (ML) techniques have been successfully applied to perform such tasks in a data-driven manner. However, the success of this approach notwithstanding, we still lack a clear understanding of ML methods for detecting phase transitions, particularly of those that utilize neural networks (NNs). In this work, we derive analytical expressions for the optimal output of three widely used NN-based methods for detecting phase transitions. These optimal predictions correspond to the results obtained in the limit of high model capacity. Therefore, in practice they can, for example, be recovered using sufficiently large, well-trained NNs. The inner workings of the considered methods are revealed through the explicit dependence of the optimal output on the input data. By evaluating the analytical expressions, we can identify phase transitions directly from experimentally accessible data without training NNs, which makes this procedure favorable in terms of computation time. Our theoretical results are supported by extensive numerical simulations covering, e.g., topological, quantum, and many-body localization phase transitions. We expect similar analyses to provide a deeper understanding of other classification tasks in condensed matter physics.
The identification and characterization of phase transitions is one of the oldest and most central problems in condensed matter physics, traditionally approached through order parameters, free-energy expansions, renormalization-group analysis, and direct numerical simulation. Over the past decade, machine learning (ML) has emerged as a complementary and, in some regimes, transformative methodology for this task. Supervised classifiers can learn to distinguish phases directly from raw configurations without an a priori order parameter; unsupervised and self-supervised techniques such as principal component analysis, autoencoders, and learning-by-confusion can locate transition points with minimal or no labeled data; and generative and variational architectures, including neural-network quantum states, now approximate ground-state wavefunctions of strongly correlated systems well beyond the reach of exact diagonalization. This paper reviews the theoretical foundations of phase transitions relevant to machine-learning applications, surveys the principal families of algorithms used to detect and classify phases, and examines their application across classical spin systems, percolation, topological and quantum phases, strongly correlated electron systems, and experimentally measured spectroscopic data. Representative case studies are discussed, including convolutional and graph-neural-network classifiers of lattice configurations, explainable-ML detection of thermodynamic transitions in photoemission spectra, and deep-learning-guided discovery of high-temperature superconductors. The review closes with a critical discussion of persistent challenges interpretability, data scarcity in correlated-electron experiments, generalization across Hamiltonians, and the reliability of learned order parameters near criticality and outlines directions for future research, including physics-informed architectures, uncertainty quantification, and closed-loop integration with autonomous experimentation.
Distinguishing between different phases of matter and detecting phase transitions are some of the most central tasks in many-body physics. Traditionally, these tasks are accomplished by searching for a small set of low-dimensional quantities capturing the macroscopic properties of each phase of the system, so-called order parameters. Because of the large state space underlying many-body systems, success generally requires a great deal of human intuition and understanding. In particular, it can be challenging to define an appropriate order parameter if the symmetry breaking pattern is unknown or the phase is of topological nature and thus exhibits nonlocal order. In this chapter, we explore the use of machine learning to automate the task of classifying phases of matter and detecting phase transitions. We discuss the application of various machine learning techniques, ranging from clustering to supervised learning and anomaly detection, to different physical systems, including the prototypical Ising model that features a symmetry-breaking phase transition and the Ising gauge theory which hosts a topological phase of matter.
Abstract Known for their ability to identify hidden patterns in data, artificial neural networks are among the most powerful machine learning tools. Most notably, neural networks have played a central role in identifying states of matter and phase transitions across condensed matter physics. To date, most studies have focused on systems where different phases of matter and their phase transitions are known, and thus the performance of neural networks is well controlled. While neural networks present an exciting new tool to detect new phases of matter, here we demonstrate that when the training sets are poisoned (i.e. poor training data or mislabeled data) it is easy for neural networks to make misleading predictions.