Detection of phase transitions is a critical task in statistical physics, traditionally pursued through analytic methods and direct numerical simulations. Recently, machine-learning techniques have emerged as promising tools in this context, with a particular focus on supervised and unsupervised learning methods, along with nonlearning approaches. In this paper, we study the performance of unsupervised learning in detecting phase transitions in the J_{1}-J_{2} Ising model on the square lattice. The model is chosen due to its simplicity and complexity, thus providing an understanding of the application of machine-learning techniques in both straightforward and challenging scenarios. We propose a simple method based on a direct comparison of configurations. The reconstruction error, defined as the mean-squared distance between two configurations, is used to determine the critical temperatures. The results from the comparison of configurations are contrasted with those of the configurations generated by variational autoencoders. Our findings highlight that for certain systems a simpler method can yield results comparable to more complex neural networks. This paper contributes to the broader understanding of machine-learning applications in statistical physics and introduces an efficient approach to the detection of phase transitions using machine determination techniques.
Detection of phase transitions is a critical task in statistical physics, traditionally pursued through analytic methods and direct numerical simulations. Recently, machine-learning techniques have emerged as promising tools in this context, with a particular focus on supervised and unsupervised learning methods, along with nonlearning approaches. In this paper, we study the performance of unsupervised learning in detecting phase transitions in the J_{1}-J_{2} Ising model on the square lattice. The model is chosen due to its simplicity and complexity, thus providing an understanding of the application of machine-learning techniques in both straightforward and challenging scenarios. We propose a simple method based on a direct comparison of configurations. The reconstruction error, defined as the mean-squared distance between two configurations, is used to determine the critical temperatures. The results from the comparison of configurations are contrasted with those of the configurations generated by variational autoencoders. Our findings highlight that for certain systems a simpler method can yield results comparable to more complex neural networks. This paper contributes to the broader understanding of machine-learning applications in statistical physics and introduces an efficient approach to the detection of phase transitions using machine determination techniques.
The detection of phase transitions is a fundamental challenge in condensed matter physics, traditionally addressed through analytical methods and direct numerical simulations. In recent years, machine learning techniques have emerged as powerful tools to complement these standard approaches, offering valuable insights into phase and structure determination. Additionally, they have been shown to enhance the application of traditional methods. In this work, we review recent advancements in this area, with a focus on our contributions to phase and structure determination using supervised and unsupervised learning methods in several systems: (a) 2D site percolation, (b) the 3D Anderson model of localization, (c) the 2D J1-J2 Ising model, and (d) the prediction of large-angle convergent beam electron diffraction patterns.
The identification and characterization of phase transitions is one of the oldest and most central problems in condensed matter physics, traditionally approached through order parameters, free-energy expansions, renormalization-group analysis, and direct numerical simulation. Over the past decade, machine learning (ML) has emerged as a complementary and, in some regimes, transformative methodology for this task. Supervised classifiers can learn to distinguish phases directly from raw configurations without an a priori order parameter; unsupervised and self-supervised techniques such as principal component analysis, autoencoders, and learning-by-confusion can locate transition points with minimal or no labeled data; and generative and variational architectures, including neural-network quantum states, now approximate ground-state wavefunctions of strongly correlated systems well beyond the reach of exact diagonalization. This paper reviews the theoretical foundations of phase transitions relevant to machine-learning applications, surveys the principal families of algorithms used to detect and classify phases, and examines their application across classical spin systems, percolation, topological and quantum phases, strongly correlated electron systems, and experimentally measured spectroscopic data. Representative case studies are discussed, including convolutional and graph-neural-network classifiers of lattice configurations, explainable-ML detection of thermodynamic transitions in photoemission spectra, and deep-learning-guided discovery of high-temperature superconductors. The review closes with a critical discussion of persistent challenges interpretability, data scarcity in correlated-electron experiments, generalization across Hamiltonians, and the reliability of learned order parameters near criticality and outlines directions for future research, including physics-informed architectures, uncertainty quantification, and closed-loop integration with autonomous experimentation.
Machine learning methods have been important in the study of phase transitions. Unsupervised methods are particularly attractive because they do not require prior knowledge of the existence of a phase transition. In this work we focus on the constant magnetization Ising model in two (2D) and three (3D) dimensions. While there have been many studies using machine learning for the critical behavior of these systems, we are not aware of any studies for the phase diagram at off-critical magnetizations below the critical temperature. Previous work has used the raw spins as the input feature. We show that a more robust input feature is the local affinity, where the value of the feature at each site is determined by the spin and its neighbors. When coupled with a variational autoencoder, the method is able to predict the phase behavior of the 2D and 3D Ising models (including the critical exponent β) in quantitative agreement with conventional simulations. The choice of activation functions in the autoencoder is crucial, and this requires physical insight into the nature of the phase transition. The method is general and can be applied to any lattice or off-lattice system.
Conventionally, the study of phases in statistical mechan- ics is performed with the help of random sampling tools. Among the most powerful are Monte Carlo simulations consisting of a stochastic importance sampling over state space and evaluation of estimators for physical quantities. The ability of modern machine learning techniques to classify, identify, or in- terpret massive data sets provides a complementary paradigm to the above approach to analyze the exponentially large number of states in statistical physics. In this report, it is demonstrated by application on Ising-type models that deep learning has potential wide applications in solving many-body statis- tical physics problems. In application of supervised learning, we showed that the feed-forward neural network can identify phases and phase transitions in the ferromagnetic Ising model and the convolutional neural network (CNN) is extremely powerful in classifying T = 0 and T = ∞ phases in the Ising gauge model; In application of unsupervised learning, we illustrated that a deep auto-encoder constructed by stacked restricted Boltzmann machines (RBM)\nis closely related to the renormalization group (RG) method well understood in modern physics and our reconstruction of Ising spin configurations in the ferromagnetic Ising model is similar to the hand-written digits reconstruction.
We apply various unsupervised machine learning methods for phase classification to investigate the finite-temperature phase diagram of the spinless Falicov-Kimball model in two dimensions. Using only particle occupation snapshots from Monte Carlo simulations as input, each technique, including a straightforward classification based on principal component analysis (PCA), successfully identifies the phase boundary between ordered and disordered phases, independent of the type of phase transition. Remarkably, these techniques also distinguish between the weakly localized and Anderson-localized regimes within the disordered phase, accurately identifying their crossover, which is a challenging task for standard methods. Among the machine learning approaches used, PCA based analysis outperforms more complex methods, such as neural network predictors and autoencoders. These results underscore the effectiveness of simple unsupervised techniques in examining phase transitions and electron localization in complex correlated systems.
Abstract We investigate deep learning autoencoders for the unsupervised recognition of phase transitions in physical systems formulated on a lattice. We focus our investigation on the 2-dimensional ferromagnetic Ising model and then test the application of the autoencoder on the anti-ferromagnetic Ising model. We use spin configurations produced for the 2-dimensional ferromagnetic and anti-ferromagnetic Ising model in zero external magnetic field. For the ferromagnetic Ising model, we study numerically the relation between one latent variable extracted from the autoencoder to the critical temperature T c . The proposed autoencoder reveals the two phases, one for which the spins are ordered and the other for which spins are disordered, reflecting the restoration of the ℤ 2 symmetry as the temperature increases. We provide a finite volume analysis for a sequence of increasing lattice sizes. For the largest volume studied, the transition between the two phases occurs very close to the theoretically extracted critical temperature. We define as a quasi-order parameter the absolute average latent variable z ̃ , which enables us to predict the critical temperature. One can define a latent susceptibility and use it to quantify the value of the critical temperature T c ( L ) at different lattice sizes and that these values suffer from only small finite scaling effects. We demonstrate that T c ( L ) extrapolates to the known theoretical value as L → ∞ suggesting that the autoencoder can also be used to extract the critical temperature of the phase transition to an adequate precision. Subsequently, we test the application of the autoencoder on the anti-ferromagnetic Ising model, demonstrating that the proposed network can detect the phase transition successfully in a similar way. Graphical abstract