Abstract Employing a deep convolutional neural network (deep CNN) trained on spin configurations of the 2D Ising model and the temperatures, we examine whether the deep CNN can detect the phase transition of the 2D
q-state Potts model. To this end, we generate binarized images of spin configurations of the
q-state Potts model (
q≥3) by replacing the spin variables
{0,1,…,⌊q/2⌋−1} and
{⌊q/2⌋,…,q−1} with
{0} and
{1}, respectively. Then, we input these images to the trained CNN to output the predicted temperatures. The binarized images of the
q-state Potts model are entirely different from Ising spin configurations, particularly at the transition temperature. Moreover, our CNN model is not trained on the information about whether phases are ordered/disordered but is naively trained by Ising spin configurations labeled with temperatures at which they are generated. Nevertheless, the deep CNN can detect the transition point with high accuracy, regardless of the type of transition. We also find that, in the high-temperature region, the CNN outputs the temperature based on the internal energy, whereas, in the low-temperature region, the output depends on the magnetization and possibly the internal energy as well. However, in the vicinity of the transition point, the CNN may use more general factors to detect the transition point.
Abstract Phase transitions play a central role in statistical physics and are well understood in systems at thermal equilibrium. However, their nonequilibrium counterparts remain less explored because of the lack of a unified theoretical framework. In this study, we examine the potential of deep learning, specially convolutional neural networks (CNN), to detect nonequilibrium phase transitions (NEPT) in a 2D Ising model-like square lattice ferromagnetic system under effective parameter h . Without this parameter ( h = 0 ), we generate equilibrium spin configurations using the standard Metropolis algorithm as usual. With h ≠ 0 , we generate nonequilibrium spin configurations using an effective Glauber update rule which breaks detailed balance. While the former is used to train CNN, the later is not subsequently described by the usual Boltzmann-Gibbs distribution rather used to test the model. The study shows that the trained CNN can distinguish between ordered and disordered nonequilibrium steady states and accurately predict the critical temperature of the system undergoing NEPT. Finite size scaling analysis of the model’s output (perdition) reproduces critical exponents that agree with theoretical expectations, indicating that this method provides a strong, data driven approach for examining nonequilibrium critical phenomena.
This paper presents the investigation of convolutional neural network (CNN) prediction successfully recognizing the temperature of the nonequilibrium phase transitions in two-dimensional (2D) Ising spins on a square lattice. The model uses image snapshots of ferromagnetic 2D spin configurations as an input shape to provide the average output predictions. By considering supervised machine learning techniques, we perform Metropolis Monte Carlo (MC) simulations to generate the configurations. In the equilibrium Ising model, the Metropolis algorithm respects detailed balance condition (DBC), while its nonequilibrium version violates DBC. Violating the DBC of the algorithm is characterized by a parameter −8<ε<8. We find the exact result of the transition temperature Tc(ε) in terms of ε. If we set ε=0, the usual single spin-flip algorithm can be restored, and the equilibrium configurations generated with such a set up are used to train our model. For ε≠0, the system attains the nonequilibrium steady states (NESS), and the modified algorithm generates NESS configurations (test dataset). The trained model is successfully tested on the test dataset. Our result shows that CNN can determine Tc(ε≠0) for various ε values, consistent with the exact result.
Over the past several years, there have been many studies demonstrating the ability of deep neural networks to identify phase transitions in many physical systems, notably in classical statistical physics systems. One often finds that the prediction of deep learning methods trained on many ensembles below and above the critical temperature T_{c} behaves similarly to an order parameter, and this analogy has been successfully used to locate T_{c} and estimate universal critical exponents. In this work, we pay particular attention to the ability of a convolutional neural network to capture these critical parameters for the two-dimensional Ising model when the network is trained on configurations at T=0 and T=∞ only. We directly compare its output to the same network trained at multiple temperatures below and above T_{c} to gain understanding of how this extreme restriction of training data can impact a neural network's ability to classify phases. We find that the network trained on two temperatures is still able to identify T_{c} and ν, while the extraction of γ becomes more challenging.
The authors describe a method for determining the critical point of a second-order phase transitions using a convolutional neural network based on the Ising model on a square lattice. Data for training were obtained using Metropolis algorithm for different temperatures. The neural network was trained on the data corresponding to the low-temperature phase, that is a ferromagnetic one and high-temperature phase, that is a paramagnetic one, respectively. After training, the neural network analyzed input data from the entire temperature range: from 0.1 to 5.0 (in dimensionless units) and determined (the Curie temperature T_c). The accuracy of the obtained results was estimated relative to the Onsager solution for a flat lattice of Ising spins.
We present an analysis of neural network-based machine learning schemes for phases and phase transitions in theoretical condensed matter research, focusing on neural networks with a single hidden layer. Such shallow neural networks were previously found to be efficient in classifying phases and locating phase transitions of various basic model systems. In order to rationalize the emergence of the classification process and for identifying any underlying physical quantities, it is feasible to examine the weight matrices and the convolutional filter kernels that result from the learning process of such shallow networks. Furthermore, we demonstrate how the learning-by-confusing scheme can be used, in combination with a simple threshold-value classification method, to diagnose the learning parameters of neural networks. In particular, we study the classification process of both fully-connected and convolutional neural networks for the two-dimensional Ising model with extended domain wall configurations included in the low-temperature regime. Moreover, we consider the two-dimensional XY model and contrast the performance of the learning-by-confusing scheme and convolutional neural networks trained on bare spin configurations to the case of preprocessed samples with respect to vortex configurations. We discuss these findings in relation to similar recent investigations and possible further applications.