This paper presents a systematic study of the application of convolutional neural networks (CNNs) as an efficient and versatile tool for the analysis of critical and low-temperature phase states in spin system models. The problem of calculating the dependence of the average energy on the spatial distribution of exchange integrals for the Edwards-Anderson model on a square lattice with frustrated interactions is considered. We further construct a single convolutional classifier of phase states of the ferromagnetic Ising model on square, triangular, honeycomb, and kagome lattices, trained on configurations generated by the Swendsen-Wang cluster algorithm. Computed temperature profiles of the averaged posterior probability of the high-temperature phase form clear S-shaped curves that intersect in the vicinity of the theoretical critical temperatures and allow one to determine the critical temperature for the kagome lattice without additional retraining. It is shown that convolutional models substantially reduce the root-mean-square error (RMSE) compared with fully connected architectures and efficiently capture complex correlations between thermodynamic characteristics and the structure of magnetic correlated systems.
This paper presents a systematic study of the application of convolutional neural networks (CNNs) as an efficient and versatile tool for the analysis of critical and low-temperature phase states in spin system models. The problem of calculating the dependence of the average energy on the spatial distribution of exchange integrals for the Edwards-Anderson model on a square lattice with frustrated interactions is considered. We further construct a single convolutional classifier of phase states of the ferromagnetic Ising model on square, triangular, honeycomb, and kagome lattices, trained on configurations generated by the Swendsen-Wang cluster algorithm. Computed temperature profiles of the averaged posterior probability of the high-temperature phase form clear S-shaped curves that intersect in the vicinity of the theoretical critical temperatures and allow one to determine the critical temperature for the kagome lattice without additional retraining. It is shown that convolutional models substantially reduce the root-mean-square error (RMSE) compared with fully connected architectures and efficiently capture complex correlations between thermodynamic characteristics and the structure of magnetic correlated systems.
This paper presents the investigation of convolutional neural network (CNN) prediction successfully recognizing the temperature of the nonequilibrium phase transitions in two-dimensional (2D) Ising spins on a square lattice. The model uses image snapshots of ferromagnetic 2D spin configurations as an input shape to provide the average output predictions. By considering supervised machine learning techniques, we perform Metropolis Monte Carlo (MC) simulations to generate the configurations. In the equilibrium Ising model, the Metropolis algorithm respects detailed balance condition (DBC), while its nonequilibrium version violates DBC. Violating the DBC of the algorithm is characterized by a parameter −8<ε<8. We find the exact result of the transition temperature Tc(ε) in terms of ε. If we set ε=0, the usual single spin-flip algorithm can be restored, and the equilibrium configurations generated with such a set up are used to train our model. For ε≠0, the system attains the nonequilibrium steady states (NESS), and the modified algorithm generates NESS configurations (test dataset). The trained model is successfully tested on the test dataset. Our result shows that CNN can determine Tc(ε≠0) for various ε values, consistent with the exact result.
In this paper, we applied a deep neural network to study the issue of knowledge transferability between statistical mechanics models. The following computer experiment was conducted. A convolutional neural network was trained to solve the problem of binary classification of snapshots of the Ising model’s spin configuration on a two-dimensional lattice. During testing, snapshots of the Ising model spins on a lattice with diagonal ferromagnetic and antiferromagnetic connections were fed to the input of the neural network. Estimates of the probability of samples belonging to the paramagnetic phase were obtained from the outputs of the tested network. The analysis of these probabilities allowed us to estimate the critical temperature and the critical correlation length exponent. It turned out that at weak anisotropy the neural network satisfactorily predicts the transition point and the value of the correlation length exponent. Strong anisotropy leads to a noticeable deviation of the predicted values from the precisely known ones. Qualitatively, strong anisotropy is associated with the presence of oscillations of the correlation function above the Stefenson disorder temperature and further approach to the point of the fully frustrated case.
Quantum spin networks represent systems in which quantum spins are arranged on a topological lattice, where the nature of spin interactions and the influence of external magnetic fields can lead to complex collective behaviors. The Hamiltonian governing such systems determines the energy landscape and phase transitions under various thermodynamic conditions. In this paper, we focus on the two-dimensional Ising spin model with periodic boundary conditions subjected to a uniform external magnetic field. Initially, we employ the Metropolis Monte Carlo (MP-MN) algorithm to simulate the system and identify its phase transitions at different magnetic field strengths. The emergence of ordered and disordered phases in response to thermal fluctuations and magnetic interactions is systematically analyzed. Subsequently, we explore the application of convolutional neural networks (CNNs), a powerful class of deep learning models, to detect and classify the phases of the Ising model based on spin configurations generated at a fixed temperature. The CNN is trained using labeled data representing different magnetic field values, and its performance in phase prediction is quantitatively evaluated. The results demonstrate that CNNs can successfully learn complex spin patterns and provide accurate classification of spin phases, highlighting their potential for analyzing phase transitions in statistical physics models.
Abstract Phase transitions play a central role in statistical physics and are well understood in systems at thermal equilibrium. However, their nonequilibrium counterparts remain less explored because of the lack of a unified theoretical framework. In this study, we examine the potential of deep learning, specially convolutional neural networks (CNN), to detect nonequilibrium phase transitions (NEPT) in a 2D Ising model-like square lattice ferromagnetic system under effective parameter h . Without this parameter ( h = 0 ), we generate equilibrium spin configurations using the standard Metropolis algorithm as usual. With h ≠ 0 , we generate nonequilibrium spin configurations using an effective Glauber update rule which breaks detailed balance. While the former is used to train CNN, the later is not subsequently described by the usual Boltzmann-Gibbs distribution rather used to test the model. The study shows that the trained CNN can distinguish between ordered and disordered nonequilibrium steady states and accurately predict the critical temperature of the system undergoing NEPT. Finite size scaling analysis of the model’s output (perdition) reproduces critical exponents that agree with theoretical expectations, indicating that this method provides a strong, data driven approach for examining nonequilibrium critical phenomena.
In recent years Machine Learning has proved to be successful in many technological applications and scientific tasks, such as image and speech recognition, natural language
understanding and more. In this work we apply both supervised and unsupervised Machine Learning to three key problems in statistical physics: design of Hamiltonian from data,
phase recognition and study of critical properties of a system undergoing phase transition.
As an example of model design, we use a dataset with spin configurations and corresponding energies randomly sampled from a one dimensional Ising model. We then make two
guesses for the correct Hamiltonian: the former involving interactions of spins with an external local field, the latter involving two body interactions among spins.
The coupling constants are determined with a linear penalized regression, comparing the effects of L1 and L2 penalization terms of the cost function. We pay specific attention
to the problem of overfitting and to the validation process, which is critical for accepting or rejecting the proposed model.
The phase recognition problem is faced with the two dimensional Ising and XY models as examples. After showing the limits of a simple softmax regression for this task,
we build suitable neural networks to overcome these limits. In particular, a feed forward network is built and the learning process is investigated for the Ising model;
while a more sophisticated convolutional network is proposed for the XY model in order to detect local topological structures.
The last part of the work is dedicated to the unsupervised study of phase transitions, and the determination of critical properties (order parameter, critical
temperature, critical exponents). The discussed techniques are Principal Component Analysis (PCA) for dimensional reduction and K-means clustering for organizing data into
subsets with specific properties. PCA is applied to the two dimensional Ising, Potts and XY models, and it is used to find suitable order parameters. The study of the
proposed order parameter as a function of temperature provides evidence of phase transition, and a finite size scaling allows to extrapolate both the critical temperature
in the thermodynamic limit, and the ν critical exponent for the correlation length. K-means clustering is applied to equilibrium configurations of the two dimensional
Ising model, before and after the dimensional reduction, and the critical temperature is estimated. Moreover, a clustering of relaxation curves of magnetization in a
Monte Carlo dynamics is used to build a phase diagram on the parameter space of temperature and magnetic field.
A synergy of C++, Python and Wolfram Mathematica 12.0 is used throughout this work in order to sample input datasets and to build and control customized neural networks
and learning tools. The most relevant codes are provided in the appendix.
Quantum spin networks represent configurations of spins arranged on a topological lattice, where the spin interactions are governed by the system's Hamiltonian. These networks are critical for understanding magnetic materials, as the arrangement of spins and the type of interaction between neighboring spins determine the macroscopic behavior of the system. The behavior of these systems is further influenced by the presence of external magnetic fields. In this paper, we first investigate the various phases of the two-dimensional Ising lattice with periodic boundary conditions under the influence of a uniform external magnetic field. The exploration of these phases is performed using the Metropolis Monte Carlo (MP-MN) algorithm, a well-established statistical method for simulating spin systems. Subsequently, we explore the potential of deep learning, specifically convolutional neural networks (CNN), in identifying and predicting these phases of spin lattices. The CNN's ability to classify different phases of the two-dimensional Ising model in the presence of a homogeneous magnetic field at a constant temperature is examined. The study aims to demonstrate how machine learning models, particularly CNNs, can effectively detect phase transitions and predict the system's behavior, which traditionally requires extensive computational methods. Finally, the performance of the CNN algorithm is evaluated by assessing its accuracy in predicting different phases of the Ising model.