The latest advances of statistical physics have shown remarkable performance of machine learning in identifying phase transitions. In this paper, we apply domain adversarial neural network (DANN) based on transfer learning to studying nonequilibrium and equilibrium phase transition models, which are percolation model and directed percolation (DP) model, respectively. With the DANN, only a small fraction of input configurations (two-dimensional images) needs to be labeled, which is automatically chosen, to capture the critical point. To learn the DP model, the method is refined by an iterative procedure in determining the critical point, which is a prerequisite for the data collapse in calculating the critical exponent ν_{⊥}. We then apply the DANN to a two-dimensional site percolation with configurations filtered to include only the largest cluster which may contain the information related to the order parameter. The DANN learning of both models yields reliable results which are comparable to the ones from Monte Carlo simulations. Our study also shows that the DANN can achieve quite high accuracy at much lower cost, compared to the supervised learning.
The latest advances of statistical physics have shown remarkable performance of machine learning in identifying phase transitions. In this paper, we apply domain adversarial neural network (DANN) based on transfer learning to studying nonequilibrium and equilibrium phase transition models, which are percolation model and directed percolation (DP) model, respectively. With the DANN, only a small fraction of input configurations (two-dimensional images) needs to be labeled, which is automatically chosen, to capture the critical point. To learn the DP model, the method is refined by an iterative procedure in determining the critical point, which is a prerequisite for the data collapse in calculating the critical exponent ν_{⊥}. We then apply the DANN to a two-dimensional site percolation with configurations filtered to include only the largest cluster which may contain the information related to the order parameter. The DANN learning of both models yields reliable results which are comparable to the ones from Monte Carlo simulations. Our study also shows that the DANN can achieve quite high accuracy at much lower cost, compared to the supervised learning.
Recently, machine learning algorithms have been used remarkably to study the equilibrium phase transitions, however there are only a few works have been done using this technique in the nonequilibrium phase transitions. In this work, we use the supervised learning with the convolutional neural network (CNN) algorithm and unsupervised learning with the density-based spatial clustering of applications with noise (DBSCAN) algorithm to study the nonequilibrium phase transition in two models. We use CNN and DBSCAN in order to determine the critical points for directed bond percolation (bond DP) model and Domany-Kinzel cellular automaton (DK) model. Both models have been proven to have a nonequilibrium phase transition belongs to the directed percolation (DP) universality class. In the case of supervised learning we train CNN using the images which are generated from Monte Carlo simulations of directed bond percolation. We use that trained CNN in studding the phase transition for the two models. In the case of unsupervised learning, we train DBSCAN using the raw data of Monte Carlo simulations. In this case, we retrain DBSCAN at each time we change the model or lattice size. Our results from both algorithms show that, even for a very small values of lattice size, machine can predict the critical points accurately for both models. Finally, we mention to that, the value of the critical point we find here for bond DP model using CNN or DBSCAN is exactly the same value that has been found using transfer learning with a domain adversarial neural network (DANN) algorithm.
Machine learning (ML) has been well applied to studying equilibrium phase transition models by accurately predicating critical thresholds and some critical exponents. Difficulty will be raised, however, for integrating ML into nonequilibrium phase transitions. The extra dimension in a given nonequilibrium system, namely time, can greatly slow down the procedure toward the steady state. In this paper we find that by using some simple techniques of ML, non-steady-state configurations of directed percolation (DP) suffice to capture its essential critical behaviors in both (1+1) and (2+1) dimensions. With the supervised learning method, the framework of our binary classification neural networks can identify the phase transition threshold, as well as the spatial and temporal correlation exponents. The characteristic time t_{c}, specifying the transition from active phases to absorbing ones, is also a major product of the learning. Moreover, we employ the convolutional autoencoder, an unsupervised learning technique, to extract dimensionality reduction representations and cluster configurations of (1+1) bond DP. It is quite appealing that such a method can yield a reasonable estimation of the critical point.
Abstract Machine learning has been widely applied in physics research. Although unsupervised learning can extract the critical points of phase transitions, the percolation model remains a challenge. Unsupervised learning using the raw configurations of the percolation model fails to capture the critical points. To capture the configuration characteristics of the percolation model, this paper proposes using the maximum cluster as input to the neural network. It is well understood that the order parameter of the percolation model is not simply the particle density, but rather the probability that a given site or bond belongs to the percolating cluster. Additionally, we introduce the use of a Siamese Neural Network (SNN) to detect percolation phase transitions. Unlike unsupervised dimensionality reduction methods or supervised binary classification outputs, the SNN produces a scalar output referred to as similarity. By combining the maximum cluster and the SNN, we not only successfully extract the critical value of the percolation model, but also calculate the correlation exponent via data collapse. We believe that the SNN has great potential in handling phase transition classification problems and can serve as a reference for studying other phase transition systems.
Neural networks in machine learning are highly capable of classifying data and recognizing graphics, and have been widely used in statistical physics, particularly in phase transitions. In this paper, we review recent developments in machine learning algorithms in the application of primary phase transition models. We first introduce the background of modern machine learning algorithms and related pioneering work in equilibrium phase transitions. Second, by taking directed percolation as an example of a typical non-equilibrium phase transition model, we present some of the latest research findings of our group. The research involves supervised, unsupervised, and semi-supervised learning for classifying phases, predicting critical points, and measuring critical exponents. Thereafter, we elaborate on related work on machine learning algorithms in phase transition research in quantum many-body theory, soft matter physics, and high-energy physics. Lastly, corresponding discussions and prospects are presented.
In this paper, we apply machine learning methods to study phase transitions in certain statistical mechanical models on the two-dimensional lattices, whose transitions involve nonlocal or topological properties, including site and bond percolations, the XY model, and the generalized XY model. We find that using just one hidden layer in a fully connected neural network, the percolation transition can be learned and the data collapse by using the average output layer gives correct estimate of the critical exponent ν. We also study the Berezinskii-Kosterlitz-Thouless transition, which involves binding and unbinding of topological defects, vortices and antivortices, in the classical XY model. The generalized XY model contains richer phases, such as the nematic phase, the paramagnetic and the quasi-long-range ferromagnetic phases, and we also apply machine learning method to it. We obtain a consistent phase diagram from the network trained with only data along the temperature axis at two particular parameter Δ values, where Δ is the relative weight of pure XY coupling. Aside from using the spin configurations (either angles or spin components) as the input information in a convolutional neural network, we devise a feature engineering approach using the histograms of the spin orientations in order to train the network to learn the three phases in the generalized XY model and demonstrate that it indeed works. The trained network by using system size L×L can be used to the phase diagram for other sizes (L^{'}×L^{'}, where L^{'}≠L) without any further training.
Neural network methods are increasingly applied to solve phase transition problems, particularly in identifying critical points in non-equilibrium phase transitions, offering more convenience compared to traditional methods. In this paper, we analyze the (1+1)-dimensional and (2+1)-dimensional directed percolation models using an autoencoder network. We demonstrate that single-step configurations after reaching steady state can replace traditional full configurations for learning purposes. This approach significantly reduces data size and accelerates training time.Furthermore, we introduce a multi-input branch autoencoder network to extract shared features from systems of different sizes. The neural network is capable of learning results from finite-size scaling. By modifying the network input to include configurations at discrete time steps, the network can also capture temporal information, enabling dynamic analysis of non-equilibrium phase boundaries. Our proposed method allows for high-precision identification of critical points using both spatial and temporal features.