Neural network methods are increasingly applied to solve phase transition problems, particularly in identifying critical points in non-equilibrium phase transitions, offering more convenience compared to traditional methods. In this paper, we analyze the (1+1)-dimensional and (2+1)-dimensional directed percolation models using an autoencoder network. We demonstrate that single-step configurations after reaching steady state can replace traditional full configurations for learning purposes. This approach significantly reduces data size and accelerates training time.Furthermore, we introduce a multi-input branch autoencoder network to extract shared features from systems of different sizes. The neural network is capable of learning results from finite-size scaling. By modifying the network input to include configurations at discrete time steps, the network can also capture temporal information, enabling dynamic analysis of non-equilibrium phase boundaries. Our proposed method allows for high-precision identification of critical points using both spatial and temporal features.
Neural network methods are increasingly applied to solve phase transition problems, particularly in identifying critical points in non-equilibrium phase transitions, offering more convenience compared to traditional methods. In this paper, we analyze the (1+1)-dimensional and (2+1)-dimensional directed percolation models using an autoencoder network. We demonstrate that single-step configurations after reaching steady state can replace traditional full configurations for learning purposes. This approach significantly reduces data size and accelerates training time.Furthermore, we introduce a multi-input branch autoencoder network to extract shared features from systems of different sizes. The neural network is capable of learning results from finite-size scaling. By modifying the network input to include configurations at discrete time steps, the network can also capture temporal information, enabling dynamic analysis of non-equilibrium phase boundaries. Our proposed method allows for high-precision identification of critical points using both spatial and temporal features.
Machine learning (ML) has been well applied to studying equilibrium phase transition models by accurately predicating critical thresholds and some critical exponents. Difficulty will be raised, however, for integrating ML into nonequilibrium phase transitions. The extra dimension in a given nonequilibrium system, namely time, can greatly slow down the procedure toward the steady state. In this paper we find that by using some simple techniques of ML, non-steady-state configurations of directed percolation (DP) suffice to capture its essential critical behaviors in both (1+1) and (2+1) dimensions. With the supervised learning method, the framework of our binary classification neural networks can identify the phase transition threshold, as well as the spatial and temporal correlation exponents. The characteristic time t_{c}, specifying the transition from active phases to absorbing ones, is also a major product of the learning. Moreover, we employ the convolutional autoencoder, an unsupervised learning technique, to extract dimensionality reduction representations and cluster configurations of (1+1) bond DP. It is quite appealing that such a method can yield a reasonable estimation of the critical point.
The latest advances of statistical physics have shown remarkable performance of machine learning in identifying phase transitions. In this paper, we apply domain adversarial neural network (DANN) based on transfer learning to studying nonequilibrium and equilibrium phase transition models, which are percolation model and directed percolation (DP) model, respectively. With the DANN, only a small fraction of input configurations (two-dimensional images) needs to be labeled, which is automatically chosen, to capture the critical point. To learn the DP model, the method is refined by an iterative procedure in determining the critical point, which is a prerequisite for the data collapse in calculating the critical exponent ν_{⊥}. We then apply the DANN to a two-dimensional site percolation with configurations filtered to include only the largest cluster which may contain the information related to the order parameter. The DANN learning of both models yields reliable results which are comparable to the ones from Monte Carlo simulations. Our study also shows that the DANN can achieve quite high accuracy at much lower cost, compared to the supervised learning.
Abstract Machine learning (ML) of phase transitions (PTs) has gradually become an effective approach that enables us to explore the nature of various PTs more promptly in equilibrium and nonequilibrium systems. Unlike equilibrium systems, non-equilibrium systems display more complicated and diverse features because of the extra dimension of time, which is not readily tractable, both theoretically and numerically. The combination of ML and most renowned nonequilibrium model, directed percolation (DP), led to some significant findings. In this study, ML is applied to ( 1 + 1 ) -d, even offspring branching annihilating random walks (BAW), whose universality class is not DP-like. The supervised learning of ( 1 + 1 ) -d BAW via convolutional neural networks (CNN) results in a more accurate prediction of the critical point than the Monte Carlo (MC) simulation for the same system sizes. The dynamic exponent z and spatial correlation length correlation exponent ν ⊥ were also measured and found to be consistent with their respective theoretical values. Furthermore, the unsupervised learning of ( 1 + 1 ) -d BAW via an autoencoder (AE) gives rise to a transition point, which is the same as the critical point. The latent layer of AE, through a single neuron, can be regarded as the order parameter of the system being properly re-scaled. Therefore, we believe that ML has exciting application prospects in reaction-diffusion systems such as BAW and DP.
In this paper, we apply machine learning methods to study phase transitions in certain statistical mechanical models on the two-dimensional lattices, whose transitions involve nonlocal or topological properties, including site and bond percolations, the XY model, and the generalized XY model. We find that using just one hidden layer in a fully connected neural network, the percolation transition can be learned and the data collapse by using the average output layer gives correct estimate of the critical exponent ν. We also study the Berezinskii-Kosterlitz-Thouless transition, which involves binding and unbinding of topological defects, vortices and antivortices, in the classical XY model. The generalized XY model contains richer phases, such as the nematic phase, the paramagnetic and the quasi-long-range ferromagnetic phases, and we also apply machine learning method to it. We obtain a consistent phase diagram from the network trained with only data along the temperature axis at two particular parameter Δ values, where Δ is the relative weight of pure XY coupling. Aside from using the spin configurations (either angles or spin components) as the input information in a convolutional neural network, we devise a feature engineering approach using the histograms of the spin orientations in order to train the network to learn the three phases in the generalized XY model and demonstrate that it indeed works. The trained network by using system size L×L can be used to the phase diagram for other sizes (L^{'}×L^{'}, where L^{'}≠L) without any further training.
Abstract Machine learning has been widely applied in physics research. Although unsupervised learning can extract the critical points of phase transitions, the percolation model remains a challenge. Unsupervised learning using the raw configurations of the percolation model fails to capture the critical points. To capture the configuration characteristics of the percolation model, this paper proposes using the maximum cluster as input to the neural network. It is well understood that the order parameter of the percolation model is not simply the particle density, but rather the probability that a given site or bond belongs to the percolating cluster. Additionally, we introduce the use of a Siamese Neural Network (SNN) to detect percolation phase transitions. Unlike unsupervised dimensionality reduction methods or supervised binary classification outputs, the SNN produces a scalar output referred to as similarity. By combining the maximum cluster and the SNN, we not only successfully extract the critical value of the percolation model, but also calculate the correlation exponent via data collapse. We believe that the SNN has great potential in handling phase transition classification problems and can serve as a reference for studying other phase transition systems.
Recently, machine learning algorithms have been used remarkably to study the equilibrium phase transitions, however there are only a few works have been done using this technique in the nonequilibrium phase transitions. In this work, we use the supervised learning with the convolutional neural network (CNN) algorithm and unsupervised learning with the density-based spatial clustering of applications with noise (DBSCAN) algorithm to study the nonequilibrium phase transition in two models. We use CNN and DBSCAN in order to determine the critical points for directed bond percolation (bond DP) model and Domany-Kinzel cellular automaton (DK) model. Both models have been proven to have a nonequilibrium phase transition belongs to the directed percolation (DP) universality class. In the case of supervised learning we train CNN using the images which are generated from Monte Carlo simulations of directed bond percolation. We use that trained CNN in studding the phase transition for the two models. In the case of unsupervised learning, we train DBSCAN using the raw data of Monte Carlo simulations. In this case, we retrain DBSCAN at each time we change the model or lattice size. Our results from both algorithms show that, even for a very small values of lattice size, machine can predict the critical points accurately for both models. Finally, we mention to that, the value of the critical point we find here for bond DP model using CNN or DBSCAN is exactly the same value that has been found using transfer learning with a domain adversarial neural network (DANN) algorithm.