arXiv:2101.06392 · Physical review. E

Supervised and unsupervised learning of directed percolation

Jianmin Shen, Wei Li, Shengfeng Deng, Tao Zhang

Published May 27, 2021• 37 citations

Abstract

Machine learning (ML) has been well applied to studying equilibrium phase transition models by accurately predicating critical thresholds and some critical exponents. Difficulty will be raised, however, for integrating ML into nonequilibrium phase transitions. The extra dimension in a given nonequilibrium system, namely time, can greatly slow down the procedure toward the steady state. In this paper we find that by using some simple techniques of ML, non-steady-state configurations of directed percolation (DP) suffice to capture its essential critical behaviors in both (1+1) and (2+1) dimensions. With the supervised learning method, the framework of our binary classification neural networks can identify the phase transition threshold, as well as the spatial and temporal correlation exponents. The characteristic time t_{c}, specifying the transition from active phases to absorbing ones, is also a major product of the learning. Moreover, we employ the convolutional autoencoder, an unsupervised learning technique, to extract dimensionality reduction representations and cluster configurations of (1+1) bond DP. It is quite appealing that such a method can yield a reasonable estimation of the critical point.

DOI: 10.1103/physreve.103.052140

Related papers

Supervised and unsupervised learning of (1+1) -dimensional even-offspring branching annihilating random walks

Yanyang Wang, Wei Li, Feiyi Liu +1 more

Abstract Machine learning (ML) of phase transitions (PTs) has gradually become an effective approach that enables us to explore the nature of various PTs more promptly in equilibrium and nonequilibrium systems. Unlike equilibrium systems, non-equilibrium systems display more complicated and diverse features because of the extra dimension of time, which is not readily tractable, both theoretically and numerically. The combination of ML and most renowned nonequilibrium model, directed percolation (DP), led to some significant findings. In this study, ML is applied to ( 1 + 1 ) -d, even offspring branching annihilating random walks (BAW), whose universality class is not DP-like. The supervised learning of ( 1 + 1 ) -d BAW via convolutional neural networks (CNN) results in a more accurate prediction of the critical point than the Monte Carlo (MC) simulation for the same system sizes. The dynamic exponent z and spatial correlation length correlation exponent ν ⊥ were also measured and found to be consistent with their respective theoretical values. Furthermore, the unsupervised learning of ( 1 + 1 ) -d BAW via an autoencoder (AE) gives rise to a transition point, which is the same as the critical point. The latent layer of AE, through a single neuron, can be regarded as the order parameter of the system being properly re-scaled. Therefore, we believe that ML has exciting application prospects in reaction-diffusion systems such as BAW and DP.

arXiv:2307.05618Machine Learning Science and TechnologyFeb 9, 20245 citations

Determination of the critical points for systems of directed percolation class using machine learning

M. Ali Saif, Bassam M. Mughalles

Recently, machine learning algorithms have been used remarkably to study the equilibrium phase transitions, however there are only a few works have been done using this technique in the nonequilibrium phase transitions. In this work, we use the supervised learning with the convolutional neural network (CNN) algorithm and unsupervised learning with the density-based spatial clustering of applications with noise (DBSCAN) algorithm to study the nonequilibrium phase transition in two models. We use CNN and DBSCAN in order to determine the critical points for directed bond percolation (bond DP) model and Domany-Kinzel cellular automaton (DK) model. Both models have been proven to have a nonequilibrium phase transition belongs to the directed percolation (DP) universality class. In the case of supervised learning we train CNN using the images which are generated from Monte Carlo simulations of directed bond percolation. We use that trained CNN in studding the phase transition for the two models. In the case of unsupervised learning, we train DBSCAN using the raw data of Monte Carlo simulations. In this case, we retrain DBSCAN at each time we change the model or lattice size. Our results from both algorithms show that, even for a very small values of lattice size, machine can predict the critical points accurately for both models. Finally, we mention to that, the value of the critical point we find here for bond DP model using CNN or DBSCAN is exactly the same value that has been found using transfer learning with a domain adversarial neural network (DANN) algorithm.

arXiv:2307.10456Jul 19, 20230 citations

Neural network learning of multi-scale and discrete temporal features in directed percolation

Gao, Feng, Jianmin Shen, Shanshan Wang +2 more

Neural network methods are increasingly applied to solve phase transition problems, particularly in identifying critical points in non-equilibrium phase transitions, offering more convenience compared to traditional methods. In this paper, we analyze the (1+1)-dimensional and (2+1)-dimensional directed percolation models using an autoencoder network. We demonstrate that single-step configurations after reaching steady state can replace traditional full configurations for learning purposes. This approach significantly reduces data size and accelerates training time.Furthermore, we introduce a multi-input branch autoencoder network to extract shared features from systems of different sizes. The neural network is capable of learning results from finite-size scaling. By modifying the network input to include configurations at discrete time steps, the network can also capture temporal information, enabling dynamic analysis of non-equilibrium phase boundaries. Our proposed method allows for high-precision identification of critical points using both spatial and temporal features.

arXiv:2503.08278Mar 11, 20250 citations

Transfer learning of phase transitions in percolation and directed percolation

Jianmin Shen, Feiyi Liu, Shiyang Chen +6 more

The latest advances of statistical physics have shown remarkable performance of machine learning in identifying phase transitions. In this paper, we apply domain adversarial neural network (DANN) based on transfer learning to studying nonequilibrium and equilibrium phase transition models, which are percolation model and directed percolation (DP) model, respectively. With the DANN, only a small fraction of input configurations (two-dimensional images) needs to be labeled, which is automatically chosen, to capture the critical point. To learn the DP model, the method is refined by an iterative procedure in determining the critical point, which is a prerequisite for the data collapse in calculating the critical exponent ν_{⊥}. We then apply the DANN to a two-dimensional site percolation with configurations filtered to include only the largest cluster which may contain the information related to the order parameter. The DANN learning of both models yields reliable results which are comparable to the ones from Monte Carlo simulations. Our study also shows that the DANN can achieve quite high accuracy at much lower cost, compared to the supervised learning.

arXiv:2112.15516Physical review. EJun 30, 202217 citations

Supervised, semisupervised, and unsupervised learning of the Domany-Kinzel model

Kui Tuo, Wei Li, Shengfeng Deng +1 more

The Domany-Kinzel (DK) model encompasses several types of nonequilibrium phase transitions, depending on the selected parameters. We apply supervised, semisupervised, and unsupervised learning methods to studying the phase transitions and critical behaviors of the (1+1)-dimensional DK model. The supervised and the semisupervised learning methods permit the estimations of the critical points, the spatial and temporal correlation exponents, concerning labeled and unlabeled DK configurations, respectively. Furthermore, we also predict the critical points by employing principal component analysis and autoencoder. The PCA and autoencoder can produce results in good agreement with simulated stationary particle number density.

arXiv:2309.13990Physical review. EAug 2, 20245 citations

Machine learning of (1+1)-dimensional directed percolation based on raw and shuffled configurations

Jianmin, Shen, Wang Shanshan, Wei Li +6 more

Machine learning (ML) can process large sets of data generated from complex systems, which is ideal for classification tasks as often appeared in critical phenomena. Meanwhile ML techniques have been found effective in detecting critical points, or in a broader sense phase separation, and extracting critical exponents. But there are still many unsolved issues with the ML, one of which is the meaning of hidden variables of unsupervised learning. Some say that the hidden variables and the principal component may contain basic information regarding the order parameter of the system of interest, which sounds plausible but lacks evidence. This study aims at searching for evidence supporting the conjecture that the autoencoder's (AE) single latent variable and PCA's first principal component can only serve as signals related to particle density, which happens to be the order parameter of the non-equilibrium DP model. Indeed, in some phase transition (PT) models the order parameter is the particle density, whereas in some PT models it is not. Having conducted a certain degree of random shuffling on the DP configurations, which are then fed to the neural networks as input, we find that AE's single latent variable and PCA's first principal component can indeed represent particle density. It is found that shuffling does affect the size of maximum cluster in the system, which suggests that the second principal component of the PCA is related to the maximal cluster. This has been supported by changes in the correlation length of the transition system with variations in the shuffle ratio.

arXiv:2311.11741Nov 20, 20230 citations