Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2109.05533 · Journal of the Physical Society of Japan

Randomized-Gauge Test for Machine Learning of Ising Model Order Parameter

Tomoyuki Morishita, Synge Todo

Published Mar 2, 2022• 1 citation
arXivHTMLPDF

Abstract

Recently, machine learning has been applied successfully for identifying phases and phase transitions of the Ising models. The continuous phase transition is characterized by spontaneous symmetry breaking, which can not be detected in general from a single spin configuration. To investigate if neural networks can extract correlations among spin snapshots, we propose a new test using the random-gauge Ising model. We show that neural networks can extract the order parameter or the energy of the random-gauge model as in the ferromagnetic case. We also discuss how and where the information of random gauge is encoded in neural networks and attempt to reconstruct the gauge from the neural network parameters. We find that the fully connected network encodes the effect of random gauge to its weights naturally. In contrast, the convolutional network copes with the randomness by assigning different network parts to local gauge patterns. This observation indicates that although the latter demonstrates higher performance than the former for the present randomized-gauge test, the former is more effective and suitable for dealing with models with spatial randomness.

DOI
10.7566/jpsj.91.044001

Related papers

Machine learning phases in statistical physics

Qi Chen

Conventionally, the study of phases in statistical mechan- ics is performed with the help of random sampling tools. Among the most powerful are Monte Carlo simulations consisting of a stochastic importance sampling over state space and evaluation of estimators for physical quantities. The ability of modern machine learning techniques to classify, identify, or in- terpret massive data sets provides a complementary paradigm to the above approach to analyze the exponentially large number of states in statistical physics. In this report, it is demonstrated by application on Ising-type models that deep learning has potential wide applications in solving many-body statis- tical physics problems. In application of supervised learning, we showed that the feed-forward neural network can identify phases and phase transitions in the ferromagnetic Ising model and the convolutional neural network (CNN) is extremely powerful in classifying T = 0 and T = ∞ phases in the Ising gauge model; In application of unsupervised learning, we illustrated that a deep auto-encoder constructed by stacked restricted Boltzmann machines (RBM)\nis closely related to the renormalization group (RG) method well understood in modern physics and our reconstruction of Ising spin configurations in the ferromagnetic Ising model is similar to the hand-written digits reconstruction.

•Jan 1, 2017•0 citations

Machine learning of Ising criticality with spin-shuffling

Pallab Basu, Jyotirmoy Bhattacharya, Dileep Pavan Surya Jakka +2 more

We investigate the performance of neural networks in identifying critical behaviour in the 2D Ising model with next-to-nearest neighbour interactions. We train DNN and CNN based classifiers on the Ising model configurations with nearest neighbour interactions and test the ability of our models to identify the critical (cross-over) region, as well as the phases in the presence of next-to-nearest neighbour interactions. Our main objective is to investigate whether our models can learn the notion of criticality and universality, in contrast to merely identifying the phases by simply learning the value of the order parameter, magnetization in this case. We design a simple adversarial training process which forces our models to ignore learning about the order parameter while training. We find that such models are able to identify critical region with reasonable success, implying that it has learned to identify the structure of spin-spin correlations near criticality.

arXiv:2203.04012•Mar 8, 2022•1 citation

Machine learning of explicit order parameters: From the Ising model to SU(2) lattice gauge theory

Sebastian J. Wetzel, Manuel Scherzer

We present a solution to the problem of interpreting neural networks classifying phases of matter. We devise a procedure for reconstructing the decision function of an artificial neural network as a simple function of the input, provided the decision function is sufficiently symmetric. In this case one can easily deduce the quantity by which the neural network classifies the input. The method is applied to the Ising model and SU(2) lattice gauge theory. In both systems we deduce the explicit expressions of the order parameters from the decision functions of the neural networks. We assume no prior knowledge about the Hamiltonian or the order parameters except Monte Carlo--sampled configurations.

arXiv:1705.05582•Physical review. B./Physical review. B•Nov 8, 2017•137 citations

Image Preparation for Machine-Learning Analysis of Multiple-Size Spin Systems

Akimichi Sakamoto, Kenta Shiina, 弘之 森

A new idea of preparing data is proposed for application of machine-learning methods to analysis of phase transitions of Ising model. Presenting spin configurations with different sizes in single-size images, we could test the different-size spin configurations by using a neural network trained with spin configurations with a fixed size. We also analyzed the Ising model on triangular and hexagonal lattices using the neural network trained for square lattice.

Journal of the Physical Society of Japan•May 28, 2021•0 citations

Deep learning study of nonequilibrium phase transitions in ferromagnetic systems under effective interactions

Dagne Wordofa Tola, Mulugeta Bekele

Abstract Phase transitions play a central role in statistical physics and are well understood in systems at thermal equilibrium. However, their nonequilibrium counterparts remain less explored because of the lack of a unified theoretical framework. In this study, we examine the potential of deep learning, specially convolutional neural networks (CNN), to detect nonequilibrium phase transitions (NEPT) in a 2D Ising model-like square lattice ferromagnetic system under effective parameter h . Without this parameter ( h = 0 ), we generate equilibrium spin configurations using the standard Metropolis algorithm as usual. With h ≠ 0 , we generate nonequilibrium spin configurations using an effective Glauber update rule which breaks detailed balance. While the former is used to train CNN, the later is not subsequently described by the usual Boltzmann-Gibbs distribution rather used to test the model. The study shows that the trained CNN can distinguish between ordered and disordered nonequilibrium steady states and accurately predict the critical temperature of the system undergoing NEPT. Finite size scaling analysis of the model’s output (perdition) reproduces critical exponents that agree with theoretical expectations, indicating that this method provides a strong, data driven approach for examining nonequilibrium critical phenomena.

Journal of Physics Communications•Aug 21, 2026•0 citations

Detecting composite orders in layered models via machine learning

Wojciech Rządkowski, Nicolò Defenu, Silvia Chiacchiera +2 more

Determining the phase diagram of systems consisting of smaller subsystems 'connected' via a tunable coupling is a challenging task relevant for a variety of physical settings. A general question is whether new phases, not present in the uncoupled limit, may arise. We use machine learning and a suitable quasidistance between different points of the phase diagram to study layered spin models, in which the spin variables constituting each of the uncoupled systems (to which we refer as layers) are coupled to each other via an interlayer coupling. In such systems, in general, composite order parameters involving spins of different layers may emerge as a consequence of the interlayer coupling. We focus on the layered Ising and Ashkin–Teller models as a paradigmatic case study, determining their phase diagram via the application of a machine learning algorithm to the Monte Carlo data. Remarkably our technique is able to correctly characterize all the system phases also in the case of hidden order parameters, i.e. order parameters whose expression in terms of the microscopic configurations would require additional preprocessing of the data fed to the algorithm. We correctly retrieve the three known phases of the Ashkin–Teller model with ferromagnetic couplings, including the phase described by a composite order parameter. For the bilayer and trilayer Ising models the phases we find are only the ferromagnetic and the paramagnetic ones. Within the approach we introduce, owing to the construction of convolutional neural networks, naturally suitable for layered image-like data with arbitrary number of layers, no preprocessing of the Monte Carlo data is needed, also with regard to its spatial structure. The physical meaning of our results is discussed and compared with analytical data, where available. Yet, the method can be used without any a priori knowledge of the phases one seeks to find and can be applied to other models and structures.

•Sep 1, 2020•9 citations
Recently, machine learning has been applied successfully for identifying phases and phase transitions of the Ising models. The continuous phase transition is characterized by spontaneous symmetry breaking, which can not be detected in general from a single spin configuration. To investigate if neural networks can extract correlations among spin snapshots, we propose a new test using the random-gauge Ising model. We show that neural networks can extract the order parameter or the energy of the random-gauge model as in the ferromagnetic case. We also discuss how and where the information of random gauge is encoded in neural networks and attempt to reconstruct the gauge from the neural network parameters. We find that the fully connected network encodes the effect of random gauge to its weights naturally. In contrast, the convolutional network copes with the randomness by assigning different network parts to local gauge patterns. This observation indicates that although the latter demonstrates higher performance than the former for the present randomized-gauge test, the former is more effective and suitable for dealing with models with spatial randomness.
Conventionally, the study of phases in statistical mechan- ics is performed with the help of random sampling tools. Among the most powerful are Monte Carlo simulations consisting of a stochastic importance sampling over state space and evaluation of estimators for physical quantities. The ability of modern machine learning techniques to classify, identify, or in- terpret massive data sets provides a complementary paradigm to the above approach to analyze the exponentially large number of states in statistical physics. In this report, it is demonstrated by application on Ising-type models that deep learning has potential wide applications in solving many-body statis- tical physics problems. In application of supervised learning, we showed that the feed-forward neural network can identify phases and phase transitions in the ferromagnetic Ising model and the convolutional neural network (CNN) is extremely powerful in classifying T = 0 and T = ∞ phases in the Ising gauge model; In application of unsupervised learning, we illustrated that a deep auto-encoder constructed by stacked restricted Boltzmann machines (RBM)\nis closely related to the renormalization group (RG) method well understood in modern physics and our reconstruction of Ising spin configurations in the ferromagnetic Ising model is similar to the hand-written digits reconstruction.
We investigate the performance of neural networks in identifying critical behaviour in the 2D Ising model with next-to-nearest neighbour interactions. We train DNN and CNN based classifiers on the Ising model configurations with nearest neighbour interactions and test the ability of our models to identify the critical (cross-over) region, as well as the phases in the presence of next-to-nearest neighbour interactions. Our main objective is to investigate whether our models can learn the notion of criticality and universality, in contrast to merely identifying the phases by simply learning the value of the order parameter, magnetization in this case. We design a simple adversarial training process which forces our models to ignore learning about the order parameter while training. We find that such models are able to identify critical region with reasonable success, implying that it has learned to identify the structure of spin-spin correlations near criticality.
We present a solution to the problem of interpreting neural networks classifying phases of matter. We devise a procedure for reconstructing the decision function of an artificial neural network as a simple function of the input, provided the decision function is sufficiently symmetric. In this case one can easily deduce the quantity by which the neural network classifies the input. The method is applied to the Ising model and SU(2) lattice gauge theory. In both systems we deduce the explicit expressions of the order parameters from the decision functions of the neural networks. We assume no prior knowledge about the Hamiltonian or the order parameters except Monte Carlo--sampled configurations.
Abstract Phase transitions play a central role in statistical physics and are well understood in systems at thermal equilibrium. However, their nonequilibrium counterparts remain less explored because of the lack of a unified theoretical framework. In this study, we examine the potential of deep learning, specially convolutional neural networks (CNN), to detect nonequilibrium phase transitions (NEPT) in a 2D Ising model-like square lattice ferromagnetic system under effective parameter h . Without this parameter ( h = 0 ), we generate equilibrium spin configurations using the standard Metropolis algorithm as usual. With h ≠ 0 , we generate nonequilibrium spin configurations using an effective Glauber update rule which breaks detailed balance. While the former is used to train CNN, the later is not subsequently described by the usual Boltzmann-Gibbs distribution rather used to test the model. The study shows that the trained CNN can distinguish between ordered and disordered nonequilibrium steady states and accurately predict the critical temperature of the system undergoing NEPT. Finite size scaling analysis of the model’s output (perdition) reproduces critical exponents that agree with theoretical expectations, indicating that this method provides a strong, data driven approach for examining nonequilibrium critical phenomena.
Determining the phase diagram of systems consisting of smaller subsystems 'connected' via a tunable coupling is a challenging task relevant for a variety of physical settings. A general question is whether new phases, not present in the uncoupled limit, may arise. We use machine learning and a suitable quasidistance between different points of the phase diagram to study layered spin models, in which the spin variables constituting each of the uncoupled systems (to which we refer as layers) are coupled to each other via an interlayer coupling. In such systems, in general, composite order parameters involving spins of different layers may emerge as a consequence of the interlayer coupling. We focus on the layered Ising and Ashkin–Teller models as a paradigmatic case study, determining their phase diagram via the application of a machine learning algorithm to the Monte Carlo data. Remarkably our technique is able to correctly characterize all the system phases also in the case of hidden order parameters, i.e. order parameters whose expression in terms of the microscopic configurations would require additional preprocessing of the data fed to the algorithm. We correctly retrieve the three known phases of the Ashkin–Teller model with ferromagnetic couplings, including the phase described by a composite order parameter. For the bilayer and trilayer Ising models the phases we find are only the ferromagnetic and the paramagnetic ones. Within the approach we introduce, owing to the construction of convolutional neural networks, naturally suitable for layered image-like data with arbitrary number of layers, no preprocessing of the Monte Carlo data is needed, also with regard to its spatial structure. The physical meaning of our results is discussed and compared with analytical data, where available. Yet, the method can be used without any a priori knowledge of the phases one seeks to find and can be applied to other models and structures.