arXiv:2206.15114 · Physical review. E

Learning by confusion approach to identification of discontinuous phase transitions

Monika Richter-Laskowska, Marcin Kurpas, Maciej M. Maśka

Published Aug 7, 2023• 16 citations

Abstract

Recently, the learning by confusion (LbC) approach has been proposed as a machine learning tool to determine the critical temperature T_{c} of phase transitions without any prior knowledge of its even approximate value. The method has been proven effective, but it has been used only for continuous phase transitions, where the confusion results only from deliberate incorrect labeling of the data. However, in the case of a discontinuous phase transition, additional confusion can result from the coexistence of different phases. To verify whether the confusion scheme can also be used for discontinuous phase transitions, we apply the LbC method to three microscopic models, the Blume-Capel, the q-state Potts, and the Falicov-Kimball models, which undergo continuous or discontinuous phase transitions depending on model parameters. With the help of a simple model, we predict that the phase coexistence present in discontinuous phase transitions can indeed make the neural network more confused and thus decrease its performance. However, numerical calculations performed for the models mentioned above indicate that other aspects of this kind of phase transition are more important and can render the LbC method even less effective. Nevertheless, we demonstrate that in some cases the same aspects allow us to use the LbC method to identify the order of a phase transition.

DOI: 10.1103/physreve.108.024113

Related papers

Confusion scheme in machine learning detects double phase transitions and quasi-long-range order

Song Sub Lee, Beom Jun Kim

Thanks to the development of machine learning techniques, it has been shown that the supervised learning can be useful to study critical phenomena of various systems. However, the supervised learning cannot be done without labels which require knowledge about critical behavior of the system. To overcome this barrier, unsupervised machine learning methods have been considered and the confusion scheme has been proposed. In this study, we use the confusion scheme of the unsupervised learning and investigate critical behavior of various systems which exhibit single (double) phase transitions with (without) quasi-long-range order. In detail, we choose the two-color Ashkin-Teller model, the XY model, and the eight-state clock model as such systems and snapshots of the spin configurations at various temperatures are collected via Monte Carlo simulations to be used as input data for the unsupervised machine learning. We also put focus on the size dependence of results and validate the availability of the confusion scheme in thermodynamic limit. Our results indicate that the confusion scheme of the unsupervised learning successfully locates the approximate transition points for all models and becomes more accurate as the system size is increased. We also find a characteristic feature of the result which reflects the presence of a quasi-long-range order. We conclude that regardless of the presence of a quasi-long-range order, single and double phase transitions can be detected via the confusion scheme.

Physical review. EApr 24, 201928 citations

Phase probabilities in first-order transitions using machine learning

Diana Sukhoverkhova, Vyacheslav Mozolenko, Щур Лев Николаевич

We set out to explore the possibility of investigating the critical behavior of systems with first-order phase transition using deep machine learning. We propose a machine learning protocol with ternary classification of instantaneous spin configurations using known values of disordered phase energy and ordered phase energy. The trained neural network is used to predict whether a given sample belong to one or another phase of matter. This allows us to estimate for the first time the probability that configurations with a certain energy belong to the ordered phase, coexistence phase, and disordered phase. Based on these probabilities, we obtained estimates of the values of the critical energies and latent heat for the Potts model with 10 and 20 components, which undergoes a strong discontinuous transition. We also found that the probabilities may reflect geometric transitions in the coexistence phase.

arXiv:2411.00733Physical review. ESep 12, 20252 citations

Parameter diagnostics of phases and phase transition learning by neural networks

Philippe Suchsland, Stefan Weßel

We present an analysis of neural network-based machine learning schemes for phases and phase transitions in theoretical condensed matter research, focusing on neural networks with a single hidden layer. Such shallow neural networks were previously found to be efficient in classifying phases and locating phase transitions of various basic model systems. In order to rationalize the emergence of the classification process and for identifying any underlying physical quantities, it is feasible to examine the weight matrices and the convolutional filter kernels that result from the learning process of such shallow networks. Furthermore, we demonstrate how the learning-by-confusing scheme can be used, in combination with a simple threshold-value classification method, to diagnose the learning parameters of neural networks. In particular, we study the classification process of both fully-connected and convolutional neural networks for the two-dimensional Ising model with extended domain wall configurations included in the low-temperature regime. Moreover, we consider the two-dimensional XY model and contrast the performance of the learning-by-confusing scheme and convolutional neural networks trained on bare spin configurations to the case of preprocessed samples with respect to vortex configurations. We discuss these findings in relation to similar recent investigations and possible further applications.

arXiv:1802.09876Physical review. B./Physical review. BMay 31, 201878 citations

Unsupervised machine learning for identifying phase transition using two-times clustering

Nan Wu, Zhuohan Li, Wanzhou Zhang

In recent years, developing unsupervised machine learning for identifying phase transition is a research direction. In this paper, we introduce a two-times clustering method that can help select perfect configurations from a set of degenerate samples and assign the configuration with labels in a manner of unsupervised machine learning. These perfect configurations can then be used to train a neural network to classify phases. The derivatives of the predicted classification in the phase diagram, show peaks at the phase transition points. The effectiveness of our method is tested for the Ising, Potts, and Blume-Capel models. By using the ordered configuration from two-times clustering, our method can provide a useful way to obtain phase diagrams.

arXiv:2305.17687May 28, 20230 citations

Three-Phase Confusion Learning

Filippo Caleca, Simone Tibaldi, Elisa Ercolessi

The use of Neural Networks in quantum many-body theory has undergone a formidable rise in recent years. Among the many possible applications, their pattern recognition power can be utilized when dealing with the study of equilibrium phase diagrams. Learning by Confusion has emerged as an interesting and unbiased scheme within this context. This technique involves systematically reassigning labels to the data in various ways, followed by training and testing the Neural Network. While random labeling results in low accuracy, the method reveals a peak in accuracy when the data are correctly and meaningfully partitioned, even if the correct labeling is initially unknown. Here, we propose a generalization of this confusion scheme for systems with more than two phases, for which it was originally proposed. Our construction relies on the use of a slightly different Neural Network: from a binary classifier, we move to a ternary one, which is more suitable to detect systems exhibiting three phases. After introducing this construction, we test it on free and interacting Kitaev chains and on the one-dimensional Extended Hubbard model, consistently achieving results that are compatible with previous works. Our work opens the way to wider use of Learning by Confusion, demonstrating once more the usefulness of Machine Learning to address quantum many-body problems.

EntropyFeb 14, 20250 citations

Transfer and confusion deep learning in frustrated spin systems

Inés Corte, Santiago Acevedo, Marcelo Arlego +1 more

The transfer learning of a neural network is one of its most outstanding aspects, and has given supervised learning with neural networks a prominent place in data science. Here we explore this feature in the context of strongly interacting many-body systems. By means of case studies, we show the potential of this deep learning technique to detect phases and their transitions in frustrated spin systems, using dense and convolutional neural networks. In addition, we explore a recently-introduced technique, which is at the middle point of supervised and unsupervised learning. It consists in evaluating the performance of a neural network which has been deliberately 'confused' during its training. To properly demonstrate the capability of the 'confusion' and transfer learning techniques, we apply them to a paradigmatic model of frustrated magnetism in two dimensions, to determine its phase diagram and compare it with high-performance Monte Carlo simulations.

Sep 1, 20202 citations