Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Transfer and confusion deep learning in frustrated spin systems

Inés Corte, Santiago Acevedo, Marcelo Arlego, Carlos Alberto Lamas

Published Sep 1, 2020• 2 citations
OpenAlex

Abstract

The transfer learning of a neural network is one of its most outstanding aspects, and has given supervised learning with neural networks a prominent place in data science. Here we explore this feature in the context of strongly interacting many-body systems. By means of case studies, we show the potential of this deep learning technique to detect phases and their transitions in frustrated spin systems, using dense and convolutional neural networks. In addition, we explore a recently-introduced technique, which is at the middle point of supervised and unsupervised learning. It consists in evaluating the performance of a neural network which has been deliberately 'confused' during its training. To properly demonstrate the capability of the 'confusion' and transfer learning techniques, we apply them to a paradigmatic model of frustrated magnetism in two dimensions, to determine its phase diagram and compare it with high-performance Monte Carlo simulations.

Related papers

Learning by confusion: The phase diagram of the Holstein model

George Issa, Owen Bradley, Ehsan Khatami +1 more

We employ the ``learning by confusion'' technique, an unsupervised machine learning approach for detecting phase transitions, to analyze quantum Monte Carlo simulations of the two-dimensional Holstein model---a fundamental model for electron-phonon interactions on a lattice. Utilizing a convolutional neural network, we conduct a series of binary classification tasks to identify Holstein critical points based on the neural network's learning accuracy. We further evaluate the effectiveness of various training datasets, including snapshots of phonon fields and other measurements resolved in imaginary time, for predicting distinct phase transitions and crossovers. Our results culminate in the construction of the finite-temperature phase diagram of the Holstein model.

arXiv:2501.04681•Physical review. B./Physical review. B•Apr 23, 2025•7 citations

Quantum phase recognition via unsupervised machine learning

Peter Broecker, Fakher F. Assaad, Simon Trebst

The application of state-of-the-art machine learning techniques to statistical physic problems has seen a surge of interest for their ability to discriminate phases of matter by extracting essential features in the many-body wavefunction or the ensemble of correlators sampled in Monte Carlo simulations. Here we introduce a gener- alization of supervised machine learning approaches that allows to accurately map out phase diagrams of inter- acting many-body systems without any prior knowledge, e.g. of their general topology or the number of distinct phases. To substantiate the versatility of this approach, which combines convolutional neural networks with quantum Monte Carlo sampling, we map out the phase diagrams of interacting boson and fermion models both at zero and finite temperatures and show that first-order, second-order, and Kosterlitz-Thouless phase transitions can all be identified. We explicitly demonstrate that our approach is capable of identifying the phase transition to non-trivial many-body phases such as superfluids or topologically ordered phases without supervision.

arXiv:1707.00663•Jul 3, 2017•53 citations

Three-Phase Confusion Learning

Filippo Caleca, Simone Tibaldi, Elisa Ercolessi

The use of Neural Networks in quantum many-body theory has undergone a formidable rise in recent years. Among the many possible applications, their pattern recognition power can be utilized when dealing with the study of equilibrium phase diagrams. Learning by Confusion has emerged as an interesting and unbiased scheme within this context. This technique involves systematically reassigning labels to the data in various ways, followed by training and testing the Neural Network. While random labeling results in low accuracy, the method reveals a peak in accuracy when the data are correctly and meaningfully partitioned, even if the correct labeling is initially unknown. Here, we propose a generalization of this confusion scheme for systems with more than two phases, for which it was originally proposed. Our construction relies on the use of a slightly different Neural Network: from a binary classifier, we move to a ternary one, which is more suitable to detect systems exhibiting three phases. After introducing this construction, we test it on free and interacting Kitaev chains and on the one-dimensional Extended Hubbard model, consistently achieving results that are compatible with previous works. Our work opens the way to wider use of Learning by Confusion, demonstrating once more the usefulness of Machine Learning to address quantum many-body problems.

Entropy•Feb 14, 2025•0 citations

Machine learning phases in statistical physics

Qi Chen

Conventionally, the study of phases in statistical mechan- ics is performed with the help of random sampling tools. Among the most powerful are Monte Carlo simulations consisting of a stochastic importance sampling over state space and evaluation of estimators for physical quantities. The ability of modern machine learning techniques to classify, identify, or in- terpret massive data sets provides a complementary paradigm to the above approach to analyze the exponentially large number of states in statistical physics. In this report, it is demonstrated by application on Ising-type models that deep learning has potential wide applications in solving many-body statis- tical physics problems. In application of supervised learning, we showed that the feed-forward neural network can identify phases and phase transitions in the ferromagnetic Ising model and the convolutional neural network (CNN) is extremely powerful in classifying T = 0 and T = ∞ phases in the Ising gauge model; In application of unsupervised learning, we illustrated that a deep auto-encoder constructed by stacked restricted Boltzmann machines (RBM)\nis closely related to the renormalization group (RG) method well understood in modern physics and our reconstruction of Ising spin configurations in the ferromagnetic Ising model is similar to the hand-written digits reconstruction.

•Jan 1, 2017•0 citations

3-phases Confusion Learning

Filippo Caleca, Simone Tibaldi, Elisa Ercolessi

The use of Neural Networks in quantum many-body theory has seen a formidable rise in recent years. Among the many possible applications, one surely is to make use of their pattern recognition power when dealing with the study of equilibrium phase diagram. Within this context, Learning by Confusion has emerged as an interesting, unbiased scheme. The idea behind it briefly consists in iteratively label numerical results in a random way and then train and test a Neural Network; while for a generic random labeling the Network displays low accuracy, the latter shall display a peak when data are divided into a correct, yet unknown way. Here, we propose a generalization of this confusion scheme for systems with more than two phases, for which it was originally proposed. Our construction simply relies on the use of a slightly different Neural Network: from a binary classificator we move to a ternary one, more suitable to detect systems exhibiting three phases. After introducing this construction, we test is onto the free and the interacting Kitaev chain and on the one-dimensional Extended Hubbard model, always finding results compatible with previous works. Our work opens the way to wider use of Learning by Confusion, showing once more the usefulness of Machine Learning to address quantum many-body problems.

arXiv:2412.02458•Dec 3, 2024•0 citations

Transfer learning of phase transitions in percolation and directed percolation

Jianmin Shen, Feiyi Liu, Shiyang Chen +6 more

The latest advances of statistical physics have shown remarkable performance of machine learning in identifying phase transitions. In this paper, we apply domain adversarial neural network (DANN) based on transfer learning to studying nonequilibrium and equilibrium phase transition models, which are percolation model and directed percolation (DP) model, respectively. With the DANN, only a small fraction of input configurations (two-dimensional images) needs to be labeled, which is automatically chosen, to capture the critical point. To learn the DP model, the method is refined by an iterative procedure in determining the critical point, which is a prerequisite for the data collapse in calculating the critical exponent ν_{⊥}. We then apply the DANN to a two-dimensional site percolation with configurations filtered to include only the largest cluster which may contain the information related to the order parameter. The DANN learning of both models yields reliable results which are comparable to the ones from Monte Carlo simulations. Our study also shows that the DANN can achieve quite high accuracy at much lower cost, compared to the supervised learning.

arXiv:2112.15516•Physical review. E•Jun 30, 2022•17 citations
The transfer learning of a neural network is one of its most outstanding aspects, and has given supervised learning with neural networks a prominent place in data science. Here we explore this feature in the context of strongly interacting many-body systems. By means of case studies, we show the potential of this deep learning technique to detect phases and their transitions in frustrated spin systems, using dense and convolutional neural networks. In addition, we explore a recently-introduced technique, which is at the middle point of supervised and unsupervised learning. It consists in evaluating the performance of a neural network which has been deliberately 'confused' during its training. To properly demonstrate the capability of the 'confusion' and transfer learning techniques, we apply them to a paradigmatic model of frustrated magnetism in two dimensions, to determine its phase diagram and compare it with high-performance Monte Carlo simulations.
We employ the ``learning by confusion'' technique, an unsupervised machine learning approach for detecting phase transitions, to analyze quantum Monte Carlo simulations of the two-dimensional Holstein model---a fundamental model for electron-phonon interactions on a lattice. Utilizing a convolutional neural network, we conduct a series of binary classification tasks to identify Holstein critical points based on the neural network's learning accuracy. We further evaluate the effectiveness of various training datasets, including snapshots of phonon fields and other measurements resolved in imaginary time, for predicting distinct phase transitions and crossovers. Our results culminate in the construction of the finite-temperature phase diagram of the Holstein model.
The application of state-of-the-art machine learning techniques to statistical physic problems has seen a surge of interest for their ability to discriminate phases of matter by extracting essential features in the many-body wavefunction or the ensemble of correlators sampled in Monte Carlo simulations. Here we introduce a gener- alization of supervised machine learning approaches that allows to accurately map out phase diagrams of inter- acting many-body systems without any prior knowledge, e.g. of their general topology or the number of distinct phases. To substantiate the versatility of this approach, which combines convolutional neural networks with quantum Monte Carlo sampling, we map out the phase diagrams of interacting boson and fermion models both at zero and finite temperatures and show that first-order, second-order, and Kosterlitz-Thouless phase transitions can all be identified. We explicitly demonstrate that our approach is capable of identifying the phase transition to non-trivial many-body phases such as superfluids or topologically ordered phases without supervision.
The use of Neural Networks in quantum many-body theory has undergone a formidable rise in recent years. Among the many possible applications, their pattern recognition power can be utilized when dealing with the study of equilibrium phase diagrams. Learning by Confusion has emerged as an interesting and unbiased scheme within this context. This technique involves systematically reassigning labels to the data in various ways, followed by training and testing the Neural Network. While random labeling results in low accuracy, the method reveals a peak in accuracy when the data are correctly and meaningfully partitioned, even if the correct labeling is initially unknown. Here, we propose a generalization of this confusion scheme for systems with more than two phases, for which it was originally proposed. Our construction relies on the use of a slightly different Neural Network: from a binary classifier, we move to a ternary one, which is more suitable to detect systems exhibiting three phases. After introducing this construction, we test it on free and interacting Kitaev chains and on the one-dimensional Extended Hubbard model, consistently achieving results that are compatible with previous works. Our work opens the way to wider use of Learning by Confusion, demonstrating once more the usefulness of Machine Learning to address quantum many-body problems.
Conventionally, the study of phases in statistical mechan- ics is performed with the help of random sampling tools. Among the most powerful are Monte Carlo simulations consisting of a stochastic importance sampling over state space and evaluation of estimators for physical quantities. The ability of modern machine learning techniques to classify, identify, or in- terpret massive data sets provides a complementary paradigm to the above approach to analyze the exponentially large number of states in statistical physics. In this report, it is demonstrated by application on Ising-type models that deep learning has potential wide applications in solving many-body statis- tical physics problems. In application of supervised learning, we showed that the feed-forward neural network can identify phases and phase transitions in the ferromagnetic Ising model and the convolutional neural network (CNN) is extremely powerful in classifying T = 0 and T = ∞ phases in the Ising gauge model; In application of unsupervised learning, we illustrated that a deep auto-encoder constructed by stacked restricted Boltzmann machines (RBM)\nis closely related to the renormalization group (RG) method well understood in modern physics and our reconstruction of Ising spin configurations in the ferromagnetic Ising model is similar to the hand-written digits reconstruction.
The use of Neural Networks in quantum many-body theory has seen a formidable rise in recent years. Among the many possible applications, one surely is to make use of their pattern recognition power when dealing with the study of equilibrium phase diagram. Within this context, Learning by Confusion has emerged as an interesting, unbiased scheme. The idea behind it briefly consists in iteratively label numerical results in a random way and then train and test a Neural Network; while for a generic random labeling the Network displays low accuracy, the latter shall display a peak when data are divided into a correct, yet unknown way. Here, we propose a generalization of this confusion scheme for systems with more than two phases, for which it was originally proposed. Our construction simply relies on the use of a slightly different Neural Network: from a binary classificator we move to a ternary one, more suitable to detect systems exhibiting three phases. After introducing this construction, we test is onto the free and the interacting Kitaev chain and on the one-dimensional Extended Hubbard model, always finding results compatible with previous works. Our work opens the way to wider use of Learning by Confusion, showing once more the usefulness of Machine Learning to address quantum many-body problems.
The latest advances of statistical physics have shown remarkable performance of machine learning in identifying phase transitions. In this paper, we apply domain adversarial neural network (DANN) based on transfer learning to studying nonequilibrium and equilibrium phase transition models, which are percolation model and directed percolation (DP) model, respectively. With the DANN, only a small fraction of input configurations (two-dimensional images) needs to be labeled, which is automatically chosen, to capture the critical point. To learn the DP model, the method is refined by an iterative procedure in determining the critical point, which is a prerequisite for the data collapse in calculating the critical exponent ν_{⊥}. We then apply the DANN to a two-dimensional site percolation with configurations filtered to include only the largest cluster which may contain the information related to the order parameter. The DANN learning of both models yields reliable results which are comparable to the ones from Monte Carlo simulations. Our study also shows that the DANN can achieve quite high accuracy at much lower cost, compared to the supervised learning.