Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1708.03350 · Physical review. E

Unsupervised machine learning account of magnetic transitions in the Hubbard model

Kelvin Ch’ng, Nick Vazquez, Ehsan Khatami

Published Jan 16, 2018• 147 citations
arXivHTMLPDF

Abstract

We employ several unsupervised machine learning techniques, including autoencoders, random trees embedding, and t-distributed stochastic neighboring ensemble (t-SNE), to reduce the dimensionality of, and therefore classify, raw (auxiliary) spin configurations generated, through Monte Carlo simulations of small clusters, for the Ising and Fermi-Hubbard models at finite temperatures. Results from a convolutional autoencoder for the three-dimensional Ising model can be shown to produce the magnetization and the susceptibility as a function of temperature with a high degree of accuracy. Quantum fluctuations distort this picture and prevent us from making such connections between the output of the autoencoder and physical observables for the Hubbard model. However, we are able to define an indicator based on the output of the t-SNE algorithm that shows a near perfect agreement with the antiferromagnetic structure factor of the model in two and three spatial dimensions in the weak-coupling regime. t-SNE also predicts a transition to the canted antiferromagnetic phase for the three-dimensional model when a strong magnetic field is present. We show that these techniques cannot be expected to work away from half filling when the "sign problem" in quantum Monte Carlo simulations is present.

DOI
10.1103/physreve.97.013306

Related papers

Unsupervised Machine Learning Method for the Phase Behavior of the Constant Magnetization Ising Model in Two and Three Dimensions

In-Hyuk Jang, Arun Yethiraj

Machine learning methods have been important in the study of phase transitions. Unsupervised methods are particularly attractive because they do not require prior knowledge of the existence of a phase transition. In this work we focus on the constant magnetization Ising model in two (2D) and three (3D) dimensions. While there have been many studies using machine learning for the critical behavior of these systems, we are not aware of any studies for the phase diagram at off-critical magnetizations below the critical temperature. Previous work has used the raw spins as the input feature. We show that a more robust input feature is the local affinity, where the value of the feature at each site is determined by the spin and its neighbors. When coupled with a variational autoencoder, the method is able to predict the phase behavior of the 2D and 3D Ising models (including the critical exponent β) in quantitative agreement with conventional simulations. The choice of activation functions in the autoencoder is crucial, and this requires physical insight into the nature of the phase transition. The method is general and can be applied to any lattice or off-lattice system.

The Journal of Physical Chemistry B•Dec 26, 2024•6 citations

Unsupervised identification of the phase transition on the 2D-Ising model

Constantia Alexandrou, Andreas Athenodorou, Charalambos Chrysostomou +1 more

We investigate deep learning autoencoders for the unsupervised recognition of phase transitions in physical systems formulated on a lattice. We use spin configurations produced for the 2-dimensional ferromagnetic Ising model in zero external magnetic field. We study numerically the relation between one latent dimension extracted from the autoencoder to the critical temperature $T_c$. The autoencoder reveals the two phases, one for which the spins are ordered and the other for which spins are disordered, reflecting the restoration of the $\mathbb{Z}_2$ symmetry as the temperature increases. For the largest volume studied, the transition between the two phases occurs very close to the theoretically extracted critical temperature. We define as a quasi-order parameter the absolute average latent dimension ${\tilde z}$, which enables us to predict the critical temperature. We show that one can build the latent susceptibility and use it to quantify the value of the critical temperature $T_c(L)$ at different lattice sizes and that these values suffer from only small finite scaling effects. We demonstrate that $T_c(L)$ extrapolates to the known theoretical value as $L \to \infty$ suggesting that the autoencoder can also be used to extract the critical temperature of the phase transition to an adequate precision.

•Mar 8, 2019•6 citations

Principal component analysis of the magnetic transition in the three-dimensional Fermi-Hubbard model

Ehsan Khatami

Abstract Machine learning techniques have been widely used in the study of strongly correlated systems in recent years. Here, we review some applications to classical and quantum many-body systems and present results from an unsupervised machine learning technique, the principal component analysis, employed to identify the finite-temperature phase transition of the three-dimensional Fermi-Hubbard model to the antiferromagnetically ordered state. We find that this linear method can capture the phase transition as well as other more complicated and nonlinear counterparts.

Journal of Physics Conference Series•Oct 1, 2019•5 citations

Phase diagram study of a two-dimensional frustrated antiferromagnet via unsupervised machine learning

Santiago Acevedo, Marcelo Arlego, Carlos Alberto Lamas

We apply unsupervised learning techniques to classify the different phases of the ${J}_{1}\text{\ensuremath{-}}{J}_{2}$ antiferromagnetic Ising model on the honeycomb lattice. We construct the phase diagram of the system using convolutional autoencoders. These neural networks can detect phase transitions in the system via ``anomaly detection'' without the need for any label or a priori knowledge of the phases. We present different ways of training these autoencoders, and we evaluate them to discriminate between distinct magnetic phases. In this process, we highlight the case of high-temperature or even random training data. Finally, we analyze the capability of the autoencoder to detect the ground state degeneracy through the reconstruction error.

arXiv:2101.10161•Physical review. B./Physical review. B•Apr 15, 2021•35 citations

Unsupervised learning the phase diagram of frustrated Ising models

Danilo Rodrigues de Assis Elias, Enzo Granato, Maurice de Koning

We assess the quality of a set of machine-learning (ML) techniques for the prediction of the phase diagrams of two frustrated 2D Ising models with competing interactions, that feature phase transitions characterized by critical manifolds rather than a single critical point. Using raw Monte Carlo spin configurations generated for random system parameters, we apply principal-component analysis (PCA) and auto-encoders to achieve dimensionality reduction, followed by clustering using the DBSCAN method and a support-vector machine classifier. The resulting estimates for the critical manifolds of both systems are in excellent agreement with available exact results, with the auto-encoders leading to quantitatively superior results. Notably, both the structure of the optimized auto-encoder as well its corresponding dimensionality-reduced and clustered space correlate with fundamental physical characteristics of the systems under consideration, which is useful when \emph{a priori} theoretical insight is unavailable.

•Dec 21, 2020•0 citations

Machine Learning techniques applied to the statistical properties of spin systems

Matteo Ferraretto

In recent years Machine Learning has proved to be successful in many technological applications and scientific tasks, such as image and speech recognition, natural language understanding and more. In this work we apply both supervised and unsupervised Machine Learning to three key problems in statistical physics: design of Hamiltonian from data, phase recognition and study of critical properties of a system undergoing phase transition. As an example of model design, we use a dataset with spin configurations and corresponding energies randomly sampled from a one dimensional Ising model. We then make two guesses for the correct Hamiltonian: the former involving interactions of spins with an external local field, the latter involving two body interactions among spins. The coupling constants are determined with a linear penalized regression, comparing the effects of L1 and L2 penalization terms of the cost function. We pay specific attention to the problem of overfitting and to the validation process, which is critical for accepting or rejecting the proposed model. The phase recognition problem is faced with the two dimensional Ising and XY models as examples. After showing the limits of a simple softmax regression for this task, we build suitable neural networks to overcome these limits. In particular, a feed forward network is built and the learning process is investigated for the Ising model; while a more sophisticated convolutional network is proposed for the XY model in order to detect local topological structures. The last part of the work is dedicated to the unsupervised study of phase transitions, and the determination of critical properties (order parameter, critical temperature, critical exponents). The discussed techniques are Principal Component Analysis (PCA) for dimensional reduction and K-means clustering for organizing data into subsets with specific properties. PCA is applied to the two dimensional Ising, Potts and XY models, and it is used to find suitable order parameters. The study of the proposed order parameter as a function of temperature provides evidence of phase transition, and a finite size scaling allows to extrapolate both the critical temperature in the thermodynamic limit, and the $\nu$ critical exponent for the correlation length. K-means clustering is applied to equilibrium configurations of the two dimensional Ising model, before and after the dimensional reduction, and the critical temperature is estimated. Moreover, a clustering of relaxation curves of magnetization in a Monte Carlo dynamics is used to build a phase diagram on the parameter space of temperature and magnetic field. A synergy of C++, Python and Wolfram Mathematica 12.0 is used throughout this work in order to sample input datasets and to build and control customized neural networks and learning tools. The most relevant codes are provided in the appendix.

•Oct 14, 2019•0 citations
We employ several unsupervised machine learning techniques, including autoencoders, random trees embedding, and t-distributed stochastic neighboring ensemble (t-SNE), to reduce the dimensionality of, and therefore classify, raw (auxiliary) spin configurations generated, through Monte Carlo simulations of small clusters, for the Ising and Fermi-Hubbard models at finite temperatures. Results from a convolutional autoencoder for the three-dimensional Ising model can be shown to produce the magnetization and the susceptibility as a function of temperature with a high degree of accuracy. Quantum fluctuations distort this picture and prevent us from making such connections between the output of the autoencoder and physical observables for the Hubbard model. However, we are able to define an indicator based on the output of the t-SNE algorithm that shows a near perfect agreement with the antiferromagnetic structure factor of the model in two and three spatial dimensions in the weak-coupling regime. t-SNE also predicts a transition to the canted antiferromagnetic phase for the three-dimensional model when a strong magnetic field is present. We show that these techniques cannot be expected to work away from half filling when the "sign problem" in quantum Monte Carlo simulations is present.
Machine learning methods have been important in the study of phase transitions. Unsupervised methods are particularly attractive because they do not require prior knowledge of the existence of a phase transition. In this work we focus on the constant magnetization Ising model in two (2D) and three (3D) dimensions. While there have been many studies using machine learning for the critical behavior of these systems, we are not aware of any studies for the phase diagram at off-critical magnetizations below the critical temperature. Previous work has used the raw spins as the input feature. We show that a more robust input feature is the local affinity, where the value of the feature at each site is determined by the spin and its neighbors. When coupled with a variational autoencoder, the method is able to predict the phase behavior of the 2D and 3D Ising models (including the critical exponent β) in quantitative agreement with conventional simulations. The choice of activation functions in the autoencoder is crucial, and this requires physical insight into the nature of the phase transition. The method is general and can be applied to any lattice or off-lattice system.
We investigate deep learning autoencoders for the unsupervised recognition of phase transitions in physical systems formulated on a lattice. We use spin configurations produced for the 2-dimensional ferromagnetic Ising model in zero external magnetic field. We study numerically the relation between one latent dimension extracted from the autoencoder to the critical temperature TcT_cTc​. The autoencoder reveals the two phases, one for which the spins are ordered and the other for which spins are disordered, reflecting the restoration of the Z2\mathbb{Z}_2Z2​ symmetry as the temperature increases. For the largest volume studied, the transition between the two phases occurs very close to the theoretically extracted critical temperature. We define as a quasi-order parameter the absolute average latent dimension z~{\tilde z}z~, which enables us to predict the critical temperature. We show that one can build the latent susceptibility and use it to quantify the value of the critical temperature Tc(L)T_c(L)Tc​(L) at different lattice sizes and that these values suffer from only small finite scaling effects. We demonstrate that Tc(L)T_c(L)Tc​(L) extrapolates to the known theoretical value as L→∞L \to \inftyL→∞ suggesting that the autoencoder can also be used to extract the critical temperature of the phase transition to an adequate precision.
Abstract Machine learning techniques have been widely used in the study of strongly correlated systems in recent years. Here, we review some applications to classical and quantum many-body systems and present results from an unsupervised machine learning technique, the principal component analysis, employed to identify the finite-temperature phase transition of the three-dimensional Fermi-Hubbard model to the antiferromagnetically ordered state. We find that this linear method can capture the phase transition as well as other more complicated and nonlinear counterparts.
We apply unsupervised learning techniques to classify the different phases of the ${J}_{1}\text{\ensuremath{-}}{J}_{2}$ antiferromagnetic Ising model on the honeycomb lattice. We construct the phase diagram of the system using convolutional autoencoders. These neural networks can detect phase transitions in the system via ``anomaly detection'' without the need for any label or a priori knowledge of the phases. We present different ways of training these autoencoders, and we evaluate them to discriminate between distinct magnetic phases. In this process, we highlight the case of high-temperature or even random training data. Finally, we analyze the capability of the autoencoder to detect the ground state degeneracy through the reconstruction error.
We assess the quality of a set of machine-learning (ML) techniques for the prediction of the phase diagrams of two frustrated 2D Ising models with competing interactions, that feature phase transitions characterized by critical manifolds rather than a single critical point. Using raw Monte Carlo spin configurations generated for random system parameters, we apply principal-component analysis (PCA) and auto-encoders to achieve dimensionality reduction, followed by clustering using the DBSCAN method and a support-vector machine classifier. The resulting estimates for the critical manifolds of both systems are in excellent agreement with available exact results, with the auto-encoders leading to quantitatively superior results. Notably, both the structure of the optimized auto-encoder as well its corresponding dimensionality-reduced and clustered space correlate with fundamental physical characteristics of the systems under consideration, which is useful when \emph{a priori} theoretical insight is unavailable.
In recent years Machine Learning has proved to be successful in many technological applications and scientific tasks, such as image and speech recognition, natural language understanding and more. In this work we apply both supervised and unsupervised Machine Learning to three key problems in statistical physics: design of Hamiltonian from data, phase recognition and study of critical properties of a system undergoing phase transition. As an example of model design, we use a dataset with spin configurations and corresponding energies randomly sampled from a one dimensional Ising model. We then make two guesses for the correct Hamiltonian: the former involving interactions of spins with an external local field, the latter involving two body interactions among spins. The coupling constants are determined with a linear penalized regression, comparing the effects of L1 and L2 penalization terms of the cost function. We pay specific attention to the problem of overfitting and to the validation process, which is critical for accepting or rejecting the proposed model. The phase recognition problem is faced with the two dimensional Ising and XY models as examples. After showing the limits of a simple softmax regression for this task, we build suitable neural networks to overcome these limits. In particular, a feed forward network is built and the learning process is investigated for the Ising model; while a more sophisticated convolutional network is proposed for the XY model in order to detect local topological structures. The last part of the work is dedicated to the unsupervised study of phase transitions, and the determination of critical properties (order parameter, critical temperature, critical exponents). The discussed techniques are Principal Component Analysis (PCA) for dimensional reduction and K-means clustering for organizing data into subsets with specific properties. PCA is applied to the two dimensional Ising, Potts and XY models, and it is used to find suitable order parameters. The study of the proposed order parameter as a function of temperature provides evidence of phase transition, and a finite size scaling allows to extrapolate both the critical temperature in the thermodynamic limit, and the ν\nuν critical exponent for the correlation length. K-means clustering is applied to equilibrium configurations of the two dimensional Ising model, before and after the dimensional reduction, and the critical temperature is estimated. Moreover, a clustering of relaxation curves of magnetization in a Monte Carlo dynamics is used to build a phase diagram on the parameter space of temperature and magnetic field. A synergy of C++, Python and Wolfram Mathematica 12.0 is used throughout this work in order to sample input datasets and to build and control customized neural networks and learning tools. The most relevant codes are provided in the appendix.