Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1705.09524

Towards meaningful physics from generative models

M. Cristoforetti, Giuseppe Jurman, Andrea I. Nardelli, Cesare Furlanello

Published May 26, 2017• 15 citations
arXivHTMLPDF

Abstract

In several physical systems, important properties characterizing the system itself are theoretically related with specific degrees of freedom. Although standard Monte Carlo simulations provide an effective tool to accurately reconstruct the physical configurations of the system, they are unable to isolate the different contributions corresponding to different degrees of freedom. Here we show that unsupervised deep learning can become a valid support to MC simulation, coupling useful insights in the phases detection task with good reconstruction performance. As a testbed we consider the 2D XY model, showing that a deep neural network based on variational autoencoders can detect the continuous Kosterlitz-Thouless (KT) transitions, and that, if endowed with the appropriate constrains, they generate configurations with meaningful physical content.

DOI
10.48550/arxiv.1705.09524

Related papers

Continuous-Mixture Autoregressive Networks Learning the Kosterlitz-Thouless Transition

Lingxiao Wang, Yin Jiang, Lianyi He +1 more

We develop deep autoregressive networks with multi channels to compute many-body systems with continuous spin degrees of freedom directly. As a concrete example, we demonstrate the two-dimensional XY model with the continuous-mixture networks and rediscover the Kosterlitz–Thouless (KT) phase transition on a periodic square lattice. Vortices characterizing the quasi-long range order are accurately detected by the generative model. By learning the microscopic probability distributions from the macroscopic thermal distribution, the networks are trained as an efficient physical sampler which can approximate the free energy and estimate thermodynamic observables unbiasedly with importance sampling. As a more precise evaluation, we compute the helicity modulus to determine the KT transition temperature. Although the training process becomes more time-consuming with larger lattice sizes, the training time remains unchanged around the KT transition temperature. The continuous-mixture autoregressive networks we developed thus can be potentially used to study other many-body systems with continuous degrees of freedom.

arXiv:2005.04857•Chinese Physics Letters•Nov 21, 2022•19 citations

Variational Autoencoder Reconstruction of Complex Many-Body Physics

I. A. Luchnikov, Alexander Ryzhov, Pieter-Jan Stas +2 more

Thermodynamics is a theory of principles that permits a basic description of the macroscopic properties of a rich variety of complex systems from traditional ones, such as crystalline solids, gases, liquids, and thermal machines, to more intricate systems such as living organisms and black holes to name a few. Physical quantities of interest, or equilibrium state variables, are linked together in equations of state to give information on the studied system, including phase transitions, as energy in the forms of work and heat, and/or matter are exchanged with its environment, thus generating entropy. A more accurate description requires different frameworks, namely, statistical mechanics and quantum physics to explore in depth the microscopic properties of physical systems and relate them to their macroscopic properties. These frameworks also allow to go beyond equilibrium situations. Given the notably increasing complexity of mathematical models to study realistic systems, and their coupling to their environment that constrains their dynamics, both analytical approaches and numerical methods that build on these models show limitations in scope or applicability. On the other hand, machine learning, i.e., data-driven, methods prove to be increasingly efficient for the study of complex quantum systems. Deep neural networks, in particular, have been successfully applied to many-body quantum dynamics simulations and to quantum matter phase characterization. In the present work, we show how to use a variational autoencoder (VAE)—a state-of-the-art tool in the field of deep learning for the simulation of probability distributions of complex systems. More precisely, we transform a quantum mechanical problem of many-body state reconstruction into a statistical problem, suitable for VAE, by using informationally complete positive operator-valued measure. We show, with the paradigmatic quantum Ising model in a transverse magnetic field, that the ground-state physics, such as, e.g., magnetization and other mean values of observables, of a whole class of quantum many-body systems can be reconstructed by using VAE learning of tomographic data for different parameters of the Hamiltonian, and even if the system undergoes a quantum phase transition. We also discuss challenges related to our approach as entropy calculations pose particular difficulties.

arXiv:1910.03957•Entropy•Nov 7, 2019•39 citations

Learning thermodynamics and topological order of the 2D XY model with generative real-valued restricted Boltzmann machines

Kai Zhang

Detecting the topological Kosterlitz-Thouless (KT) transition in the prototypical 2D XY model using unsupervised machine learning methods has long been a challenging problem due to the lack of suitable order parameters. To address this issue, we begin with a conventional real-valued RBM (RBM-xy), which uses exponential conditional probabilities to generate visible units. We then develop a novel real-valued RBM (RBM-CosSin) featuring nonlinear cos/sin activation, whose visible units follow the von Mises distribution. Our findings reveal that RBM-CosSin effectively learns the underlying Boltzmann distribution of 2D XY systems and generate authentic XY configurations that accurately capture both thermodynamics and topological order (vortex). Furthermore, we demonstrate that it is possible to extract phase transition information, including the KT transition, from the weight matrices without relying on prior physics knowledge.

arXiv:2409.20377•Sep 30, 2024•0 citations

Learning thermodynamics and topological order of the two-dimensional XY model with generative real-valued restricted Boltzmann machines

Kai Zhang

Detecting the topological Kosterlitz-Thouless (KT) transition in the prototypical two-dimensional (2D) XY model using unsupervised machine learning methods has long been a challenging problem due to the lack of suitable order parameters. To address this issue, we begin with a conventional real-valued restricted Boltzmann machine (RBM) (RBM-xy), which uses exponential conditional probabilities to generate visible units. We then develop a novel real-valued RBM (RBM-CosSin) featuring nonlinear $cos/sin$ activation, whose visible units follow the von Mises distribution. Our findings reveal that RBM-CosSin effectively learns the underlying Boltzmann distribution of 2D XY systems and generates authentic XY configurations that accurately capture both thermodynamics and topological order (vortex). Furthermore, we demonstrate that it is possible to extract phase transition information, including the KT transition, from the weight matrices without relying on prior physics knowledge.

Physical review. B./Physical review. B•Jan 23, 2025•2 citations

Machine learning phases in statistical physics

Qi Chen

Conventionally, the study of phases in statistical mechan- ics is performed with the help of random sampling tools. Among the most powerful are Monte Carlo simulations consisting of a stochastic importance sampling over state space and evaluation of estimators for physical quantities. The ability of modern machine learning techniques to classify, identify, or in- terpret massive data sets provides a complementary paradigm to the above approach to analyze the exponentially large number of states in statistical physics. In this report, it is demonstrated by application on Ising-type models that deep learning has potential wide applications in solving many-body statis- tical physics problems. In application of supervised learning, we showed that the feed-forward neural network can identify phases and phase transitions in the ferromagnetic Ising model and the convolutional neural network (CNN) is extremely powerful in classifying T = 0 and T = ∞ phases in the Ising gauge model; In application of unsupervised learning, we illustrated that a deep auto-encoder constructed by stacked restricted Boltzmann machines (RBM)\nis closely related to the renormalization group (RG) method well understood in modern physics and our reconstruction of Ising spin configurations in the ferromagnetic Ising model is similar to the hand-written digits reconstruction.

•Jan 1, 2017•0 citations

Prometheus: Unsupervised Discovery of Phase Transitions and Order Parameters in the Two-Dimensional Ising Model Using Variational Autoencoders

Brandon Yee, Wilson Collins, Caden Wang +1 more

Abstract We present an unsupervised machine learning framework for discovering phase transitions and order parameters in the two-dimensional Ising model without prior knowledge of the underlying physics. Using convolutional beta-variational autoencoders (β-VAE), we learn compressed representations that naturally separate ordered and disordered phases. Our physics-informed training procedures incorporate data augmentation respecting Ising symmetries, cosine annealing optimization, and progressive temperature curriculum learning. Experimental validation on Monte Carlo simulated configurations demonstrates automatic order parameter discovery with correlation ρ = 0.85 ± 0.04 to theoretical magnetization (95% CI [0.82, 0.88]) and critical temperature detection within 0.27% of the Onsager solution (p < 0.001). The method achieves 89% improvement over principal component analysis and 124% improvement over t-distributed stochastic neighbor embedding. Latent representations exhibit clear phase separation with physics consistency score S = 0.88 ± 0.03. Ablation studies reveal optimal performance at β = 1.0, balancing reconstruction fidelity with disentanglement. This framework enables automated identification of emergent phenomena in complex many-body systems, advancing machine learning applications in condensed matter physics.

•Oct 31, 2025•0 citations
In several physical systems, important properties characterizing the system itself are theoretically related with specific degrees of freedom. Although standard Monte Carlo simulations provide an effective tool to accurately reconstruct the physical configurations of the system, they are unable to isolate the different contributions corresponding to different degrees of freedom. Here we show that unsupervised deep learning can become a valid support to MC simulation, coupling useful insights in the phases detection task with good reconstruction performance. As a testbed we consider the 2D XY model, showing that a deep neural network based on variational autoencoders can detect the continuous Kosterlitz-Thouless (KT) transitions, and that, if endowed with the appropriate constrains, they generate configurations with meaningful physical content.
We develop deep autoregressive networks with multi channels to compute many-body systems with continuous spin degrees of freedom directly. As a concrete example, we demonstrate the two-dimensional XY model with the continuous-mixture networks and rediscover the Kosterlitz–Thouless (KT) phase transition on a periodic square lattice. Vortices characterizing the quasi-long range order are accurately detected by the generative model. By learning the microscopic probability distributions from the macroscopic thermal distribution, the networks are trained as an efficient physical sampler which can approximate the free energy and estimate thermodynamic observables unbiasedly with importance sampling. As a more precise evaluation, we compute the helicity modulus to determine the KT transition temperature. Although the training process becomes more time-consuming with larger lattice sizes, the training time remains unchanged around the KT transition temperature. The continuous-mixture autoregressive networks we developed thus can be potentially used to study other many-body systems with continuous degrees of freedom.
Thermodynamics is a theory of principles that permits a basic description of the macroscopic properties of a rich variety of complex systems from traditional ones, such as crystalline solids, gases, liquids, and thermal machines, to more intricate systems such as living organisms and black holes to name a few. Physical quantities of interest, or equilibrium state variables, are linked together in equations of state to give information on the studied system, including phase transitions, as energy in the forms of work and heat, and/or matter are exchanged with its environment, thus generating entropy. A more accurate description requires different frameworks, namely, statistical mechanics and quantum physics to explore in depth the microscopic properties of physical systems and relate them to their macroscopic properties. These frameworks also allow to go beyond equilibrium situations. Given the notably increasing complexity of mathematical models to study realistic systems, and their coupling to their environment that constrains their dynamics, both analytical approaches and numerical methods that build on these models show limitations in scope or applicability. On the other hand, machine learning, i.e., data-driven, methods prove to be increasingly efficient for the study of complex quantum systems. Deep neural networks, in particular, have been successfully applied to many-body quantum dynamics simulations and to quantum matter phase characterization. In the present work, we show how to use a variational autoencoder (VAE)—a state-of-the-art tool in the field of deep learning for the simulation of probability distributions of complex systems. More precisely, we transform a quantum mechanical problem of many-body state reconstruction into a statistical problem, suitable for VAE, by using informationally complete positive operator-valued measure. We show, with the paradigmatic quantum Ising model in a transverse magnetic field, that the ground-state physics, such as, e.g., magnetization and other mean values of observables, of a whole class of quantum many-body systems can be reconstructed by using VAE learning of tomographic data for different parameters of the Hamiltonian, and even if the system undergoes a quantum phase transition. We also discuss challenges related to our approach as entropy calculations pose particular difficulties.
Detecting the topological Kosterlitz-Thouless (KT) transition in the prototypical 2D XY model using unsupervised machine learning methods has long been a challenging problem due to the lack of suitable order parameters. To address this issue, we begin with a conventional real-valued RBM (RBM-xy), which uses exponential conditional probabilities to generate visible units. We then develop a novel real-valued RBM (RBM-CosSin) featuring nonlinear cos/sin activation, whose visible units follow the von Mises distribution. Our findings reveal that RBM-CosSin effectively learns the underlying Boltzmann distribution of 2D XY systems and generate authentic XY configurations that accurately capture both thermodynamics and topological order (vortex). Furthermore, we demonstrate that it is possible to extract phase transition information, including the KT transition, from the weight matrices without relying on prior physics knowledge.
Detecting the topological Kosterlitz-Thouless (KT) transition in the prototypical two-dimensional (2D) XY model using unsupervised machine learning methods has long been a challenging problem due to the lack of suitable order parameters. To address this issue, we begin with a conventional real-valued restricted Boltzmann machine (RBM) (RBM-xy), which uses exponential conditional probabilities to generate visible units. We then develop a novel real-valued RBM (RBM-CosSin) featuring nonlinear cos/sincos/sincos/sin activation, whose visible units follow the von Mises distribution. Our findings reveal that RBM-CosSin effectively learns the underlying Boltzmann distribution of 2D XY systems and generates authentic XY configurations that accurately capture both thermodynamics and topological order (vortex). Furthermore, we demonstrate that it is possible to extract phase transition information, including the KT transition, from the weight matrices without relying on prior physics knowledge.
Conventionally, the study of phases in statistical mechan- ics is performed with the help of random sampling tools. Among the most powerful are Monte Carlo simulations consisting of a stochastic importance sampling over state space and evaluation of estimators for physical quantities. The ability of modern machine learning techniques to classify, identify, or in- terpret massive data sets provides a complementary paradigm to the above approach to analyze the exponentially large number of states in statistical physics. In this report, it is demonstrated by application on Ising-type models that deep learning has potential wide applications in solving many-body statis- tical physics problems. In application of supervised learning, we showed that the feed-forward neural network can identify phases and phase transitions in the ferromagnetic Ising model and the convolutional neural network (CNN) is extremely powerful in classifying T = 0 and T = ∞ phases in the Ising gauge model; In application of unsupervised learning, we illustrated that a deep auto-encoder constructed by stacked restricted Boltzmann machines (RBM)\nis closely related to the renormalization group (RG) method well understood in modern physics and our reconstruction of Ising spin configurations in the ferromagnetic Ising model is similar to the hand-written digits reconstruction.
Abstract We present an unsupervised machine learning framework for discovering phase transitions and order parameters in the two-dimensional Ising model without prior knowledge of the underlying physics. Using convolutional beta-variational autoencoders (β-VAE), we learn compressed representations that naturally separate ordered and disordered phases. Our physics-informed training procedures incorporate data augmentation respecting Ising symmetries, cosine annealing optimization, and progressive temperature curriculum learning. Experimental validation on Monte Carlo simulated configurations demonstrates automatic order parameter discovery with correlation ρ = 0.85 ± 0.04 to theoretical magnetization (95% CI [0.82, 0.88]) and critical temperature detection within 0.27% of the Onsager solution (p < 0.001). The method achieves 89% improvement over principal component analysis and 124% improvement over t-distributed stochastic neighbor embedding. Latent representations exhibit clear phase separation with physics consistency score S = 0.88 ± 0.03. Ablation studies reveal optimal performance at β = 1.0, balancing reconstruction fidelity with disentanglement. This framework enables automated identification of emergent phenomena in complex many-body systems, advancing machine learning applications in condensed matter physics.