Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2610.34769

Learning by Confusion Locates a Parametrization-Dependent Fisher Information Maximum

George Issa, Richard T. Scalettar

Published Oct 26, 2026• 0 citations
arXivHTMLPDF

Abstract

Learning by confusion (LBC) is a machine-learning method for locating phase transitions without assuming a known order parameter. Its characteristic accuracy curve contains a central maximum that is interpreted as the transition point, but what determines the location and finite-size scaling of this maximum has remained unclear. We derive an exact balance condition for the Bayes-optimal confusion peak and show that, for equilibrium systems with a single swept parameter, the peak closely follows the maximum of the corresponding Fisher information. This immediately gives its finite-size scaling and reveals an unexpected dependence on how the data are sampled: the same configurations arranged on grids uniform in $T$, $\ln T$, or $β=1/T$ can yield different finite-size pseudocritical trajectories. Tests on the Ising, Blume-Capel, Potts, and Baxter-Wu models confirm the prediction across continuous, tricritical, and first-order transitions. Our results identify the statistical quantity measured by LBC and show that finite-size machine-learning estimates can depend on the parametrization of the training data as well as on the underlying physics.

DOI
10.48550/arxiv.2610.34769

Related papers

Learning by confusion approach to identification of discontinuous phase transitions

Monika Richter-Laskowska, Marcin Kurpas, Maciej M. Maśka

Recently, the learning by confusion (LbC) approach has been proposed as a machine learning tool to determine the critical temperature T_{c} of phase transitions without any prior knowledge of its even approximate value. The method has been proven effective, but it has been used only for continuous phase transitions, where the confusion results only from deliberate incorrect labeling of the data. However, in the case of a discontinuous phase transition, additional confusion can result from the coexistence of different phases. To verify whether the confusion scheme can also be used for discontinuous phase transitions, we apply the LbC method to three microscopic models, the Blume-Capel, the q-state Potts, and the Falicov-Kimball models, which undergo continuous or discontinuous phase transitions depending on model parameters. With the help of a simple model, we predict that the phase coexistence present in discontinuous phase transitions can indeed make the neural network more confused and thus decrease its performance. However, numerical calculations performed for the models mentioned above indicate that other aspects of this kind of phase transition are more important and can render the LbC method even less effective. Nevertheless, we demonstrate that in some cases the same aspects allow us to use the LbC method to identify the order of a phase transition.

arXiv:2206.15114•Physical review. E•Aug 7, 2023•17 citations

Fast Detection of Phase Transitions with Multi-Task Learning-by-Confusion

Julian Arnold, Frank Schäfer, Niels Lörch

Machine learning has been successfully used to study phase transitions. One of the most popular approaches to identifying critical points from data without prior knowledge of the underlying phases is the learning-by-confusion scheme. As input, it requires system samples drawn from a grid of the parameter whose change is associated with potential phase transitions. Up to now, the scheme required training a distinct binary classifier for each possible splitting of the grid into two sides, resulting in a computational cost that scales linearly with the number of grid points. In this work, we propose and showcase an alternative implementation that only requires the training of a single multi-class classifier. Ideally, such multi-task learning eliminates the scaling with respect to the number of grid points. In applications to the Ising model and an image dataset generated with Stable Diffusion, we find significant speedups that closely correspond to the ideal case, with only minor deviations.

arXiv:2311.09128•Nov 15, 2023•6 citations

Confusion scheme in machine learning detects double phase transitions and quasi-long-range order

Song Sub Lee, Beom Jun Kim

Thanks to the development of machine learning techniques, it has been shown that the supervised learning can be useful to study critical phenomena of various systems. However, the supervised learning cannot be done without labels which require knowledge about critical behavior of the system. To overcome this barrier, unsupervised machine learning methods have been considered and the confusion scheme has been proposed. In this study, we use the confusion scheme of the unsupervised learning and investigate critical behavior of various systems which exhibit single (double) phase transitions with (without) quasi-long-range order. In detail, we choose the two-color Ashkin-Teller model, the XY model, and the eight-state clock model as such systems and snapshots of the spin configurations at various temperatures are collected via Monte Carlo simulations to be used as input data for the unsupervised machine learning. We also put focus on the size dependence of results and validate the availability of the confusion scheme in thermodynamic limit. Our results indicate that the confusion scheme of the unsupervised learning successfully locates the approximate transition points for all models and becomes more accurate as the system size is increased. We also find a characteristic feature of the result which reflects the presence of a quasi-long-range order. We conclude that regardless of the presence of a quasi-long-range order, single and double phase transitions can be detected via the confusion scheme.

Physical review. E•Apr 24, 2019•29 citations

Machine-learning study of phase transitions in Ising, Blume-Capel, and Ising-metamagnet models

Vasanth Kumar Babu, Rahul Anil Pandit

We combine machine-learning techniques with Monte Carlo (MC) simulations and finite-size scaling (FSS) to study continuous and first-order phase transitions in Ising, Blume-Capel, and Ising-metamagnet spin models. We go beyond earlier studies that had concentrated on obtaining the correlation-length exponent ν. In particular, we show (a) how to combine neural networks (NNs), trained with data from MC simulations of Ising-type spin models on finite lattices, with FSS to obtain both thermal magnetic exponents y_{t}=1/ν and y_{h}, respectively, at both critical and tricritical points, (b) how to obtain the NN counterpart of two-scale-factor universality at an Ising-type critical point, and (c) how to get FSS at a first-order transition. We also obtain the FSS forms for the output of our trained NNs as functions of both the temperature and the magnetic field.

arXiv:2501.17815•Physical review. E•May 27, 2025•6 citations

A cautionary tale for machine learning generated configurations in presence of a conserved quantity

Ahmadreza Azizi, Michel Pleimling

We investigate the performance of machine learning algorithms trained exclusively with configurations obtained from importance sampling Monte Carlo simulations of the two-dimensional Ising model with conserved magnetization. For supervised machine learning, we use convolutional neural networks and find that the corresponding output not only allows to locate the phase transition point with high precision, it also displays a finite-size scaling characterized by an Ising critical exponent. For unsupervised learning, restricted Boltzmann machines (RBM) are trained to generate new configurations that are then used to compute various quantities. We find that RBM generates configurations with magnetizations and energies forbidden in the original physical system. The RBM generated configurations result in energy density probability distributions with incorrect weights as well as in wrong spatial correlations. We show that shortcomings are also encountered when training RBM with configurations obtained from the non-conserved Ising model.

arXiv:2007.09764•Scientific Reports•Mar 18, 2021•18 citations

Emergence of a finite-size-scaling function in the supervised learning of the Ising phase transition

Dongkyu Kim, DH Kim

Abstract We investigate the connection between the supervised learning of the binary phase classification in the ferromagnetic Ising model and the standard finite-size-scaling theory of the second-order phase transition. Proposing a minimal one-free-parameter neural network model, we analytically formulate the supervised learning problem for the canonical ensemble being used as a training data set. We show that just one free parameter is capable enough to describe the data-driven emergence of the universal finite-size-scaling function in the network output that is observed in a large neural network, theoretically validating its critical point prediction for unseen test data from different underlying lattices yet in the same universality class of the Ising criticality. We also numerically demonstrate the interpretation with the proposed one-parameter model by providing an example of finding a critical point with the learning of the Landau mean-field free energy being applied to the real data set from the uncorrelated random scale-free graph with a large degree exponent.

arXiv:2010.00351•Journal of Statistical Mechanics Theory and Experiment•Feb 1, 2021•7 citations
Learning by confusion (LBC) is a machine-learning method for locating phase transitions without assuming a known order parameter. Its characteristic accuracy curve contains a central maximum that is interpreted as the transition point, but what determines the location and finite-size scaling of this maximum has remained unclear. We derive an exact balance condition for the Bayes-optimal confusion peak and show that, for equilibrium systems with a single swept parameter, the peak closely follows the maximum of the corresponding Fisher information. This immediately gives its finite-size scaling and reveals an unexpected dependence on how the data are sampled: the same configurations arranged on grids uniform in TTT, ln⁡T\ln TlnT, or β=1/Tβ=1/Tβ=1/T can yield different finite-size pseudocritical trajectories. Tests on the Ising, Blume-Capel, Potts, and Baxter-Wu models confirm the prediction across continuous, tricritical, and first-order transitions. Our results identify the statistical quantity measured by LBC and show that finite-size machine-learning estimates can depend on the parametrization of the training data as well as on the underlying physics.
Recently, the learning by confusion (LbC) approach has been proposed as a machine learning tool to determine the critical temperature T_{c} of phase transitions without any prior knowledge of its even approximate value. The method has been proven effective, but it has been used only for continuous phase transitions, where the confusion results only from deliberate incorrect labeling of the data. However, in the case of a discontinuous phase transition, additional confusion can result from the coexistence of different phases. To verify whether the confusion scheme can also be used for discontinuous phase transitions, we apply the LbC method to three microscopic models, the Blume-Capel, the q-state Potts, and the Falicov-Kimball models, which undergo continuous or discontinuous phase transitions depending on model parameters. With the help of a simple model, we predict that the phase coexistence present in discontinuous phase transitions can indeed make the neural network more confused and thus decrease its performance. However, numerical calculations performed for the models mentioned above indicate that other aspects of this kind of phase transition are more important and can render the LbC method even less effective. Nevertheless, we demonstrate that in some cases the same aspects allow us to use the LbC method to identify the order of a phase transition.
Machine learning has been successfully used to study phase transitions. One of the most popular approaches to identifying critical points from data without prior knowledge of the underlying phases is the learning-by-confusion scheme. As input, it requires system samples drawn from a grid of the parameter whose change is associated with potential phase transitions. Up to now, the scheme required training a distinct binary classifier for each possible splitting of the grid into two sides, resulting in a computational cost that scales linearly with the number of grid points. In this work, we propose and showcase an alternative implementation that only requires the training of a single multi-class classifier. Ideally, such multi-task learning eliminates the scaling with respect to the number of grid points. In applications to the Ising model and an image dataset generated with Stable Diffusion, we find significant speedups that closely correspond to the ideal case, with only minor deviations.
Thanks to the development of machine learning techniques, it has been shown that the supervised learning can be useful to study critical phenomena of various systems. However, the supervised learning cannot be done without labels which require knowledge about critical behavior of the system. To overcome this barrier, unsupervised machine learning methods have been considered and the confusion scheme has been proposed. In this study, we use the confusion scheme of the unsupervised learning and investigate critical behavior of various systems which exhibit single (double) phase transitions with (without) quasi-long-range order. In detail, we choose the two-color Ashkin-Teller model, the XY model, and the eight-state clock model as such systems and snapshots of the spin configurations at various temperatures are collected via Monte Carlo simulations to be used as input data for the unsupervised machine learning. We also put focus on the size dependence of results and validate the availability of the confusion scheme in thermodynamic limit. Our results indicate that the confusion scheme of the unsupervised learning successfully locates the approximate transition points for all models and becomes more accurate as the system size is increased. We also find a characteristic feature of the result which reflects the presence of a quasi-long-range order. We conclude that regardless of the presence of a quasi-long-range order, single and double phase transitions can be detected via the confusion scheme.
We combine machine-learning techniques with Monte Carlo (MC) simulations and finite-size scaling (FSS) to study continuous and first-order phase transitions in Ising, Blume-Capel, and Ising-metamagnet spin models. We go beyond earlier studies that had concentrated on obtaining the correlation-length exponent ν. In particular, we show (a) how to combine neural networks (NNs), trained with data from MC simulations of Ising-type spin models on finite lattices, with FSS to obtain both thermal magnetic exponents y_{t}=1/ν and y_{h}, respectively, at both critical and tricritical points, (b) how to obtain the NN counterpart of two-scale-factor universality at an Ising-type critical point, and (c) how to get FSS at a first-order transition. We also obtain the FSS forms for the output of our trained NNs as functions of both the temperature and the magnetic field.
We investigate the performance of machine learning algorithms trained exclusively with configurations obtained from importance sampling Monte Carlo simulations of the two-dimensional Ising model with conserved magnetization. For supervised machine learning, we use convolutional neural networks and find that the corresponding output not only allows to locate the phase transition point with high precision, it also displays a finite-size scaling characterized by an Ising critical exponent. For unsupervised learning, restricted Boltzmann machines (RBM) are trained to generate new configurations that are then used to compute various quantities. We find that RBM generates configurations with magnetizations and energies forbidden in the original physical system. The RBM generated configurations result in energy density probability distributions with incorrect weights as well as in wrong spatial correlations. We show that shortcomings are also encountered when training RBM with configurations obtained from the non-conserved Ising model.
Abstract We investigate the connection between the supervised learning of the binary phase classification in the ferromagnetic Ising model and the standard finite-size-scaling theory of the second-order phase transition. Proposing a minimal one-free-parameter neural network model, we analytically formulate the supervised learning problem for the canonical ensemble being used as a training data set. We show that just one free parameter is capable enough to describe the data-driven emergence of the universal finite-size-scaling function in the network output that is observed in a large neural network, theoretically validating its critical point prediction for unseen test data from different underlying lattices yet in the same universality class of the Ising criticality. We also numerically demonstrate the interpretation with the proposed one-parameter model by providing an example of finding a critical point with the learning of the Landau mean-field free energy being applied to the real data set from the uncorrelated random scale-free graph with a large degree exponent.