Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2209.01777 · Physical review. E

Neural network approach to scaling analysis of critical phenomena

Ryosuke Yoneda, Kenji Harada

Published Apr 27, 2023• 5 citations
arXivHTMLPDF

Abstract

Determining the universality class of a system exhibiting critical phenomena is one of the central problems in physics. There are several methods to determine this universality class from data. As methods to collapse plots onto scaling functions, polynomial regression, which is less accurate, and Gaussian process regression, which provides high accuracy and flexibility but is computationally expensive, have been proposed. In this paper, we propose a regression method using a neural network. The computational complexity is linear only in the number of data points. We demonstrate the proposed method for the finite-size scaling analysis of critical phenomena in the two-dimensional Ising model and bond percolation problem to confirm the performance. This method efficiently obtains the critical values with accuracy in both cases.

DOI
10.1103/physreve.107.044128

Related papers

Bayesian finite-size scaling analysis

Kenji Harada

To determine the universality class of critical phenomena, we propose a method of statistical inference in the scaling analysis of critical phenomena. The method is based on Bayesian statistics, most specifically, the Gaussian process regression. It assumes only the smoothness of a scaling function, and it does not need a form. We demonstrate this method for the finite-size scaling analysis of the Ising models on square and triangular lattices. Near the critical point, the method is comparable in accuracy to the least-square method. In addition, it works well for data to which we cannot apply the least-square method with a polynomial of low degree. By comparing the data on triangular lattices with the scaling function inferred from the data on square lattices, we confirm the universality of the finite-size scaling function of the two-dimensional Ising model.

•Feb 21, 2011•0 citations

Bayesian inference in the scaling analysis of critical phenomena

Kenji Harada

To determine the universality class of critical phenomena, we propose a method of statistical inference in the scaling analysis of critical phenomena. The method is based on Bayesian statistics, most specifically, the Gaussian process regression. It assumes only the smoothness of a scaling function, and it does not need a form. We demonstrate this method for the finite-size scaling analysis of the Ising models on square and triangular lattices. Near the critical point, the method is comparable in accuracy to the least-square method. In addition, it works well for data to which we cannot apply the least-square method with a polynomial of low degree. By comparing the data on triangular lattices with the scaling function inferred from the data on square lattices, we confirm the universality of the finite-size scaling function of the two-dimensional Ising model.

arXiv:1102.4149•Physical Review E•Nov 18, 2011•99 citations

Finite-size analysis in neural network classification of critical phenomena

Vladislav Chertenkov, Evgeni Burovski, Щур Лев Николаевич

We analyze the problem of supervised learning of ferromagnetic phase transitions from the statistical physics perspective. We consider two systems in two universality classes, the two-dimensional Ising model and two-dimensional Baxter-Wu model, and perform careful finite-size analysis of the results of the supervised learning of the phases of each model. We find that the variance of the neural network (NN) output function (VOF) as a function of temperature has a peak in the critical region. Qualitatively, the VOF is related to the classification rate of the NN. We find that the width of the VOF peak displays the finite-size scaling governed by the correlation length exponent ν of the universality class of the model. We check this conclusion using several NN architectures-a fully connected NN, a convolutional NN, and several members of the ResNet family-and discuss the accuracy of the extracted critical exponents ν.

arXiv:2305.03342•Physical review. E•Sep 19, 2023•20 citations

Kernel method for corrections to scaling

Kenji Harada

Scaling analysis, in which one infers scaling exponents and a scaling function in a scaling law from given data, is a powerful tool for determining universal properties of critical phenomena in many fields of science. However, there are corrections to scaling in many cases, and then the inference problem becomes ill-posed by an uncontrollable irrelevant scaling variable. We propose a new kernel method based on Gaussian process regression to fix this problem generally. We test the performance of the new kernel method for some example cases. In all cases, when the precision of the example data increases, inference results of the new kernel method correctly converge. Because there is no limitation in the new kernel method for the scaling function even with corrections to scaling, unlike in the conventional method, the new kernel method can be widely applied to real data in critical phenomena.

arXiv:1410.3622•Physical Review E•Jul 6, 2015•35 citations

Dynamical Scaling Method Improved by a Deep Learning Approach

Yusuke Terasawa, Yukiyasu Ozeki

We propose a dynamical scaling analysis improved by a deep learning approach. While Gaussian process regression has been widely employed for estimating scaling parameters, its computational cost for parameter optimization becomes a limitation in dynamical scaling analysis, where large datasets are involved. In contrast, the present method employs a neural network, which significantly reduces the computational cost and enables the use of the entire dataset that was inaccessible with Gaussian process regression. We applied the method to the 2D Ising model and the 2D 3-state Potts model, achieving higher accuracy and computational efficiency than conventional approaches.

arXiv:2603.06008•Journal of the Physical Society of Japan•May 14, 2026•0 citations

Emergence of a finite-size-scaling function in the supervised learning of the Ising phase transition

Dongkyu Kim, DH Kim

Abstract We investigate the connection between the supervised learning of the binary phase classification in the ferromagnetic Ising model and the standard finite-size-scaling theory of the second-order phase transition. Proposing a minimal one-free-parameter neural network model, we analytically formulate the supervised learning problem for the canonical ensemble being used as a training data set. We show that just one free parameter is capable enough to describe the data-driven emergence of the universal finite-size-scaling function in the network output that is observed in a large neural network, theoretically validating its critical point prediction for unseen test data from different underlying lattices yet in the same universality class of the Ising criticality. We also numerically demonstrate the interpretation with the proposed one-parameter model by providing an example of finding a critical point with the learning of the Landau mean-field free energy being applied to the real data set from the uncorrelated random scale-free graph with a large degree exponent.

arXiv:2010.00351•Journal of Statistical Mechanics Theory and Experiment•Feb 1, 2021•6 citations
Determining the universality class of a system exhibiting critical phenomena is one of the central problems in physics. There are several methods to determine this universality class from data. As methods to collapse plots onto scaling functions, polynomial regression, which is less accurate, and Gaussian process regression, which provides high accuracy and flexibility but is computationally expensive, have been proposed. In this paper, we propose a regression method using a neural network. The computational complexity is linear only in the number of data points. We demonstrate the proposed method for the finite-size scaling analysis of critical phenomena in the two-dimensional Ising model and bond percolation problem to confirm the performance. This method efficiently obtains the critical values with accuracy in both cases.
To determine the universality class of critical phenomena, we propose a method of statistical inference in the scaling analysis of critical phenomena. The method is based on Bayesian statistics, most specifically, the Gaussian process regression. It assumes only the smoothness of a scaling function, and it does not need a form. We demonstrate this method for the finite-size scaling analysis of the Ising models on square and triangular lattices. Near the critical point, the method is comparable in accuracy to the least-square method. In addition, it works well for data to which we cannot apply the least-square method with a polynomial of low degree. By comparing the data on triangular lattices with the scaling function inferred from the data on square lattices, we confirm the universality of the finite-size scaling function of the two-dimensional Ising model.
To determine the universality class of critical phenomena, we propose a method of statistical inference in the scaling analysis of critical phenomena. The method is based on Bayesian statistics, most specifically, the Gaussian process regression. It assumes only the smoothness of a scaling function, and it does not need a form. We demonstrate this method for the finite-size scaling analysis of the Ising models on square and triangular lattices. Near the critical point, the method is comparable in accuracy to the least-square method. In addition, it works well for data to which we cannot apply the least-square method with a polynomial of low degree. By comparing the data on triangular lattices with the scaling function inferred from the data on square lattices, we confirm the universality of the finite-size scaling function of the two-dimensional Ising model.
We analyze the problem of supervised learning of ferromagnetic phase transitions from the statistical physics perspective. We consider two systems in two universality classes, the two-dimensional Ising model and two-dimensional Baxter-Wu model, and perform careful finite-size analysis of the results of the supervised learning of the phases of each model. We find that the variance of the neural network (NN) output function (VOF) as a function of temperature has a peak in the critical region. Qualitatively, the VOF is related to the classification rate of the NN. We find that the width of the VOF peak displays the finite-size scaling governed by the correlation length exponent ν of the universality class of the model. We check this conclusion using several NN architectures-a fully connected NN, a convolutional NN, and several members of the ResNet family-and discuss the accuracy of the extracted critical exponents ν.
Scaling analysis, in which one infers scaling exponents and a scaling function in a scaling law from given data, is a powerful tool for determining universal properties of critical phenomena in many fields of science. However, there are corrections to scaling in many cases, and then the inference problem becomes ill-posed by an uncontrollable irrelevant scaling variable. We propose a new kernel method based on Gaussian process regression to fix this problem generally. We test the performance of the new kernel method for some example cases. In all cases, when the precision of the example data increases, inference results of the new kernel method correctly converge. Because there is no limitation in the new kernel method for the scaling function even with corrections to scaling, unlike in the conventional method, the new kernel method can be widely applied to real data in critical phenomena.
We propose a dynamical scaling analysis improved by a deep learning approach. While Gaussian process regression has been widely employed for estimating scaling parameters, its computational cost for parameter optimization becomes a limitation in dynamical scaling analysis, where large datasets are involved. In contrast, the present method employs a neural network, which significantly reduces the computational cost and enables the use of the entire dataset that was inaccessible with Gaussian process regression. We applied the method to the 2D Ising model and the 2D 3-state Potts model, achieving higher accuracy and computational efficiency than conventional approaches.
Abstract We investigate the connection between the supervised learning of the binary phase classification in the ferromagnetic Ising model and the standard finite-size-scaling theory of the second-order phase transition. Proposing a minimal one-free-parameter neural network model, we analytically formulate the supervised learning problem for the canonical ensemble being used as a training data set. We show that just one free parameter is capable enough to describe the data-driven emergence of the universal finite-size-scaling function in the network output that is observed in a large neural network, theoretically validating its critical point prediction for unseen test data from different underlying lattices yet in the same universality class of the Ising criticality. We also numerically demonstrate the interpretation with the proposed one-parameter model by providing an example of finding a critical point with the learning of the Landau mean-field free energy being applied to the real data set from the uncorrelated random scale-free graph with a large degree exponent.