Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2405.16288 · European network for Particle physics, Lattice field theory and Extreme computing Conference (EuroPLEx)

Generating configurations of increasing lattice size with machine learning and the inverse renormalization group

Dimitrios Bachtis

Published Jun 3, 2024• 0 citations
arXivHTMLPDF

Abstract

We review recent developments of machine learning algorithms pertinent to the inverse renormalization group, which was originally established as a generative numerical method by Ron-Swendsen-Brandt via the implementation of compatible Monte Carlo simulations. Inverse renormalization group methods enable the iterative generation of configurations for increasing lattice size without the critical slowing down effect. We discuss the construction of inverse renormalization group transformations with the use of convolutional neural networks and present applications in models of statistical mechanics, lattice field theory, and disordered systems. We highlight the case of the three-dimensional Edwards-Anderson spin glass, where the inverse renormalization group can be employed to construct configurations for lattice volumes that have not yet been accessed by dedicated supercomputers.

DOI
10.22323/1.451.0001

Related papers

Inverse renormalization group of spin glasses

Dimitrios Bachtis

We propose inverse renormalization group transformations to construct approximate configurations for lattice volumes that have not yet been accessed by supercomputers or large-scale simulations in the study of spin glasses. Specifically, starting from lattices of volume $V={8}^{3}$ in the case of the three-dimensional Edwards-Anderson model we employ machine learning algorithms to construct rescaled lattices up to ${V}^{\ensuremath{'}}={128}^{3}$, which we utilize to extract two critical exponents. We conclude by discussing how to incorporate numerical exactness within inverse renormalization group methods of disordered systems, thus opening up the opportunity to explore a sustainable and energy-efficient generation of exact configurations for increasing lattice volumes without the use of dedicated supercomputers.

arXiv:2310.12631•Physical review. B./Physical review. B•Oct 29, 2024•4 citations

Super-resolving the Ising model with convolutional neural networks

Stavros Efthymiou, Matthew J. S. Beach, Roger G. Melko

Machine learning is becoming widely used in condensed matter physics. Inspired by the concept of image super-resolution, we propose a method to increase the size of lattice spin configurations using deep convolutional neural networks. Through supervised learning on Monte Carlo (MC) generated spin configurations, we train networks that invert real-space renormalization decimations. We demonstrate that super-resolution can reproduce thermodynamic observables that agree with MC calculations for the one- and two-dimensional Ising model at various temperatures. We find that it is possible to predict thermodynamic quantities for lattice sizes larger than those used in training by extrapolating the parameters of the network. We use this method to compute the critical exponents of the 2D Ising model, finding good agreement with theory.

arXiv:1810.02372•Physical review. B./Physical review. B•Feb 6, 2019•63 citations

Machine learning renormalization group for statistical physics

Wanda Hou, Yi‐Zhuang You

Abstract We develop a machine-learning renormalization group (MLRG) algorithm to explore and analyze many-body lattice models in statistical physics. Using the representation learning capability of generative modeling, MLRG automatically learns the optimal renormalization group (RG) transformations from self-generated spin configurations and formulates RG equations without human supervision. The algorithm does not focus on simulating any particular lattice model but broadly explores all possible models compatible with the internal and lattice symmetries given the on-site symmetry representation. It can uncover the RG monotone that governs the RG flow, assuming a strong form of the c-theorem. This enables several downstream tasks, including unsupervised classification of phases, automatic location of phase transitions or critical points, controlled estimation of critical exponents, and operator scaling dimensions. We demonstrate the MLRG method in two-dimensional lattice models with Ising symmetry and show that the algorithm correctly identifies and characterizes the Ising criticality.

arXiv:2306.11054•Machine Learning Science and Technology•Oct 6, 2023•8 citations

Inverse renormalization group based on image super-resolution using deep convolutional networks

Kenta Shiina, 弘之 森, Yusuke Tomita +2 more

The inverse renormalization group is studied based on the image super-resolution using the deep convolutional neural networks. We consider the improved correlation configuration instead of spin configuration for the spin models, such as the two-dimensional Ising and three-state Potts models. We propose a block-cluster transformation as an alternative to the block-spin transformation in dealing with the improved estimators. In the framework of the dual Monte Carlo algorithm, the block-cluster transformation is regarded as a transformation in the graph degrees of freedom, whereas the block-spin transformation is that in the spin degrees of freedom. We demonstrate that the renormalized improved correlation configuration successfully reproduces the original configuration at all the temperatures by the super-resolution scheme. Using the rule of enlargement, we repeatedly make inverse renormalization procedure to generate larger correlation configurations. To connect thermodynamics, an approximate temperature rescaling is discussed. The enlarged systems generated using the super-resolution satisfy the finite-size scaling.

arXiv:2104.04482•Scientific Reports•May 5, 2021•18 citations

Quantum field-theoretic machine learning and the renormalization group

Dimitrios Bachtis

Within the past decade, machine learning algorithms have been proposed as a po-tential solution to a variety of research problems which emerge within physics. As this cross-fertilization matures, one is able to investigate if the efficiency of machine learning algorithms can be increased by interpreting them physically and if there exist fundamental connections that can be established between the two research fields. In this thesis, we pursue research directions intimately related to the above questions.First, we investigate the practical implications of interpreting machine learning functions as statistical-mechanical observables. Through this perspective, we explore if we can extend the classification capabilities of machine learning algorithms and if we are able to include neural networks within Hamiltonians to induce phase transitions in systems. A related direction concerns the use of machine learning to construct inverse renormalization group transformations to arbitrarily increase the size of a system. These techniques are then utilized to study the infinite volume limit of discrete spin systems and of quantum field theories, in order to investigate if machine learning is a powerful tool to study phase transitions.In another research direction we explore the derivation of machine learning algo-rithms from quantum field theories. We investigate if the φ4 scalar field theory satisfies the Hammersley-Clifford theorem and if it can be recast as a Markov random field. We then explore if φ4 neural networks can be derived that generalize a certain class of standard neural network architectures, and we present relevant numerical appli-cations. Finally, we discuss how this research direction opens up the opportunity to investigate machine learning within quantum field theory and how it solidifies a rig-orous connection between the research fields of machine learning, probability theory, statistical mechanics, lattice and constructive quantum field theory.

•Jan 1, 2022•0 citations

Dreaming up scale invariance via inverse renormalization group

Adam Rançon, Ulysse Rançon, Tomislav Ivek +1 more

We explore how minimal neural networks can invert the renormalization group (RG) coarse-graining procedure in the two-dimensional Ising model, effectively dreaming up microscopic configurations from coarse-grained states. This task, formally impossible at the level of configurations, can be approached probabilistically, allowing machine-learning models to reconstruct scale-invariant distributions without relying on microscopic input. We demonstrate that even neural networks with as few as three trainable parameters can learn to generate critical configurations, reproducing the scaling behavior of observables such as magnetic susceptibility, heat capacity, and Binder ratios. A real-space renormalization group analysis of the generated configurations confirms that the models capture not only scale invariance but also reproduce nontrivial eigenvalues of the RG transformation. While the inversion is necessarily imperfect, these minimal models robustly reproduce the RG-relevant structure of the critical distribution. Surprisingly, we find that increasing network complexity by introducing multiple layers offers no significant benefit. These findings suggest that simple local rules, akin to those generating fractal structures, are sufficient to encode the universality of critical phenomena, creating an opportunity for efficient generative models of statistical ensembles in physics.

arXiv:2506.04016•Physical review. E•Apr 2, 2026•1 citation
We review recent developments of machine learning algorithms pertinent to the inverse renormalization group, which was originally established as a generative numerical method by Ron-Swendsen-Brandt via the implementation of compatible Monte Carlo simulations. Inverse renormalization group methods enable the iterative generation of configurations for increasing lattice size without the critical slowing down effect. We discuss the construction of inverse renormalization group transformations with the use of convolutional neural networks and present applications in models of statistical mechanics, lattice field theory, and disordered systems. We highlight the case of the three-dimensional Edwards-Anderson spin glass, where the inverse renormalization group can be employed to construct configurations for lattice volumes that have not yet been accessed by dedicated supercomputers.
We propose inverse renormalization group transformations to construct approximate configurations for lattice volumes that have not yet been accessed by supercomputers or large-scale simulations in the study of spin glasses. Specifically, starting from lattices of volume V=83V={8}^{3}V=83 in the case of the three-dimensional Edwards-Anderson model we employ machine learning algorithms to construct rescaled lattices up to ${V}^{\ensuremath{'}}={128}^{3}$, which we utilize to extract two critical exponents. We conclude by discussing how to incorporate numerical exactness within inverse renormalization group methods of disordered systems, thus opening up the opportunity to explore a sustainable and energy-efficient generation of exact configurations for increasing lattice volumes without the use of dedicated supercomputers.
Machine learning is becoming widely used in condensed matter physics. Inspired by the concept of image super-resolution, we propose a method to increase the size of lattice spin configurations using deep convolutional neural networks. Through supervised learning on Monte Carlo (MC) generated spin configurations, we train networks that invert real-space renormalization decimations. We demonstrate that super-resolution can reproduce thermodynamic observables that agree with MC calculations for the one- and two-dimensional Ising model at various temperatures. We find that it is possible to predict thermodynamic quantities for lattice sizes larger than those used in training by extrapolating the parameters of the network. We use this method to compute the critical exponents of the 2D Ising model, finding good agreement with theory.
Abstract We develop a machine-learning renormalization group (MLRG) algorithm to explore and analyze many-body lattice models in statistical physics. Using the representation learning capability of generative modeling, MLRG automatically learns the optimal renormalization group (RG) transformations from self-generated spin configurations and formulates RG equations without human supervision. The algorithm does not focus on simulating any particular lattice model but broadly explores all possible models compatible with the internal and lattice symmetries given the on-site symmetry representation. It can uncover the RG monotone that governs the RG flow, assuming a strong form of the c-theorem. This enables several downstream tasks, including unsupervised classification of phases, automatic location of phase transitions or critical points, controlled estimation of critical exponents, and operator scaling dimensions. We demonstrate the MLRG method in two-dimensional lattice models with Ising symmetry and show that the algorithm correctly identifies and characterizes the Ising criticality.
The inverse renormalization group is studied based on the image super-resolution using the deep convolutional neural networks. We consider the improved correlation configuration instead of spin configuration for the spin models, such as the two-dimensional Ising and three-state Potts models. We propose a block-cluster transformation as an alternative to the block-spin transformation in dealing with the improved estimators. In the framework of the dual Monte Carlo algorithm, the block-cluster transformation is regarded as a transformation in the graph degrees of freedom, whereas the block-spin transformation is that in the spin degrees of freedom. We demonstrate that the renormalized improved correlation configuration successfully reproduces the original configuration at all the temperatures by the super-resolution scheme. Using the rule of enlargement, we repeatedly make inverse renormalization procedure to generate larger correlation configurations. To connect thermodynamics, an approximate temperature rescaling is discussed. The enlarged systems generated using the super-resolution satisfy the finite-size scaling.
Within the past decade, machine learning algorithms have been proposed as a po-tential solution to a variety of research problems which emerge within physics. As this cross-fertilization matures, one is able to investigate if the efficiency of machine learning algorithms can be increased by interpreting them physically and if there exist fundamental connections that can be established between the two research fields. In this thesis, we pursue research directions intimately related to the above questions.First, we investigate the practical implications of interpreting machine learning functions as statistical-mechanical observables. Through this perspective, we explore if we can extend the classification capabilities of machine learning algorithms and if we are able to include neural networks within Hamiltonians to induce phase transitions in systems. A related direction concerns the use of machine learning to construct inverse renormalization group transformations to arbitrarily increase the size of a system. These techniques are then utilized to study the infinite volume limit of discrete spin systems and of quantum field theories, in order to investigate if machine learning is a powerful tool to study phase transitions.In another research direction we explore the derivation of machine learning algo-rithms from quantum field theories. We investigate if the φ4 scalar field theory satisfies the Hammersley-Clifford theorem and if it can be recast as a Markov random field. We then explore if φ4 neural networks can be derived that generalize a certain class of standard neural network architectures, and we present relevant numerical appli-cations. Finally, we discuss how this research direction opens up the opportunity to investigate machine learning within quantum field theory and how it solidifies a rig-orous connection between the research fields of machine learning, probability theory, statistical mechanics, lattice and constructive quantum field theory.
We explore how minimal neural networks can invert the renormalization group (RG) coarse-graining procedure in the two-dimensional Ising model, effectively dreaming up microscopic configurations from coarse-grained states. This task, formally impossible at the level of configurations, can be approached probabilistically, allowing machine-learning models to reconstruct scale-invariant distributions without relying on microscopic input. We demonstrate that even neural networks with as few as three trainable parameters can learn to generate critical configurations, reproducing the scaling behavior of observables such as magnetic susceptibility, heat capacity, and Binder ratios. A real-space renormalization group analysis of the generated configurations confirms that the models capture not only scale invariance but also reproduce nontrivial eigenvalues of the RG transformation. While the inversion is necessarily imperfect, these minimal models robustly reproduce the RG-relevant structure of the critical distribution. Surprisingly, we find that increasing network complexity by introducing multiple layers offers no significant benefit. These findings suggest that simple local rules, akin to those generating fractal structures, are sufficient to encode the universality of critical phenomena, creating an opportunity for efficient generative models of statistical ensembles in physics.