Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2504.14483 · Physical review. B./Physical review. B

Transformer-based operator learning framework for self-energy in strongly correlated systems

Yuanran Zhu, Peter Rosenberg, Zhen Huang, Hardeep Bassi, Chao Yang, Shiwei Zhang

Published May 21, 2026• 0 citations
arXivHTMLPDF

Abstract

We introduce $Σ$-Attention, a Transformer-based operator-learning framework to address a key computational challenge in correlated materials. Our approach utilizes an Encoder-Only Transformer as an ansatz to approximate the self-energy operator of strongly correlated electronic systems. By creating a batched dataset that combines results from three complementary approaches: many-body perturbation theory, strong-coupling expansion, and exact diagonalization, each effective in specific parameter regimes, $Σ$-Attention is applied to learn a universal approximation for the self-energy operator that is valid across all regimes. This hybrid strategy leverages the strengths of existing methods while relying on the transformer's ability to generalize beyond individual limitations. More importantly, the scalability of the Transformer architecture allows the learned self-energy to be extended to systems with larger sizes, leading to much improved computational scaling. Using the 1D Hubbard model, we demonstrate that $Σ$-Attention can accurately predict the Matsubara Green's function and hence effectively captures the Mott transition at finite temperature. Our framework offers a promising and scalable pathway for studying strongly correlated systems with many possible generalizations.

DOI
10.1103/k5s2-x6hq

Related papers

Expander attention as exchange-correlation

Karim K. Alaa El-Din, Antonius v. Strachwitz, Sam M. Vinko

Kohn-Sham density functional theory (DFT) is the workhorse of quantum chemistry, offering an attractive balance between accuracy and computational cost. Although exact in principle, DFT in practice relies on an approximation to the unknown exchange-correlation (XC) functional, which encodes the many-body quantum effects beyond the mean-field treatment. Many such approximations exist, and machine-learned XC functionals have proliferated in recent years. A persistent challenge in this area is the trade-off between accuracy and computational cost: while high-accuracy ML functionals have shown success on strongly correlated systems that are notoriously difficult for conventional approximations, their unfavorable scaling has limited broader adoption. Here, we propose a linearly scaling non-local XC approximation based on an expander graph transformer ansatz, improving the scaling of $O(N^2)$ or worse for previous ML functionals capable of reliably capturing strongly correlated systems. We show that it recovers the correct $\mathrm{H_2}$ dissociation curve in the strongly correlated regime, with promising results on planar $\mathrm{H_4}$, a system where even high-level coupled cluster methods break down. Our approach thus charts a path toward ML functionals that are both accurate on strongly correlated systems and cheap enough to deploy at scale.

quant-pharXiv:2605.10265•May 12, 2026•0 citations

Systematically improvable multiscale solver for correlated electron systems

Alexei A. Kananenka, Emanuel Gull, Dominika Zgid

The development of numerical methods capable of simulating realistic materials with strongly correlated electrons, with controllable errors, is a central challenge in quantum many-body physics. Here we describe a framework for a general multiscale method based on embedding a self-energy of a strongly correlated subsystem into a self-energy generated by a method able to treat large weakly correlated systems approximately. As an example, we present the embedding of an exact diagonalization self-energy into a self-energy generated from self-consistent second-order perturbation theory. Using a quantum impurity model, generated from a cluster dynamical mean field approximation to the two-dimensional Hubbard model, as a benchmark, we illustrate that our method allows us to obtain accurate results at a fraction of the cost of typical Monte Carlo calculations. We test the method in multiple regimes of interaction strengths and dopings of the model. The general embedding framework we present avoids difficulties such as double counting corrections, frequency-dependent interactions, or vertex functions. As it is solely formulated at the level of the single-particle Green's function, it provides a promising route for the simulation of realistic materials that are currently difficult to study with other methods.

arXiv:1410.5118•Physical Review B•Mar 23, 2015•91 citations

Deep learning nonlocal and scalable energy functionals for quantum Ising models

Emanuele Costa, Rosario Fazio, Sebastiano Pilati

Density functional theory (DFT) is routinely employed in material science and quantum chemistry to simulate weakly correlated electronic systems. Recently, deep learning (DL) techniques have been adopted to develop promising functionals for the strongly correlated regime. DFT can be applied to quantum spin models too, but functionals based on DL have not been developed yet. Here, we investigate DL-based DFTs for random quantum Ising chains, both with nearest-neighbor and up to next-nearest-neighbor couplings. Our neural functionals are trained and tested on data produced via the Jordan-Wigner transformation, exact diagonalization, and tensor-network methods. An economical gradient-descent optimization is used to find the ground-state properties of previously unseen Hamiltonian instances. Notably, our nonlocal functionals drastically improve upon the common local density approximations, and they are designed to be scalable, allowing us to simulate chain sizes much larger than those used for training. The prediction accuracy is analyzed, paying attention to the spatial correlations of the learned functionals and to the role of quantum criticality. Our findings indicate a suitable strategy to extend the reach of other computational methods with a controllable accuracy.

arXiv:2305.15370•Physical review. B./Physical review. B•Sep 7, 2023•5 citations

First-principles Deep Learning for Quantum Many-body Physics

Khachatur G. Nazaryan

This thesis investigates emergent phenomena in strongly correlated quantum matter, with a central focus on developing first-principles deep learning methods for quantum many-body systems. A common theme throughout this work is the search for microscopic mechanisms that generate unexpected collective behavior, together with computational frameworks capable of describing such behavior in regimes where conventional approaches become inadequate. The first part of the thesis studies a doped Mott insulator in a magnetic field and uncovers a new superconducting state, which we call \emph{magnonic superconductivity}. In this state, magnons mediate pairing, and the superconducting order is carried by composite objects binding electron pairs to spin excitations. This mechanism gives rise to a partially spin-polarized superconducting phase beyond the conventional paradigm of electron pairing and further suggests the possibility of higher-charge bound states, including charge-$6e$ superconductivity. The main thrust of the thesis is the use of deep neural networks as variational, first-principles representations of many-body wave functions. In contrast to the usual data-driven role of machine learning, the neural-network ans\"atze developed here do not learn from labeled datasets; instead, they are optimized directly from the microscopic Hamiltonian through variational Monte Carlo. Within this framework, we first develop self-attention-based neural-network wave functions for correlated electrons in solids and show that they accurately describe moir\'e systems with minimal human bias, capture interaction-driven phase transitions, and exhibit favorable scaling of representational complexity with system size. We then introduce a general physics-informed initialization strategy that reconstructs complex many-body wave functions from probability density and probability current. This approach enables highly accurate pretraining of neural wave functions, achieves near-exact overlaps for topological and paired quantum states, and allows efficient simulations of fractional quantum Hall systems with realistic interactions at unprecedented sizes. Finally, we introduce QERNEL, an efficient foundational neural variational ansatz designed to learn a family of many-body ground states within a single conditional model. By combining efficient context conditioning with modern permutation-equivariant building blocks, QERNEL achieves substantially improved expressivity at low computational cost. Applied to interacting electrons in semiconductor moir\'e heterobilayers, it captures distinct many-body phases and resolves the sharp phase transition between them in systems as large as 150 electrons. These results show that context-aware neural wave functions can move beyond Hamiltonian-by-Hamiltonian solution toward genuinely foundational models of quantum matter. Taken together, the results of this thesis show that first-principles deep learning can serve not merely as a numerical tool, but as a general framework for quantum many-body physics: one that bridges microscopic Hamiltonians, expressive wave-function ansätze, and scalable computation, while opening new paths to the discovery and characterization of strongly correlated quantum matter.

•May 1, 2026•0 citations

Quantum Classical Algorithm for the Study of Phase Transitions in the Hubbard Model via Dynamical Mean-Field Theory

Anshumitra Baul, Herbert F. Fotso, Hanna Terletska +2 more

Modeling many-body quantum systems is widely regarded as one of the most promising applications for near-term noisy quantum computers. However, in the near term, system size limitation will remain a severe barrier for applications in materials science or strongly correlated systems. A promising avenue of research is to combine many-body physics with machine learning for the classification of distinct phases. We present a workflow that synergizes quantum computing, many-body theory, and quantum machine learning (QML) for studying strongly correlated systems. In particular, it can capture a putative quantum phase transition of the stereotypical strongly correlated system, the Hubbard model. Following the recent proposal of the hybrid quantum-classical algorithm for the two-site dynamical mean-field theory (DMFT), we present a modification that allows the self-consistent solution of the single bath site DMFT. The modified algorithm can be generalized for multiple bath sites. This approach is used to generate a database of zero-temperature wavefunctions of the Hubbard model within the DMFT approximation. We then use a QML algorithm to distinguish between the metallic phase and the Mott insulator phase to capture the metal-to-Mott insulator phase transition. We train a recently proposed quantum convolutional neural network (QCNN) and then utilize the QCNN as a quantum classifier to capture the phase transition region. This work provides a recipe for application to other phase transitions in strongly correlated systems and represents an exciting application of small-scale quantum devices realizable with near-term technology.

arXiv:2308.01392•Quantum Reports•Apr 4, 2025•3 citations

QUANTUM CLASSICAL ALGORITHM FOR SOLVING THE HUBBARD MODEL VIA DYNAMICAL MEAN-FIELD THEORY

Anshumitra Baul

Modeling many-body quantum systems is widely regarded as one of the most promising applications for near-term noisy quantum computers. However, in the near term, system size limitation will remain a severe barrier for applications in materials science or strongly correlated systems. A promising avenue of research is to combine many-body physics with machine learning for the classification of distinct phases. I present a workflow that synergizes quantum computing, many-body theory, and quantum machine learning (QML) for studying strongly correlated systems. In particular, it can capture a putative quantum phase transition of the stereotypical strongly correlated system, the Hubbard model. Following the recent proposal of the hybrid classical-quantum algorithm for the two-site dynamical mean-field theory (DMFT), I present a modification that allows the self-consistent solution of the single bath site DMFT. The modified algorithm can be generalized for multiple bath sites. This approach is used to generate a database of zero-temperature wavefunctions of the Hubbard model within the DMFT approximation. I then use a QML algorithm to distinguish between the metallic phase and the Mott insulator phase to capture the metal-to-Mott insulator phase transition. I train a recently proposed quantum convolutional neural network(QCNN) and then utilize the QCNN as a quantum classifier to capture the phase transition region. This work provides a recipe for application to other phase transitions in strongly correlated systems and represents an exciting application of small-scale quantum devices realizable with near-term technology.

Civil War Book Review•Jul 24, 2024•0 citations
We introduce ΣΣΣ-Attention, a Transformer-based operator-learning framework to address a key computational challenge in correlated materials. Our approach utilizes an Encoder-Only Transformer as an ansatz to approximate the self-energy operator of strongly correlated electronic systems. By creating a batched dataset that combines results from three complementary approaches: many-body perturbation theory, strong-coupling expansion, and exact diagonalization, each effective in specific parameter regimes, ΣΣΣ-Attention is applied to learn a universal approximation for the self-energy operator that is valid across all regimes. This hybrid strategy leverages the strengths of existing methods while relying on the transformer's ability to generalize beyond individual limitations. More importantly, the scalability of the Transformer architecture allows the learned self-energy to be extended to systems with larger sizes, leading to much improved computational scaling. Using the 1D Hubbard model, we demonstrate that ΣΣΣ-Attention can accurately predict the Matsubara Green's function and hence effectively captures the Mott transition at finite temperature. Our framework offers a promising and scalable pathway for studying strongly correlated systems with many possible generalizations.
Kohn-Sham density functional theory (DFT) is the workhorse of quantum chemistry, offering an attractive balance between accuracy and computational cost. Although exact in principle, DFT in practice relies on an approximation to the unknown exchange-correlation (XC) functional, which encodes the many-body quantum effects beyond the mean-field treatment. Many such approximations exist, and machine-learned XC functionals have proliferated in recent years. A persistent challenge in this area is the trade-off between accuracy and computational cost: while high-accuracy ML functionals have shown success on strongly correlated systems that are notoriously difficult for conventional approximations, their unfavorable scaling has limited broader adoption. Here, we propose a linearly scaling non-local XC approximation based on an expander graph transformer ansatz, improving the scaling of O(N2)O(N^2)O(N2) or worse for previous ML functionals capable of reliably capturing strongly correlated systems. We show that it recovers the correct H2\mathrm{H_2}H2​ dissociation curve in the strongly correlated regime, with promising results on planar H4\mathrm{H_4}H4​, a system where even high-level coupled cluster methods break down. Our approach thus charts a path toward ML functionals that are both accurate on strongly correlated systems and cheap enough to deploy at scale.
The development of numerical methods capable of simulating realistic materials with strongly correlated electrons, with controllable errors, is a central challenge in quantum many-body physics. Here we describe a framework for a general multiscale method based on embedding a self-energy of a strongly correlated subsystem into a self-energy generated by a method able to treat large weakly correlated systems approximately. As an example, we present the embedding of an exact diagonalization self-energy into a self-energy generated from self-consistent second-order perturbation theory. Using a quantum impurity model, generated from a cluster dynamical mean field approximation to the two-dimensional Hubbard model, as a benchmark, we illustrate that our method allows us to obtain accurate results at a fraction of the cost of typical Monte Carlo calculations. We test the method in multiple regimes of interaction strengths and dopings of the model. The general embedding framework we present avoids difficulties such as double counting corrections, frequency-dependent interactions, or vertex functions. As it is solely formulated at the level of the single-particle Green's function, it provides a promising route for the simulation of realistic materials that are currently difficult to study with other methods.
Density functional theory (DFT) is routinely employed in material science and quantum chemistry to simulate weakly correlated electronic systems. Recently, deep learning (DL) techniques have been adopted to develop promising functionals for the strongly correlated regime. DFT can be applied to quantum spin models too, but functionals based on DL have not been developed yet. Here, we investigate DL-based DFTs for random quantum Ising chains, both with nearest-neighbor and up to next-nearest-neighbor couplings. Our neural functionals are trained and tested on data produced via the Jordan-Wigner transformation, exact diagonalization, and tensor-network methods. An economical gradient-descent optimization is used to find the ground-state properties of previously unseen Hamiltonian instances. Notably, our nonlocal functionals drastically improve upon the common local density approximations, and they are designed to be scalable, allowing us to simulate chain sizes much larger than those used for training. The prediction accuracy is analyzed, paying attention to the spatial correlations of the learned functionals and to the role of quantum criticality. Our findings indicate a suitable strategy to extend the reach of other computational methods with a controllable accuracy.
This thesis investigates emergent phenomena in strongly correlated quantum matter, with a central focus on developing first-principles deep learning methods for quantum many-body systems. A common theme throughout this work is the search for microscopic mechanisms that generate unexpected collective behavior, together with computational frameworks capable of describing such behavior in regimes where conventional approaches become inadequate. The first part of the thesis studies a doped Mott insulator in a magnetic field and uncovers a new superconducting state, which we call \emph{magnonic superconductivity}. In this state, magnons mediate pairing, and the superconducting order is carried by composite objects binding electron pairs to spin excitations. This mechanism gives rise to a partially spin-polarized superconducting phase beyond the conventional paradigm of electron pairing and further suggests the possibility of higher-charge bound states, including charge-6e6e6e superconductivity. The main thrust of the thesis is the use of deep neural networks as variational, first-principles representations of many-body wave functions. In contrast to the usual data-driven role of machine learning, the neural-network ans\"atze developed here do not learn from labeled datasets; instead, they are optimized directly from the microscopic Hamiltonian through variational Monte Carlo. Within this framework, we first develop self-attention-based neural-network wave functions for correlated electrons in solids and show that they accurately describe moir\'e systems with minimal human bias, capture interaction-driven phase transitions, and exhibit favorable scaling of representational complexity with system size. We then introduce a general physics-informed initialization strategy that reconstructs complex many-body wave functions from probability density and probability current. This approach enables highly accurate pretraining of neural wave functions, achieves near-exact overlaps for topological and paired quantum states, and allows efficient simulations of fractional quantum Hall systems with realistic interactions at unprecedented sizes. Finally, we introduce QERNEL, an efficient foundational neural variational ansatz designed to learn a family of many-body ground states within a single conditional model. By combining efficient context conditioning with modern permutation-equivariant building blocks, QERNEL achieves substantially improved expressivity at low computational cost. Applied to interacting electrons in semiconductor moir\'e heterobilayers, it captures distinct many-body phases and resolves the sharp phase transition between them in systems as large as 150 electrons. These results show that context-aware neural wave functions can move beyond Hamiltonian-by-Hamiltonian solution toward genuinely foundational models of quantum matter. Taken together, the results of this thesis show that first-principles deep learning can serve not merely as a numerical tool, but as a general framework for quantum many-body physics: one that bridges microscopic Hamiltonians, expressive wave-function ansätze, and scalable computation, while opening new paths to the discovery and characterization of strongly correlated quantum matter.
Modeling many-body quantum systems is widely regarded as one of the most promising applications for near-term noisy quantum computers. However, in the near term, system size limitation will remain a severe barrier for applications in materials science or strongly correlated systems. A promising avenue of research is to combine many-body physics with machine learning for the classification of distinct phases. We present a workflow that synergizes quantum computing, many-body theory, and quantum machine learning (QML) for studying strongly correlated systems. In particular, it can capture a putative quantum phase transition of the stereotypical strongly correlated system, the Hubbard model. Following the recent proposal of the hybrid quantum-classical algorithm for the two-site dynamical mean-field theory (DMFT), we present a modification that allows the self-consistent solution of the single bath site DMFT. The modified algorithm can be generalized for multiple bath sites. This approach is used to generate a database of zero-temperature wavefunctions of the Hubbard model within the DMFT approximation. We then use a QML algorithm to distinguish between the metallic phase and the Mott insulator phase to capture the metal-to-Mott insulator phase transition. We train a recently proposed quantum convolutional neural network (QCNN) and then utilize the QCNN as a quantum classifier to capture the phase transition region. This work provides a recipe for application to other phase transitions in strongly correlated systems and represents an exciting application of small-scale quantum devices realizable with near-term technology.
Modeling many-body quantum systems is widely regarded as one of the most promising applications for near-term noisy quantum computers. However, in the near term, system size limitation will remain a severe barrier for applications in materials science or strongly correlated systems. A promising avenue of research is to combine many-body physics with machine learning for the classification of distinct phases. I present a workflow that synergizes quantum computing, many-body theory, and quantum machine learning (QML) for studying strongly correlated systems. In particular, it can capture a putative quantum phase transition of the stereotypical strongly correlated system, the Hubbard model. Following the recent proposal of the hybrid classical-quantum algorithm for the two-site dynamical mean-field theory (DMFT), I present a modification that allows the self-consistent solution of the single bath site DMFT. The modified algorithm can be generalized for multiple bath sites. This approach is used to generate a database of zero-temperature wavefunctions of the Hubbard model within the DMFT approximation. I then use a QML algorithm to distinguish between the metallic phase and the Mott insulator phase to capture the metal-to-Mott insulator phase transition. I train a recently proposed quantum convolutional neural network(QCNN) and then utilize the QCNN as a quantum classifier to capture the phase transition region. This work provides a recipe for application to other phase transitions in strongly correlated systems and represents an exciting application of small-scale quantum devices realizable with near-term technology.