Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2605.05196

Frustrated magnetic order in hybrid Kitaev spin-orbital models

Ivan Dutta, Aayush Vijayvargia, Anamitra Mukherjee, Onur Erten, Kush Saha

Published May 6, 2026• 0 citations
arXivHTMLPDF

Abstract

Spin-orbital generalization of Kitaev model provides a robust extension to the original Kitaev model. However, real materials often exhibit competing interactions that break exact solvability which can give rise to new phases. Motivated by recent microscopic proposals of coexisting Yao-Lee and Kitaev couplings, we investigate the fate of the ground state when two independent exactly solvable spin liquid Hamiltonians each originally formulated on different lattice geometries are combined on a common lattice environment. We first focus on the hybrid Kitaev's honeycomb and square-lattice model. Using self-consistent mean-field analysis and perturbative calculation, we show that the strong-Kitaev regime yields magnetic order in the spin sector, while the orbital sector retains its topological order. We further analyze the hybridization of the Yao-Lee and square-lattice models and find that the model exhibits a rich evolution of Majorana Dirac bands and Lifshitz transitions. Remarkably, when the Yao-Lee and square-lattice couplings are equal and opposite, the model restores its exact solvability with a single itinerant Majorana flavor. These results demonstrate that hybrid spin liquid platforms may host various emergent phases beyond conventional exactly solvable limits.

DOI
10.48550/arxiv.2605.05196

Related papers

Magnetically ordered yet topologically robust phases emerging in concurrent Kitaev spin liquids

Muhammad Akram, Aayush Vijayvargia, Hae‐Young Kee +1 more

Spin-orbital generalizations of Kitaev model, such as Yao-Lee model, have attracted recent attention due to their enhanced stability of spin liquid phases against perturbations. Motivated by microscopic calculations for the realization of Yao-Lee model showing additional interactions, we study the phase diagram of the Yao-Lee model with added Kitaev and Heisenberg terms. While the plaquette operator is conserved even in the presence of added perturbations, the model becomes no longer exactly solvable. Using perturbation and Majorana mean-field theory, we find magnetic order can arise in the spin sector while the orbital sector remains a liquid for dominant Kitaev interactions, whereas both sectors form liquid phases when Yao-Lee interactions dominate. Additional Heisenberg exchange can enhance or suppress the magnetic order, revealing a rich coexistence of magnetic and topological phases.

arXiv:2507.21226•npj Quantum Materials•Jun 25, 2026•2 citations

Magnetic order through Kondo coupling to quantum spin liquids

Mehmet Akif Keskiner, Mehmet Özgür Oktel, Natalia Borisovna Perkins +1 more

We study the emergence of magnetic order in localized spins that interact solely through their coupling to a Kitaev-type spin liquid. Using three toy models – the Kitaev model, the Yao–Lee model, and a square-lattice generalization of the Kitaev model – we calculate the effective exchange Hamiltonians mediated by the fractionalized excitations of these spin liquids. This setup is analogous to a Kondo lattice model, where conduction electrons are replaced by itinerant Majorana fermions. In the Kitaev model, our results show that the lowest-order perturbation theory generates short-range interactions with modified couplings and extending to sixth order introduces longer-range interactions while preserving the quantum spin-liquid ground state . Models involving more Majorana flavors on honeycomb and square lattices exhibit more complex behavior. The honeycomb Yao–Lee model with three flavors of itinerant Majorana fermions generates long-range RKKY-type interactions, leading to antiferromagnetic order and partial gapping of the Majorana fermion spectrum. In contrast, the square-lattice model produces a combination of anisotropic short- and long-range interactions, which can give rise to either a dimerized quantum paramagnetic state or an Ising antiferromagnet, depending on the parameters. These results illustrate the rich variety of magnetic orders that can be mediated by Kitaev-type spin liquids.

arXiv:2502.07884•Materials Today Quantum•Apr 22, 2025•4 citations

Microscopic roadmap to a Kitaev-Yao-Lee spin-orbital liquid

Derek Churchill, Emily Z. Zhang, Hae‐Young Kee

The exactly solvable spin-1/2 Kitaev model on a honeycomb lattice has drawn significant interest, as it offers a pathway to realizing the long-sought-after quantum spin liquid. Building upon the Kitaev model, Yao and Lee introduced another exactly solvable model on an unusual star lattice featuring non-abelian spinons. The additional pseudospin degrees of freedom in this model could provide greater stability against perturbations, making this model appealing. However, a mechanism to realize such an interaction in a standard honeycomb lattice remains unknown. Here, we provide a microscopic theory to obtain the Yao-Lee model, on a honeycomb lattice by utilizing strong spin-orbit coupling of anions edge-shared between two e g ions in the exchange processes. This mechanism leads to the desired bond-dependent interaction among spins rather than orbitals, unique to our model, implying that the orbitals fractionalize into gapless Majorana fermions and fermionic octupolar excitations emerge. Since the conventional Kugel-Khomskii interaction also appears, we examine the phase diagram, including these interactions, using classical Monte Carlo simulations and exact diagonalization techniques. Our findings reveal a broad region of disordered states that break rotational symmetry in the bond energy, suggesting intriguing behavior reminiscent of a spin-orbital liquid.

arXiv:2410.21389•npj Quantum Materials•Mar 1, 2025•12 citations

Topological transitions in the Yao-Lee spin-orbital model and effects of site disorder

Vladislav Poliakov, Wen-Han Kao, Natalia Borisovna Perkins

The Yao-Lee model is an example of exactly solvable spin-orbital models that are generalizations of the original Kitaev honeycomb model with extra local orbital degrees of freedom. Similarly to the Kitaev model, both spin and orbital degrees of freedom are effectively represented using sets of three-flavored Majorana fermions. The Yao-Lee model exhibits a quantum spin liquid ground state with gapped and immobile ${Z}_{2}$ fluxes and threefold degenerate itinerant Majorana fermions. Our work demonstrated that by introducing different time-reversal-symmetry- (TRS) breaking fields one can split the degeneracy of Majorana fermions and close the gap for some of the bands, thus changing its topology. We calculated a comprehensive topological phase diagram for the Yao-Lee model by considering various combinations of TRS-breaking fields. This investigation revealed the emergence of distinct topological regions, each separated by nodal lines, signifying an evolution in the model's topological properties. We also investigated the impact of vacancies in the system. Our findings revealed that while vacancies modify the low-energy spectrum of the model, their presence has a limited impact on the topological properties of the model, at least for small-enough concentrations.

arXiv:2312.17359•Physical review. B./Physical review. B•Aug 8, 2024•11 citations

Topological and magnetic phase transitions in the bilayer Kitaev-Ising model

Aayush Vijayvargia, Urban F. P. Seifert, Onur Erten

We investigate the phase diagram of a bilayer Kitaev honeycomb model with Ising interlayer interactions, deriving effective models via perturbation theory and performing Majorana mean-field theory calculations. We show that a diverse array of magnetic and topological phase transitions occur, depending on the direction of the interlayer Ising interaction and the relative sign of Kitaev interactions. When two layers have the same sign of the Kitaev interaction, a first-order transition from a Kitaev spin liquid to a magnetically ordered state takes place. The magnetic order points along the Ising axis and it is (anti)ferromagnetic for (anti)ferromagnetic Kitaev interactions. However, when two layers have opposite signs of the Kitaev interaction, we observe a notable weakening of magnetic ordering tendencies and the Kitaev spin liquid survives up to a remarkably larger interlayer exchange. Our mean-field analysis suggests the emergence of an intermediate gapped ${\mathbb{Z}}_{2}$ spin-liquid state, which eventually becomes unstable upon vison condensation. The confined phase is described by a highly frustrated ${120}^{\ensuremath{\circ}}$ compass model. We furthermore use perturbation theory to study the model with the Ising axis pointing along the $\stackrel{\ifmmode \hat{}\else \^{}\fi{}}{z}$ axis or lying in the $xy$ plane. In both cases, our analysis reveals the formation of one-dimensional Ising chains, which remain decoupled in perturbation theory, resulting in a subextensive ground-state degeneracy. Our results highlight the interplay between topological order and magnetic ordering tendencies in bilayer quantum spin liquids.

arXiv:2311.06245•Physical review. B./Physical review. B•Jan 30, 2024•6 citations

Emergent magnetic order in the antiferromagnetic Kitaev model in a [111] field

Will Holdhusen, Daniel Huerga, Gerardo Ortíz

The Kitaev spin liquid, stabilized as the ground state of the Kitaev honeycomb model, is a paradigmatic example of a topological ${\mathbb{Z}}_{2}$ quantum spin liquid. The fate of the Kitaev spin liquid in presence of an external magnetic field is at present, a subject of intense scrutiny due to recent experimental signatures pointing to a ${\mathbb{Z}}_{2}$ topological phase in certain materials, as well as theoretical studies predicting the emergence of a quantum spin liquid phase of debated nature. In this work, we employ hierarchical mean-field theory, a method based on the use of clusters preserving relevant symmetries and short-range quantum correlations, to investigate the quantum phase diagram of the antiferromagnetic Kitaev's model in a [111] magnetic field. By using clusters of 24 sites, we predict that the Kitaev spin liquid transits through two intermediate phases, characterized by emerging stripe and chiral orders, respectively, before entering the trivial partially polarized phase, differing from previous studies. We assess our results by performing exact diagonalization and computing the scaling of different observables, including the many-body Chern number and other topological quantities, thus establishing hierarchical mean-field theory as a method to study models of frustrated quantum magnetism potentially hosting topological quantum spin liquids.

arXiv:2311.03334•Physical review. B./Physical review. B•May 6, 2024•5 citations
Spin-orbital generalization of Kitaev model provides a robust extension to the original Kitaev model. However, real materials often exhibit competing interactions that break exact solvability which can give rise to new phases. Motivated by recent microscopic proposals of coexisting Yao-Lee and Kitaev couplings, we investigate the fate of the ground state when two independent exactly solvable spin liquid Hamiltonians each originally formulated on different lattice geometries are combined on a common lattice environment. We first focus on the hybrid Kitaev's honeycomb and square-lattice model. Using self-consistent mean-field analysis and perturbative calculation, we show that the strong-Kitaev regime yields magnetic order in the spin sector, while the orbital sector retains its topological order. We further analyze the hybridization of the Yao-Lee and square-lattice models and find that the model exhibits a rich evolution of Majorana Dirac bands and Lifshitz transitions. Remarkably, when the Yao-Lee and square-lattice couplings are equal and opposite, the model restores its exact solvability with a single itinerant Majorana flavor. These results demonstrate that hybrid spin liquid platforms may host various emergent phases beyond conventional exactly solvable limits.
Spin-orbital generalizations of Kitaev model, such as Yao-Lee model, have attracted recent attention due to their enhanced stability of spin liquid phases against perturbations. Motivated by microscopic calculations for the realization of Yao-Lee model showing additional interactions, we study the phase diagram of the Yao-Lee model with added Kitaev and Heisenberg terms. While the plaquette operator is conserved even in the presence of added perturbations, the model becomes no longer exactly solvable. Using perturbation and Majorana mean-field theory, we find magnetic order can arise in the spin sector while the orbital sector remains a liquid for dominant Kitaev interactions, whereas both sectors form liquid phases when Yao-Lee interactions dominate. Additional Heisenberg exchange can enhance or suppress the magnetic order, revealing a rich coexistence of magnetic and topological phases.
We study the emergence of magnetic order in localized spins that interact solely through their coupling to a Kitaev-type spin liquid. Using three toy models – the Kitaev model, the Yao–Lee model, and a square-lattice generalization of the Kitaev model – we calculate the effective exchange Hamiltonians mediated by the fractionalized excitations of these spin liquids. This setup is analogous to a Kondo lattice model, where conduction electrons are replaced by itinerant Majorana fermions. In the Kitaev model, our results show that the lowest-order perturbation theory generates short-range interactions with modified couplings and extending to sixth order introduces longer-range interactions while preserving the quantum spin-liquid ground state . Models involving more Majorana flavors on honeycomb and square lattices exhibit more complex behavior. The honeycomb Yao–Lee model with three flavors of itinerant Majorana fermions generates long-range RKKY-type interactions, leading to antiferromagnetic order and partial gapping of the Majorana fermion spectrum. In contrast, the square-lattice model produces a combination of anisotropic short- and long-range interactions, which can give rise to either a dimerized quantum paramagnetic state or an Ising antiferromagnet, depending on the parameters. These results illustrate the rich variety of magnetic orders that can be mediated by Kitaev-type spin liquids.
The exactly solvable spin-1/2 Kitaev model on a honeycomb lattice has drawn significant interest, as it offers a pathway to realizing the long-sought-after quantum spin liquid. Building upon the Kitaev model, Yao and Lee introduced another exactly solvable model on an unusual star lattice featuring non-abelian spinons. The additional pseudospin degrees of freedom in this model could provide greater stability against perturbations, making this model appealing. However, a mechanism to realize such an interaction in a standard honeycomb lattice remains unknown. Here, we provide a microscopic theory to obtain the Yao-Lee model, on a honeycomb lattice by utilizing strong spin-orbit coupling of anions edge-shared between two e g ions in the exchange processes. This mechanism leads to the desired bond-dependent interaction among spins rather than orbitals, unique to our model, implying that the orbitals fractionalize into gapless Majorana fermions and fermionic octupolar excitations emerge. Since the conventional Kugel-Khomskii interaction also appears, we examine the phase diagram, including these interactions, using classical Monte Carlo simulations and exact diagonalization techniques. Our findings reveal a broad region of disordered states that break rotational symmetry in the bond energy, suggesting intriguing behavior reminiscent of a spin-orbital liquid.
The Yao-Lee model is an example of exactly solvable spin-orbital models that are generalizations of the original Kitaev honeycomb model with extra local orbital degrees of freedom. Similarly to the Kitaev model, both spin and orbital degrees of freedom are effectively represented using sets of three-flavored Majorana fermions. The Yao-Lee model exhibits a quantum spin liquid ground state with gapped and immobile Z2{Z}_{2}Z2​ fluxes and threefold degenerate itinerant Majorana fermions. Our work demonstrated that by introducing different time-reversal-symmetry- (TRS) breaking fields one can split the degeneracy of Majorana fermions and close the gap for some of the bands, thus changing its topology. We calculated a comprehensive topological phase diagram for the Yao-Lee model by considering various combinations of TRS-breaking fields. This investigation revealed the emergence of distinct topological regions, each separated by nodal lines, signifying an evolution in the model's topological properties. We also investigated the impact of vacancies in the system. Our findings revealed that while vacancies modify the low-energy spectrum of the model, their presence has a limited impact on the topological properties of the model, at least for small-enough concentrations.
We investigate the phase diagram of a bilayer Kitaev honeycomb model with Ising interlayer interactions, deriving effective models via perturbation theory and performing Majorana mean-field theory calculations. We show that a diverse array of magnetic and topological phase transitions occur, depending on the direction of the interlayer Ising interaction and the relative sign of Kitaev interactions. When two layers have the same sign of the Kitaev interaction, a first-order transition from a Kitaev spin liquid to a magnetically ordered state takes place. The magnetic order points along the Ising axis and it is (anti)ferromagnetic for (anti)ferromagnetic Kitaev interactions. However, when two layers have opposite signs of the Kitaev interaction, we observe a notable weakening of magnetic ordering tendencies and the Kitaev spin liquid survives up to a remarkably larger interlayer exchange. Our mean-field analysis suggests the emergence of an intermediate gapped Z2{\mathbb{Z}}_{2}Z2​ spin-liquid state, which eventually becomes unstable upon vison condensation. The confined phase is described by a highly frustrated ${120}^{\ensuremath{\circ}}$ compass model. We furthermore use perturbation theory to study the model with the Ising axis pointing along the $\stackrel{\ifmmode \hat{}\else \^{}\fi{}}{z}$ axis or lying in the xyxyxy plane. In both cases, our analysis reveals the formation of one-dimensional Ising chains, which remain decoupled in perturbation theory, resulting in a subextensive ground-state degeneracy. Our results highlight the interplay between topological order and magnetic ordering tendencies in bilayer quantum spin liquids.
The Kitaev spin liquid, stabilized as the ground state of the Kitaev honeycomb model, is a paradigmatic example of a topological Z2{\mathbb{Z}}_{2}Z2​ quantum spin liquid. The fate of the Kitaev spin liquid in presence of an external magnetic field is at present, a subject of intense scrutiny due to recent experimental signatures pointing to a Z2{\mathbb{Z}}_{2}Z2​ topological phase in certain materials, as well as theoretical studies predicting the emergence of a quantum spin liquid phase of debated nature. In this work, we employ hierarchical mean-field theory, a method based on the use of clusters preserving relevant symmetries and short-range quantum correlations, to investigate the quantum phase diagram of the antiferromagnetic Kitaev's model in a [111] magnetic field. By using clusters of 24 sites, we predict that the Kitaev spin liquid transits through two intermediate phases, characterized by emerging stripe and chiral orders, respectively, before entering the trivial partially polarized phase, differing from previous studies. We assess our results by performing exact diagonalization and computing the scaling of different observables, including the many-body Chern number and other topological quantities, thus establishing hierarchical mean-field theory as a method to study models of frustrated quantum magnetism potentially hosting topological quantum spin liquids.