Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Quantum Monte Carlo studies of novel phases in strongly correlated systems

Zi Yang Meng

Published Jan 1, 2011• 0 citations
Publisher

Abstract

Three models of strongly correlated electron systems have been studied in this thesis: the Shastry-Sutherland quantum antiferromagnet, the quantum spin liquid emerging out of correlated Dirac fermions on the honeycomb lattice, and the edge-state magnetism in the graphene nanoribbons. The methods applied are quantum Monte Carlo simulations, namely, stochastic series expansion quantum Monte Carlo for bosonic (spin) systems and projector auxiliary field quantum Monte Carlo for fermionic systems. The stochastic series expansion quantum Monte Carlo method is applied to study the ground state properties as well as the magnetization process of the spin-1/2 easy-axis Heisenberg model on the Shastry-Sutherland lattice. The quantum phase transitions between a N\'eel state, a dimer triplet state and a ferromagnetic XY phase have been characterized by finite size scaling analysis. The crystalline structures of the triplon magnetic excitations in the magnetic plateaus have been identified. The projector auxiliary field quantum Monte Carlo is applied to explore the ground state phase diagram of the SU(2) Hubbard model on the honeycomb lattice. The interplay between the relativistic Dirac dispersion, the vanishing density of states at half-filling and the strong quantum fluctuations, drives the system from a semimetal at weak coupling to an antiferromagnetic Mott insulator in the strong coupling regime. In between these phases there emerges an unexpected quantum spin liquid with no symmetry breaking in any channel. After careful finite size scaling analysis of various correlation functions, the quantum spin liquid phase is characterized as a short-range resonating valence bond state with a finite spin gap to all magnetic excitations. The study of edge-state magnetism in graphene nanoribbons is more experimentally motivated. The projector auxiliary field quantum Monte Carlo method is used to measure the static spin-spin correlation function, the single-particle spectral function, as well as the dynamic spin structure factor along the zigzag edge of graphene nanoribbons. A dominant low energy peak generated by the Coulomb interaction in the single-particle spectral function is identified as the dynamical signature of edge-state magnetism. The magnetic excitations along the zigzag edge show a linear dispersion at low energies due to the effective antiferromagnetic coupling of the edges across the ribbon. The magnetic excitations are damped by scattering processes into the particle-hole continuum at high energies.

DOI
10.18419/opus-5052

Related papers

Quantum Monte Carlo methods and strongly correlated electrons on honeycomb structures

Thomas C. Lang

In this thesis we apply recently developed, as well as sophisticated quantum Monte Carlo methods to numerically investigate models of strongly correlated electron systems on honeycomb structures. The latter are of particular interest owing to their unique properties when simulating electrons on them, like the relativistic dispersion, strong quantum fluctuations and their resistance against instabilities. This work covers several projects including the advancement of the weak-coupling continuous time quantum Monte Carlo and its application to zero temperature and phonons, quantum phase transitions of valence bond solids in spin-1/2 Heisenberg systems using projector quantum Monte Carlo in the valence bond basis, and the magnetic field induced transition to a canted antiferromagnet of the Hubbard model on the honeycomb lattice. The emphasis lies on two projects investigating the phase diagram of the SU(2) and the SU(N)-symmetric Hubbard model on the hexagonal lattice. At sufficiently low temperatures, condensed-matter systems tend to develop order. An exception are quantum spin-liquids, where fluctuations prevent a transition to an ordered state down to the lowest temperatures. Previously elusive in experimentally relevant microscopic two-dimensional models, we show by means of large-scale quantum Monte Carlo simulations of the SU(2) Hubbard model on the honeycomb lattice, that a quantum spin-liquid emerges between the state described by massless Dirac fermions and an antiferromagnetically ordered Mott insulator. This unexpected quantum-disordered state is found to be a short-range resonating valence bond liquid, akin to the one proposed for high temperature superconductors. Inspired by the rich phase diagrams of SU(N) models we study the SU(N)-symmetric Hubbard Heisenberg quantum antiferromagnet on the honeycomb lattice to investigate the reliability of 1/N corrections to large-N results by means of numerically exact QMC simulations. We study the melting of phases as correlations increase with decreasing N and determine whether the quantum spin liquid found in the SU(2) Hubbard model at intermediate coupling is a specific feature, or also exists in the unconstrained t-J model and higher symmetries.

•Jan 1, 2010•2 citations

Quanten Monte Carlo Methoden und stark korrelierte Elektronen auf hexagonalen Strukturen

Thomas C. Lang

In this thesis we apply recently developed, as well as sophisticated quantum Monte Carlo methods to numerically investigate models of strongly correlated electron systems on honeycomb structures. The latter are of particular interest owing to their unique properties when simulating electrons on them, like the relativistic dispersion, strong quantum fluctuations and their resistance against instabilities. This work covers several projects including the advancement of the weak-coupling continuous time quantum Monte Carlo and its application to zero temperature and phonons, quantum phase transitions of valence bond solids in spin-1/2 Heisenberg systems using projector quantum Monte Carlo in the valence bond basis, and the magnetic field induced transition to a canted antiferromagnet of the Hubbard model on the honeycomb lattice. The emphasis lies on two projects investigating the phase diagram of the SU(2) and the SU(N)-symmetric Hubbard model on the hexagonal lattice. At sufficiently low temperatures, condensed-matter systems tend to develop order. An exception are quantum spin-liquids, where fluctuations prevent a transition to an ordered state down to the lowest temperatures. Previously elusive in experimentally relevant microscopic two-dimensional models, we show by means of large-scale quantum Monte Carlo simulations of the SU(2) Hubbard model on the honeycomb lattice, that a quantum spin-liquid emerges between the state described by massless Dirac fermions and an antiferromagnetically ordered Mott insulator. This unexpected quantum-disordered state is found to be a short-range resonating valence bond liquid, akin to the one proposed for high temperature superconductors. Inspired by the rich phase diagrams of SU(N) models we study the SU(N)-symmetric Hubbard Heisenberg quantum antiferromagnet on the honeycomb lattice to investigate the reliability of 1/N corrections to large-N results by means of numerically exact QMC simulations. We study the melting of phases as correlations increase with decreasing N and determine whether the quantum spin liquid found in the SU(2) Hubbard model at intermediate coupling is a specific feature, or also exists in the unconstrained t-J model and higher symmetries.

•Jan 1, 2010•0 citations

Spin-Liquid Phase in the Hubbard Model on the Honeycomb Lattice.

Zi Yang Meng, Thomas C. Lang, Stefan Weßel +2 more

The Hubbard model encapsulates the physics of strongly correlated quantum systems in its most basic form. It has been studied intensively in the context of the high-temperature superconductivity. A number of novel phases were recently proposed for Hubbard-like models on the honeycomb lattice, the structure of graphene. We analyzed the Hubbard model of spin- \(\frac{1}{2}\) fermions on the honeycomb lattice at half-filling using large-scale quantum Monte Carlo simulations. We find that the weak coupling semimetal and the antiferromagnetic Mott insulator at strong interaction are separated by an extended gapped phase in an intermediate coupling regime. Exploring excitation gaps, various correlation functions as well as probing for flux quantization, we conclude that a quantum spin liquid, lacking any conventional order, emerges with local charge and spin correlations, best described by a resonating valence bonds state.

IEEE International Conference on High Performance Computing, Data, and Analytics•Jan 1, 2010•0 citations

Quantum phase transitions in effective spin-ladder models for graphene zigzag nanoribbons

Cornelie Koop, Stefan Weßel

We examine the magnetic correlations in quantum spin models that were derived recently as effective low-energy theories for electronic correlation effects on the edge states of graphene nanoribbons. For this purpose, we employ quantum Monte Carlo simulations to access the large-distance properties, accounting for quantum fluctuations beyond mean-field-theory approaches to edge magnetism. For certain chiral nanoribbons, antiferromagnetic interedge couplings were previously found to induce a gapped quantum disordered ground state of the effective spin model. We find that the extended nature of the intraedge couplings in the effective spin model for zigzag nanoribbons leads to a quantum phase transition at a large, finite value of the interedge coupling. This quantum critical point separates the quantum disordered region from a gapless phase of stable edge magnetism at weak intraedge coupling, which includes the ground states of spin-ladder models for wide zigzag nanoribbons. To study the quantum critical behavior, the effective spin model can be related to a model of two antiferromagnetically coupled Haldane-Shastry spin-half chains with long-ranged ferromagnetic intrachain couplings. The results for the critical exponents are compared also to several recent renormalization-group calculations for related long-ranged interacting quantum systems.

arXiv:1707.05522•Physical review. B./Physical review. B•Oct 9, 2017•16 citations

First principles quantum Monte Carlo study of correlated electronic systems

Huihuo Zheng

The many-body correlation between electrons is the origin of many fascinating phenomena in condensed matter systems, such as high temperature superconductivity, superfluidity, fractional quantum Hall effect, and Mott insulator. Strongly correlated systems have been an important subject of condensed matter physics for several decades, especially after the discovery of high temperature cuprate superconductors. In this thesis, we apply first principles quantum Monte Carlo (QMC) method to several representative systems to study the electron correlations in transition metal oxides (vanadium dioxide) and low dimensional electronic systems (graphene and graphene-like two dimensional systems). Vanadium dioxide (VO2) is a paradigmatic example of a strongly correlated system that undergoes a metal-insulator transition at a structural phase transition. To date, this transition has necessitated significant post-hoc adjustments to theory in order to be described properly. We apply first principles quantum Monte Carlo (QMC) to study the structural dependence of the properties of VO2. Using this technique, we simulate the interactions between electrons explicitly, which allows for the metal-insulator transition to naturally emerge, importantly without ad-hoc adjustments. The QMC calculations show that the structural transition directly causes the metal-insulator transition and a change in the coupling of vanadium spins. This change in the spin coupling results in a prediction of a momentum-independent magnetic excitation in the insulating state. While two-body correlations are important to set the stage for this transition, they do not change significantly when VO2 becomes an insulator. These results show that it is now possible to account for electron correlations in a quantitatively accurate way that is also specific to materials. Electron correlation in graphene is unique because of the interplay of the Dirac cone dispersion of pi electrons with long range Coulomb interaction. The random phase approximation predicts no metallic screening at long distances and low energies because of the zero density of states at Fermi level. It is thus interesting to see how screening takes place in graphene at different length scales. We addressed this problem by computing the structure factor S(q) and S(q, ω) of freestanding graphene using ab initio fixed-node diffusion Monte Carlo and the random phase approximation. The X-ray measured structure factor is reproduced very accurately using both techniques, provided that sigma-bonding electrons are included in the simulations. Strong dielectric screening from sigma electrons are observed, which redshifts the pi plasmons resonance frequency at long distance and reduces the effective interactions between pi electrons at short distance. The short distance screening makes suspended graphene a weakly correlated semimetal which otherwise would be an insulator. The third piece of works is dedicated to studying the low energy excitation of many-body systems using extended Koopmans' theorem (EKT). The EKT provides a straight forward way to compute charge excitation spectra, such as ionization potentials, electron affinities from any level of theory. We implemented the EKT within the QMC framework, and performed systematic benchmark studies of ionization potentials of the second- and third-row atoms, and closed- and open-shell molecules. We also applied it to compute the quasiparticle band structure of solids (graphene). For complex correlated systems, identifying relevant low energy physics degrees of freedom is extremely important to understanding the system's collective behavior at different length scales. In this sense, bridging the realistic systems to lower energy effective lattice models that involve fewer but important degrees of freedom is significant to understanding correlated systems. We have formulated three ab initio density matrix based downfolding (AIDMD) methods to downfold the ab initio systems into effective lattice models. We have demonstrated the successfulness of these methods by applying them to molecules (H2) and periodic systems (hydrogen chain and graphene).

•Jul 12, 2016•1 citation

Novel quantum phases in correlated electron systems

Kyusung Hwang

The quantum nature of electrons emerges in various exotic ways when they are put together with quantum many-body interactions. In Mott insulating systems with strong electron correlation, frustration and strong quantum fluctuations promote localized electron spins to form nontrivial quantum paramagnetic phases such as quantum spin liquid and valence bond solid preventing the development of conventional magnetic orders. In this thesis, we study such exotic quantum phases in various different frustrated quantum magnets. First, encouraged by the spin liquid phenomenology observed in Ba3XSb2O9 (X=Cu, Ni), we investigate Z2 spin liquids on a three dimensional triangular lattice by employing the Schwinger boson mean-field theory with projective symmetry group analysis. It is found that a nematic spin liquid is energetically favorable on this lattice structure rather than symmetric spin liquids. Next, we study various valence bond solid phases that can appear in kagome lattice antiferromagnets by generalizing the recently proposed phenomenological Z2 gauge theory for the topological Z2 spin liquid state found in the nearest-neighbor kagome lattice Heisenberg model. This work provides a bridge between the topological spin liquid and valence bond solid phases previously proposed for kagome lattice antiferromagnets via vison condensation in the gauge theory. Then, we consider optical conductivity in Mott insulators as an experimental probe to detect quantum paramagnetic phases like valence bond solid. Applying this idea to deformed kagome lattice antiferromagnet Rb2Cu3SnF12 with a 12-site valence bond solid state, we estimate the size of optical conductivity in this quantum magnet. After this, another quantum paramagnet BiCu2PO6 is carefully investigated to clarify its puzzling ground state nature and quasiparticle excitations. Utilizing recent high resolution neutron scattering data, we construct a microscopic spin model and also an effective theory for the low energy spin excitations in the compound. We find significant influences of magnetic anisotropies on the ground state and quasiparticle dynamics. Lastly, we investigate emergent quantum phases in the thin film geometries of the pyrochlore iridates, where a number of exotic quantum ground states are proposed to occur in bulk materials as a result of the interplay between electron correlation and strong spin-orbit coupling. The fate of these bulk phases, as well as the novel quantum states that may arise only in a thin film setting, are studied via a theoretical model that allows layer-dependent magnetic structures.

•Nov 1, 2016•0 citations
Three models of strongly correlated electron systems have been studied in this thesis: the Shastry-Sutherland quantum antiferromagnet, the quantum spin liquid emerging out of correlated Dirac fermions on the honeycomb lattice, and the edge-state magnetism in the graphene nanoribbons. The methods applied are quantum Monte Carlo simulations, namely, stochastic series expansion quantum Monte Carlo for bosonic (spin) systems and projector auxiliary field quantum Monte Carlo for fermionic systems. The stochastic series expansion quantum Monte Carlo method is applied to study the ground state properties as well as the magnetization process of the spin-1/2 easy-axis Heisenberg model on the Shastry-Sutherland lattice. The quantum phase transitions between a N'eel state, a dimer triplet state and a ferromagnetic XY phase have been characterized by finite size scaling analysis. The crystalline structures of the triplon magnetic excitations in the magnetic plateaus have been identified. The projector auxiliary field quantum Monte Carlo is applied to explore the ground state phase diagram of the SU(2) Hubbard model on the honeycomb lattice. The interplay between the relativistic Dirac dispersion, the vanishing density of states at half-filling and the strong quantum fluctuations, drives the system from a semimetal at weak coupling to an antiferromagnetic Mott insulator in the strong coupling regime. In between these phases there emerges an unexpected quantum spin liquid with no symmetry breaking in any channel. After careful finite size scaling analysis of various correlation functions, the quantum spin liquid phase is characterized as a short-range resonating valence bond state with a finite spin gap to all magnetic excitations. The study of edge-state magnetism in graphene nanoribbons is more experimentally motivated. The projector auxiliary field quantum Monte Carlo method is used to measure the static spin-spin correlation function, the single-particle spectral function, as well as the dynamic spin structure factor along the zigzag edge of graphene nanoribbons. A dominant low energy peak generated by the Coulomb interaction in the single-particle spectral function is identified as the dynamical signature of edge-state magnetism. The magnetic excitations along the zigzag edge show a linear dispersion at low energies due to the effective antiferromagnetic coupling of the edges across the ribbon. The magnetic excitations are damped by scattering processes into the particle-hole continuum at high energies.
In this thesis we apply recently developed, as well as sophisticated quantum Monte Carlo methods to numerically investigate models of strongly correlated electron systems on honeycomb structures. The latter are of particular interest owing to their unique properties when simulating electrons on them, like the relativistic dispersion, strong quantum fluctuations and their resistance against instabilities. This work covers several projects including the advancement of the weak-coupling continuous time quantum Monte Carlo and its application to zero temperature and phonons, quantum phase transitions of valence bond solids in spin-1/2 Heisenberg systems using projector quantum Monte Carlo in the valence bond basis, and the magnetic field induced transition to a canted antiferromagnet of the Hubbard model on the honeycomb lattice. The emphasis lies on two projects investigating the phase diagram of the SU(2) and the SU(N)-symmetric Hubbard model on the hexagonal lattice. At sufficiently low temperatures, condensed-matter systems tend to develop order. An exception are quantum spin-liquids, where fluctuations prevent a transition to an ordered state down to the lowest temperatures. Previously elusive in experimentally relevant microscopic two-dimensional models, we show by means of large-scale quantum Monte Carlo simulations of the SU(2) Hubbard model on the honeycomb lattice, that a quantum spin-liquid emerges between the state described by massless Dirac fermions and an antiferromagnetically ordered Mott insulator. This unexpected quantum-disordered state is found to be a short-range resonating valence bond liquid, akin to the one proposed for high temperature superconductors. Inspired by the rich phase diagrams of SU(N) models we study the SU(N)-symmetric Hubbard Heisenberg quantum antiferromagnet on the honeycomb lattice to investigate the reliability of 1/N corrections to large-N results by means of numerically exact QMC simulations. We study the melting of phases as correlations increase with decreasing N and determine whether the quantum spin liquid found in the SU(2) Hubbard model at intermediate coupling is a specific feature, or also exists in the unconstrained t-J model and higher symmetries.
In this thesis we apply recently developed, as well as sophisticated quantum Monte Carlo methods to numerically investigate models of strongly correlated electron systems on honeycomb structures. The latter are of particular interest owing to their unique properties when simulating electrons on them, like the relativistic dispersion, strong quantum fluctuations and their resistance against instabilities. This work covers several projects including the advancement of the weak-coupling continuous time quantum Monte Carlo and its application to zero temperature and phonons, quantum phase transitions of valence bond solids in spin-1/2 Heisenberg systems using projector quantum Monte Carlo in the valence bond basis, and the magnetic field induced transition to a canted antiferromagnet of the Hubbard model on the honeycomb lattice. The emphasis lies on two projects investigating the phase diagram of the SU(2) and the SU(N)-symmetric Hubbard model on the hexagonal lattice. At sufficiently low temperatures, condensed-matter systems tend to develop order. An exception are quantum spin-liquids, where fluctuations prevent a transition to an ordered state down to the lowest temperatures. Previously elusive in experimentally relevant microscopic two-dimensional models, we show by means of large-scale quantum Monte Carlo simulations of the SU(2) Hubbard model on the honeycomb lattice, that a quantum spin-liquid emerges between the state described by massless Dirac fermions and an antiferromagnetically ordered Mott insulator. This unexpected quantum-disordered state is found to be a short-range resonating valence bond liquid, akin to the one proposed for high temperature superconductors. Inspired by the rich phase diagrams of SU(N) models we study the SU(N)-symmetric Hubbard Heisenberg quantum antiferromagnet on the honeycomb lattice to investigate the reliability of 1/N corrections to large-N results by means of numerically exact QMC simulations. We study the melting of phases as correlations increase with decreasing N and determine whether the quantum spin liquid found in the SU(2) Hubbard model at intermediate coupling is a specific feature, or also exists in the unconstrained t-J model and higher symmetries.
The Hubbard model encapsulates the physics of strongly correlated quantum systems in its most basic form. It has been studied intensively in the context of the high-temperature superconductivity. A number of novel phases were recently proposed for Hubbard-like models on the honeycomb lattice, the structure of graphene. We analyzed the Hubbard model of spin- 12\frac{1}{2}21​ fermions on the honeycomb lattice at half-filling using large-scale quantum Monte Carlo simulations. We find that the weak coupling semimetal and the antiferromagnetic Mott insulator at strong interaction are separated by an extended gapped phase in an intermediate coupling regime. Exploring excitation gaps, various correlation functions as well as probing for flux quantization, we conclude that a quantum spin liquid, lacking any conventional order, emerges with local charge and spin correlations, best described by a resonating valence bonds state.
We examine the magnetic correlations in quantum spin models that were derived recently as effective low-energy theories for electronic correlation effects on the edge states of graphene nanoribbons. For this purpose, we employ quantum Monte Carlo simulations to access the large-distance properties, accounting for quantum fluctuations beyond mean-field-theory approaches to edge magnetism. For certain chiral nanoribbons, antiferromagnetic interedge couplings were previously found to induce a gapped quantum disordered ground state of the effective spin model. We find that the extended nature of the intraedge couplings in the effective spin model for zigzag nanoribbons leads to a quantum phase transition at a large, finite value of the interedge coupling. This quantum critical point separates the quantum disordered region from a gapless phase of stable edge magnetism at weak intraedge coupling, which includes the ground states of spin-ladder models for wide zigzag nanoribbons. To study the quantum critical behavior, the effective spin model can be related to a model of two antiferromagnetically coupled Haldane-Shastry spin-half chains with long-ranged ferromagnetic intrachain couplings. The results for the critical exponents are compared also to several recent renormalization-group calculations for related long-ranged interacting quantum systems.
The many-body correlation between electrons is the origin of many fascinating phenomena in condensed matter systems, such as high temperature superconductivity, superfluidity, fractional quantum Hall effect, and Mott insulator. Strongly correlated systems have been an important subject of condensed matter physics for several decades, especially after the discovery of high temperature cuprate superconductors. In this thesis, we apply first principles quantum Monte Carlo (QMC) method to several representative systems to study the electron correlations in transition metal oxides (vanadium dioxide) and low dimensional electronic systems (graphene and graphene-like two dimensional systems). Vanadium dioxide (VO2) is a paradigmatic example of a strongly correlated system that undergoes a metal-insulator transition at a structural phase transition. To date, this transition has necessitated significant post-hoc adjustments to theory in order to be described properly. We apply first principles quantum Monte Carlo (QMC) to study the structural dependence of the properties of VO2. Using this technique, we simulate the interactions between electrons explicitly, which allows for the metal-insulator transition to naturally emerge, importantly without ad-hoc adjustments. The QMC calculations show that the structural transition directly causes the metal-insulator transition and a change in the coupling of vanadium spins. This change in the spin coupling results in a prediction of a momentum-independent magnetic excitation in the insulating state. While two-body correlations are important to set the stage for this transition, they do not change significantly when VO2 becomes an insulator. These results show that it is now possible to account for electron correlations in a quantitatively accurate way that is also specific to materials. Electron correlation in graphene is unique because of the interplay of the Dirac cone dispersion of pi electrons with long range Coulomb interaction. The random phase approximation predicts no metallic screening at long distances and low energies because of the zero density of states at Fermi level. It is thus interesting to see how screening takes place in graphene at different length scales. We addressed this problem by computing the structure factor S(q) and S(q, ω) of freestanding graphene using ab initio fixed-node diffusion Monte Carlo and the random phase approximation. The X-ray measured structure factor is reproduced very accurately using both techniques, provided that sigma-bonding electrons are included in the simulations. Strong dielectric screening from sigma electrons are observed, which redshifts the pi plasmons resonance frequency at long distance and reduces the effective interactions between pi electrons at short distance. The short distance screening makes suspended graphene a weakly correlated semimetal which otherwise would be an insulator. The third piece of works is dedicated to studying the low energy excitation of many-body systems using extended Koopmans' theorem (EKT). The EKT provides a straight forward way to compute charge excitation spectra, such as ionization potentials, electron affinities from any level of theory. We implemented the EKT within the QMC framework, and performed systematic benchmark studies of ionization potentials of the second- and third-row atoms, and closed- and open-shell molecules. We also applied it to compute the quasiparticle band structure of solids (graphene). For complex correlated systems, identifying relevant low energy physics degrees of freedom is extremely important to understanding the system's collective behavior at different length scales. In this sense, bridging the realistic systems to lower energy effective lattice models that involve fewer but important degrees of freedom is significant to understanding correlated systems. We have formulated three ab initio density matrix based downfolding (AIDMD) methods to downfold the ab initio systems into effective lattice models. We have demonstrated the successfulness of these methods by applying them to molecules (H2) and periodic systems (hydrogen chain and graphene).
The quantum nature of electrons emerges in various exotic ways when they are put together with quantum many-body interactions. In Mott insulating systems with strong electron correlation, frustration and strong quantum fluctuations promote localized electron spins to form nontrivial quantum paramagnetic phases such as quantum spin liquid and valence bond solid preventing the development of conventional magnetic orders. In this thesis, we study such exotic quantum phases in various different frustrated quantum magnets. First, encouraged by the spin liquid phenomenology observed in Ba3XSb2O9 (X=Cu, Ni), we investigate Z2 spin liquids on a three dimensional triangular lattice by employing the Schwinger boson mean-field theory with projective symmetry group analysis. It is found that a nematic spin liquid is energetically favorable on this lattice structure rather than symmetric spin liquids. Next, we study various valence bond solid phases that can appear in kagome lattice antiferromagnets by generalizing the recently proposed phenomenological Z2 gauge theory for the topological Z2 spin liquid state found in the nearest-neighbor kagome lattice Heisenberg model. This work provides a bridge between the topological spin liquid and valence bond solid phases previously proposed for kagome lattice antiferromagnets via vison condensation in the gauge theory. Then, we consider optical conductivity in Mott insulators as an experimental probe to detect quantum paramagnetic phases like valence bond solid. Applying this idea to deformed kagome lattice antiferromagnet Rb2Cu3SnF12 with a 12-site valence bond solid state, we estimate the size of optical conductivity in this quantum magnet. After this, another quantum paramagnet BiCu2PO6 is carefully investigated to clarify its puzzling ground state nature and quasiparticle excitations. Utilizing recent high resolution neutron scattering data, we construct a microscopic spin model and also an effective theory for the low energy spin excitations in the compound. We find significant influences of magnetic anisotropies on the ground state and quasiparticle dynamics. Lastly, we investigate emergent quantum phases in the thin film geometries of the pyrochlore iridates, where a number of exotic quantum ground states are proposed to occur in bulk materials as a result of the interplay between electron correlation and strong spin-orbit coupling. The fate of these bulk phases, as well as the novel quantum states that may arise only in a thin film setting, are studied via a theoretical model that allows layer-dependent magnetic structures.