We studied the ground-state phase diagram of spin-1/2 ${J}_{1}\text{\ensuremath{-}}{J}_{2} XY$ model on the square lattice with first-neighbor
J1 and second-neighbor
J2 antiferromagnetic interactions using both infinite density matrix renormalization group (iDMRG) and DMRG approaches. We show that a plaquette valence bond phase is realized in an intermediate region $0.50\ensuremath{\le}{J}_{2}/{J}_{1}<0.54$ between a N\'eel magnetic ordered phase at
J2/J1<0.50 and a stripy magnetic ordered phase at ${J}_{2}/{J}_{1}\ensuremath{\ge}0.54$. The plaquette valence bond phase is characterized by finite dimer orders in both the horizontal and vertical directions. Contrary to the spin-1/2 ${J}_{1}\text{\ensuremath{-}}{J}_{2}$ Heisenberg model, we do not find numerical evidence for a quantum spin liquid phase in the ${J}_{1}\text{\ensuremath{-}}{J}_{2} XY$ model.
We propose a class of variational wave functions, namely the correlated valence bond states, for the frustrated Hamiltonian in the paramagnetic phase. This class of wave functions admits negative amplitude and the same sub-lattice pairing when a bipartite lattice is considered, thus suffers from the negative sign problem. However if applied to small systems, the sign problem is manageable using the standard variational Monte Carlo method. We optimize the wave functions for the J1-J2 Anti ferromagnetic Heisenberg model on a square lattice in the coupling region J2/J1 \in [0.45 : 0.56] for system sizes L = 4, 6, 8. To calculate the correlation functions and the order parameters for larger systems, we make the extensive Monte Carlo samplings using the variational parameters optimized at system size L = 8. We find that the paramagnetic phase is a gap-less spin liquid in the entire range of J2/J1 \in [0.45 : 0.56] with a gap-less singlet excitation and a gaped triplet excitation.
The nature of quantum spin liquids is studied for the spin-
1/2 antiferromagnetic Heisenberg model on a square lattice containing exchange interactions between nearest-neighbor sites,
J1, and those between next-nearest-neighbor sites,
J2. We perform variational Monte Carlo simulations together with the quantum-number-projection technique and clarify the phase diagram in the ground state together with its excitation spectra. We obtain the nonmagnetic phase in the region
0.4<J2/J1≤0.6 sandwiched by the staggered and stripe antiferromagnetic (AF) phases. Our direct calculations of the spin gap support the notion that the triplet excitation from the singlet ground state is gapless in the range of
0.4<J2/J1≤0.5, while the gapped valence-bond-crystal (VBC) phase is stabilized for
0.5<J2/J1≤0.6. The VBC order is likely to have the columnar symmetry with a spontaneous symmetry breaking of the
C4v symmetry. The power-law behaviors of the spin-spin and dimer-dimer correlation functions in the gapless region are consistent with the emergence of the algebraic quantum-spin-liquid phase (critical phase). The exponent of the spin correlation
⟨S(0)S(r)⟩∝1/rz+η at a long distance
r appears to increase from
z+η∼1 at
J2/J1∼0.4 toward the continuous transition to the VBC phase at
J1/J1∼0.5. Our results, however, do not fully exclude the possibility of a direct quantum transition between the staggered AF and VBC phases with a wide critical region and deconfined criticality.