An effective Hamiltonian for the Bose subsystem for the mixture of ultracold atomic clouds of bosons and fermions is obtained by integrating out the fermion degrees of freedom. Using the effective Hamiltonian, a collapse of the trapped boson-fermion mixture due to the boson-fermion attractive interaction without and in the presence of the quantized vortices is studied in the framework of variational Bose wave function and Thomas-Fermi approximation. The properties of the
87Rb and
40K mixture are analyzed quantitatively. The critical number of bosons for the collapse transition is estimated without and in the presence of the vortices as a function of the fermion number. It is shown that the critical number of bosons increases in the presence of the vortex. The vortex critical velocities are calculated as functions of the numbers of bosons and fermions.