A phase field grain growth model including elastic anisotropy and inhomogeneity was developed to demonstrate the effect of microelasticity on the grain growth. The mechanical response against an external load was found to control grain growth and texture evolution. In contrast to previous macroelastic descriptions, these results showed that elastically soft grains with higher strain energy density can grow at the expense of the elastically hard grains to reduce the total strain energy.