The lithospheric mantle is intrinsically heterogeneous and anisotropic. These two properties govern the repartition of deformation, controlling intraplate strain localization and development of new plate boundaries. Geophysical and geological observations provide clues on the types, ranges, and characteristic length scales of heterogeneity and anisotropy in the lithospheric mantle. Seismic tomography points to variations in geothermal gradient and hence in rheological behavior at scales of hundreds of km. Seismic anisotropy data substantiate anisotropic physical properties consistent at scales of tens to hundreds of km. Receiver functions imply lateral and vertical heterogeneity at scales < 10 km, which might record gradients in composition or anisotropy. Observations on naturally deformed peridotites establish that compositional heterogeneity and Crystal Preferred Orientations (CPOs) are ubiquitous from the mm to the km scales. These data allow discussing the processes that produce/destroy heterogeneity and anisotropy and constraining the time scales over which they are active. This analysis highlights: (i) the role of deformation and reactive percolation of melts and fluids in producing compositional and structural heterogeneity and the feedbacks between these processes, (ii) the weak mechanical effect of mineralogical variations, and (iii) the low volumes of fine-grained microstructures and difficulty to preserve them. In contrast, olivine CPO and the resulting anisotropy of mechanical and thermal properties are only modified by deformation. Based on this analysis, we propose that strain localization at the plate scale is, at first order, controlled by large-scale variations in thermal structure and in CPO-induced anisotropy. In cold parts of the lithospheric mantle , grain size reduction may contribute to strain localization, but the low volume of fine-grained domains limits this effect.