Fine-grained environmental data across large extents are needed to resolve the processes that impact species communities from local to global scales. Ground-based images (GBIs) have the potential to capture habitat complexity at biologically relevant spatial and temporal resolutions. Moving beyond existing applications of GBIs for species identification and monitoring ecological change from repeat photography, we describe promising approaches to habitat mapping, leveraging multimodal data and computer vision. We illustrate empirically how GBIs can be applied to predict distributions of species at fine scales along Street View routes, or to automatically classify and quantify habitat features. Further, we outline future research avenues using GBIs that can bring a leap forward in analyses for ecology and conservation with this underused resource.