CropPlantHarvest is the first annual dataset of corn and soybean planting and harvesting dates across the U.S. Midwest, mapped at 500 m resolution from 2001 to 2024. The dataset is provided as an image collection consisting of four layers: corn planting dates, corn harvesting dates, soybean planting dates, and soybean harvesting dates. Each pixel value represents the specific day of year (DOY, e.g., 123) corresponding to the estimated planting or harvesting date. The most current version is `CropPlantHarvest.zip`. For technical details about the methods used to create this dataset, please refer to Liu et al. (2023), Liu et al. (2025), and the data description paper available soon. This research was supported in part by the Illinois Computes project which is supported by the University of Illinois Urbana-Champaign and the University of Illinois System.