This dataset was generated throughout experiments performed under a research project funded by CNPq (Conselho Nacional de Desenvolvimento Científico e Tecnológico), grant number 408444/2021-5. This dataset contains: A CSV file with measurements of morphological parameters (plant height and canopy diameter) taken on week 15 after seeding the pepper plants. Three columns can be found in the file (Filename, PH and CD). Filename identifies the subfolder of images for which each line of the CSV file corresponds. PH denotes plant height, measured in centimeters (cm). CD denotes canopy diameter, measured in centimeters (cm). 120 lines are recorded in the CSV file, corresponding to all possible combinations of Greenhouse growing conditions (2 different values), Repetitions (4 different values), and Treatment (15 different values) A set of photographs taken from several species of pepper plants (Capsicum spp.) weekly at eight different dates (starting from week 8 to 15 after seeding). A total of 15 treatments were used, with 4 repetitions for each treatment. Additionally, 2 growing conditions (controlled greenhouse vs uncontrolled greenhouse) was considered too. For each particular plant (experimental unit), a total of 19 photos were taken, placing the plant in a wooden booth and rotating the plant 20º from one photo to another (initial rotation and final rotation were acquired even they represent the same viewpoint). The folder structure of the images is organized as follows: Root folder ↳ Week ↳ Greenhouse ↳ Repetition ↳ Treatment where: "Week": represents the date when the photos were taken. Possible values are "Week08", "Week09", "Week10", "Week11", "Week12", "Week13", "Week14" and "Week15". "Greenhouse": represents the growing conditions of the plants. Possible values are "CG" (controlled greenhouse) and "UG" (uncontrolled greenhouse). "Repetition": represents the instance of the plant from same treatment. Four repetitions were used in the experiments where the data come from. Possible values are "B1", "B2", "B3" and "B4". "Treatment": represents the accession from which the seeds came from, with codes corresponding to germplasm bank codes at the CPCE/UFPI Active Germplasm Bank. Possible values are "T1", "T2", "T3", "T4", "T5", "T6", "T7", "T8", "T9", "T10", "T11", "T12", "T13", "T14" and "T15". The following table shows the correspondence of treatment number to germplasm code and the species as well. Treatment number Germplasm code Common name Scientific name 1 CPCE 008 Maya black blood Capsicum annuum 2 CPCE 012 Masquerade Capsicum frutescens 3 CPCE 003 Floribella Capsicum sp. 4 CPCE 013 Bolivian rainbow Capsicum annuum 5 CPCE 005 Calypso Capsicum annuum 6 CPCE 006 Pyramid ornamental Capsicum annuum 7 CPCE 007 Black pyramid Capsicum frutescens 8 CPCE 009 Black cuban Capsicum annuum 9 CPCE 010 Black pearl Capsicum annuum 10 CPCE 011 Purple tiger variegated Capsicum annuum 11 CPCE 014 Medusa Capsicum annuum 12 CPCE 017 Bird’s eye baby ornamental Capsicum annuum 13 CPCE 018 Not identified Capsicum sp. 14 CPCE 019 Not identified Capsicum sp. 15 CPCE 020 Not identified Capsicum sp.