Colletotrichum acutatum is a cosmopolitan and damaging plant pathogen of temperate, subtropical, and tropical fruits and causes anthracnose on olive (Olea europaea L.). Three olive cultivars showing a variable response to infection by C. acutatum were selected to a preliminary study of pathogen development. Fruit samples, from susceptible and tolerant cultivars, were taken at 0, 24, 48, 72, and 192 h after inoculation for a microscopic and histological study of the infection and colonization process. The aim of this study was to compare the infection process: conidial germination, germ tube and appressorium formation, hyphal growth, and mesocarp colonization in susceptible and tolerant olive cultivars as a condition for further exploration of disease development, which is required to develop cultivars with improved resistance to anthracnose. The rate of mesocarp colonization differed between the susceptible and tolerant cultivars, and both intracellular hemibiotrophy and subcuticular intramural necrotrophy were observed. Hemibiotrophic infection predominated in the moderately tolerant cultivar.