The influence of the effects of the degradation of materials on the seismic fragility of Cultural Heritage buildings in Granada (Spain) is investigated. The degradation of the material, which mainly happens at the lower levels of the façades, is obtained by using 3D photogrammetry data. Fragility curves for three cultural heritage constructions in Granada are calculated by using FE nonlinear dynamic analyses for both non-deteriorated and deteriorated geometries. The Finite Elements (FE) models, based on the macro-modelling technique, are subjected to ground motions for the city of Granada, which were selected by considering Probabilistic Seismic Hazard Analysis (PSHA) methodology with their probability of occurrence. The response of each model is analyzed for different seismic Intensity Measure (IM) levels, which, in this study, correspond to average pseudo-acceleration. The procedure is applied to three monuments in Granada that were built with two different constructions materials: calcarenite and rammed earth. The damage mechanisms considered are roof displacement or maximum compressive principal stress, depending on each case. The results show that the restoration works that have been carried out has prevented structural failures in the rammed earth construction studied, and that, during future seismic events, special attention must be paid to the level of compressive strengh reached in the Santa Pudia calcarenite used at the San Jerónimo monastery.