Optical correlators are subject to point-spread and field aberrations in both the Fourier (filter) plane and the correlation (output) plane. These aberrations can be both quantitatively and qualitatively different within a given system. Analysis of a simple correlator using identical spatial light modulators in the input and filter planes shows that even a well-corrected system of this type will be limited in performance by diffraction effects.