We introduce a novel coherent diffraction imaging technique based on ptychography that enables simultaneous full-field imaging of multiple, spatially separate, sample locations. This technique only requires that diffracted light from spatially separated sample sites be mutually incoherent at the detector, which can be achieved using multiple probes that are separated either by wavelength or by orthogonal polarization states. This approach enables spatially resolved polarization spectroscopy from a single ptychography scan, as well as allowing a larger field of view to be imaged without loss in spatial resolution. Further, we compare the numerical efficiency of the multi-mode ptychography algorithm with a single mode algorithm.