We demonstrate single-pixel coherent diffraction imaging, whereby broadband terahertz waveforms passed through a slanted phase retarder (SPR), diffracted from an object, were measured by a terahertz detector located in the far field. For one dimensional imaging, the fixed-location single-pixel broadband detector simultaneously measured all the spatial frequency components of the object because the frequency components of the source maintain a one-to-one correspondence with the object’s spatial frequency. For two dimensional imaging, the angular position of the SPR enabled the diffracted terahertz wave to carry an angular projection image of the object.