Images produced by ultrasound systems are adversely hampered by a stochastic process known as speckle. A despeckling method based upon removing outlier is proposed. The method is developed to contrast enhance B-mode ultrasound images. The contrast enhancement is with respect to decreasing pixel variations in homogeneous regions while maintaining or improving differences in mean values of distinct regions. A comparison of the proposed despeckling filter is compared with the other well known despeckling filters. The evaluations of despeckling performance are based upon improvements to contrast enhancement, structural similarity, and segmentation results on a Field II simulated image and actual B-mode cardiac ultrasound images captured in vivo.