We consider the problem of ordering probability distributions which take the values in a set having only an ordering. Using the cumulative distribution function we are able to introduce some fundamental proper-ties required of such procedures. We then consider ordering procedures that are based on the mapping of a probability distribution into a single value. Finally we consider an ordering procedure that involves a pairwise comparison of the probability distributions