Different entropy concepts (increasingly general or particular depending on one’s point of view), the underlying knowledge (conditions, information) and inequalities associated to them are reviewed. Among the latter is the maximum entropy principle. It is proposed that entropies (in particular newly introduced ones) should be justified by showing that their maximization yields useful probability distributions, appropriate for the practical situation.