Summary: When evaluating point estimators by means of general loss functions, the expected loss is not always minimal, similar to the case of mean-biased estimators, whose mean squared error can be reduced by accounting for the mean-bias. Depending on the loss function, the so-called Lehmann-bias can be significantly more important than the mean-bias of an estimator. Although a simple decomposition does not hold for expected losses as it does for the mean squared error, the expected loss can still be reduced by correcting for the Lehmann-bias. An asymptotic and a bootstrap-based correction are suggested and compared in small samples for the exponential distribution by means of Monte Carlo simulation.