The “privacy calculus” has been used extensively to describe how people make privacy-related decisions. At the same time, many researchers have found that such decisions are often anything but calculated. More recently, the privacy calculus has been used in service of machine learning approaches to privacy. This position paper discusses the practical and ethical questions that arise from this use of the privacy calculus.