Cells regulate gene expression by changing the concentration and activity of transcription factors (TFs). The response of each gene to changes in TF activity is generally assumed to be encoded in the promoter. Here we show that, even when the promoter itself remains constant, each gene has a unique TF dose response curve. Many genes have an intrinsic ability to either buffer or amplify the effects of high promoter activity. We present a coupled mathematical model and experimental system for quantifying this property. Promoter activity buffering can be encoded by sequences in both the open reading frame and 3UTR and can be implemented by both autoregulatory feedback loops and by titration of limiting trans regulators. We show experimentally that promoter activity buffering insulates cells from fitness defects due to misexpression. The response of genes to changes in [TF] is encoded by sequences outside of the promoter, and this effect can either insulate or amplify the effects of aneuploidy and misregulation on organismal fitness.