Summary: We explore the impact of variable selection on statistical inferences in linear regression models. In particular, the generalized final prediction error criterion of \textit{R. Shibata} [ibid. 71, 43-49 (1984; Zbl 0543.62053)] is considered and it is found, among other things, that inferences on the regression coefficients are impaired by the variable selection procedure. Most notably, the sizes of the nominal confidence sets tend to be inflated if they are derived based on the selected model. On the other hand, variable selection does not seem to have much impact on the inferences for the error variance. Our results complement those obtained by \textit{B. M. Pötscher} [Econ. Theory 7, 163-185 (1991)] in which testing procedures are used for variable selection.