Procyclical fiscal policy can be caused by either procyclical government expenditure, countercyclical taxes or both. The majority of models which try to explain procyclical fiscal policy as the result of optimal policy have procyclical government expenditures. This paper develops a model which optimally generates procyclical fiscal policy while keeping government expenditures acyclical. Instead, taxes are optimally countercyclical. The model uses endogenous sovereign default to generate an environment where interest rates are lower in booms than in recessions. If household's have insufficient access to financial instruments it is optimal for the government to lower taxes and borrow during booms. This enables impatient households to benefit from the lower interest rates in booms by helping the consumer bring consumption forward.