As is broadly recognized, the straightforward application of the Diamond-Mirrlees (1971) production efficiency theorem implies that when lump-sum taxation is not available, then it is optimal for the government in a small open economy to rely on taxes on the net demand of households rather than on border taxes to finance its resource requirements. However, the theorem does not hold when taxation is associated with administrative costs. The present paper explores the implications for optimal taxation and for desirable directions of tax-tariff reform in countries at different levels of economic development taking into account the costs of tax administration. The paper lends support to and clarifies the reasons for the criticism by Emran and Stiglitz (2003, 2005) of the IMF and the World Bank's recommendation to developing countries to adopt VAT to replace border taxes.