We discuss the issue of complementarity between the confining phase and the Higgs phase for gauge theories in which there are no light particles below the scale of confinement or spontaneous symmetry breaking. We show with a number of examples that even though the low energy effective theories are the same (and trivial), discontinuous changes in the structure of heavy stable particles can signal a phase transition and thus we can sometimes argue that two phases which have different structures of heavy particles cannot be continuously connected and thus the phases cannot be complementary. We discuss what this means and suggest that such "stability conditions" can be a useful physical check for complementarity.

12 pages