Several theorems are proved which exhibit the impossibility of constructing nontrivial products of the Lorentz group with internal symmetry groups for some physically interesting examples. It is also shown that if the Lorentz group is replaced by the Galilei group, qualitatively different results are obtained; a "linear" breakdown of internal symmetry is possible.