The phase structure of four-dimensional lattice gauge theories based on finite non-Abelian groups is studied by Monte Carlo computations. All models examined exhibit a two-phase structure with a first-order phase transition. In three systems where the gauge group is a discrete subgroup of SU(2) the critical temperature moves toward zero as the order of the group increases and the high-temperature phase has confining properties.