A compact, orthogonally polarized, gain-switched a-cut Ho:LuLiF4 laser with intra-cavity pumping by a self-Q-switched Tm:YAP laser is demonstrated here for the first time. The π-polarization laser at 2052 nm and σ-polarization laser at 2066 nm were experimentally observed with the maximum output power values of 299 mW and 126 mW, respectively, and the two polarization directions were always kept mutually orthogonal as the pump power increased. The ratio of the output power between the two orthogonal polarization lasers was nearly 1:1 at a pump power of 18.4 W. The minimum pulse width of the Ho:LLF laser was 326 ns, the maximum repetition rate was 24 kHz, and the maximum average energy was 28 μJ.