Orthogonal space-time block codes (OSTBCs) yield full diversity gain even while requiring only a linear receiver. Such full-rate (rate-one) orthogonal designs are available for complex symbol constellations only for N=2 transmit antennas. In this paper, we propose a new family of full-rate space-time block codes (STBCs) using a single parameter feedback for communication over Rayleigh fading channels for N=3,4 transmit antennas and M receive antennas. The proposed rate-one codes achieve full diversity, and the performance is similar to maximum receiver ratio combining. The decoding complexity of these codes are only linear even while performing maximum-likelihood decoding. The partial channel information is a real phase parameter that is a function of all the channel gains, and has a simple closed-form expression for N=3,4. This feedback information enables us to derive (channel) orthogonal designs starting from quasi-orthogonal STBCs. The feedback complexity is significantly lower than conventional closed-loop transmit beamforming. We compare the proposed codes with the open-loop OSTBCs and also with the closed-loop equal gain transmission (EGT) scheme which uses equal power loading on all antennas. Simulated error-rate performances indicate that the proposed channel orthogonalized STBCs significantly outperform the open-loop orthogonal designs, for the same spectral efficiency. Moreover, even with significantly lower feedback and computational complexity, the proposed scheme outperforms the EGT technique for M>N