In this contribution, KNIH algorithm and Ordered Statistic Decoding (OSD) algorithm are investigated, based on which, a novel KNIH-OSD parallel decoding scheme for LDPC codes is proposed. KNIH decoding algorithm processes certain LRPs of a received sequence, while OSD algorithm processes certain MRIPs of a received sequence. If there are too many errors in MRIPs, the OSD algorithm will fail, on the contrary, if there are too many errors in LRPs, the KNIH algorithm will fail. This contribution proposes a parallel decoding scheme based on the complementary characteristic of these two algorithms. Simulation results show that the proposed scheme is feasible and effective. Compared with OSD and KNIH algorithm, the decoding performance is improved.