To improve the performance of polar codes with finite length, a scheme of concatenating polar codes as inner codes and non-binary low-density parity-check (NBLDPC) codes as outer codes is first proposed in this paper, which utilizes the excellent error performance of NBLDPC codes to improve the performance of polar codes at finite length. In addition to this, a novel decoding scheme is proposed, named as BP+Segment-SCL decoding, in which segment successive cancellation list (Segment-SCL) decoding and belief propagation (BP) decoding are employed for polar codes and NBLDPC codes, respectively, and an early stopping criteria is employed to reduce decoding complexity. Simulation results show that our proposed NBLDPC Polar codes with BP+Segment-SCL decoding scheme can achieve 0.35dB gain, compared to RS-Polar codes with Generalized Minimum Distance (GMD) decoding, while with comparable decoding complexity and latency. NBLDPC-Polar codes also outperform pure polar codes with successive cancellation (SC) decoding at high SNRs.