The aim of this paper is to propose a multiple ocular artifacts (OAs) removal method using the high order tensor algorithm. Four categories high order tensor methods are adopted to separate the real electroencephalogram (EEG) and ocular signals by underdetermined blind source separation (UBSS) model. The correlation coefficient and the non-negativity are adopted to choose the suitable UBSS algorithm. The ocular components are identified by the kurtosis value after separating between EEG and ocular signals. Then, the free-ocular sources components are reconstructed to EEG without OAs. The simulations show that the proposed method can effectively remove the OAs. At the same time, it also can retain the useful information after removing OAs.