To protect image data privacy, a secure and fast image encryption algorithm using hyper-chaos based key generator and vector operation is proposed. Firstly, we introduce a novel post-process method to create a key matrix for significantly reducing the iterations of the hyperchaotic system from $W\,\,\times \,\,H$ /4 to $2W$ for an image size of $W\,\,\times \,\,H$ . And within the post-process, a random selector driven by the piecewise linear chaotic map ensures the good randomness and unpredictability of the generated key matrix. Secondly, the vector operation is employed to accelerate the cipher block chaining based diffusion process, so the plain image can be parallel encrypted row by row and column by column with high efficiency. Thirdly, we utilize a Logistic map to quickly produce an initial vector for the vectorized diffusion process. Finally, the proposed algorithm is evaluated by some common security and performance tests. Experimental results show that the cipher image can pass all tests of NIST SP 800–22 with $P$ -values $\gg ~0.01$ , its correlation coefficient between pixels is close to 0, and the entropy is greater than 7.999. Combined with other results of security tests, we can safely conclude that the proposed image encryption algorithm provides adequate protection against statistical, brute-force, chosen-plaintext, and other common types of attacks. In addition, the time complexity is in the order of ${O}$ ( $W+H$ ) and the average encryption time of 512 $\times $ 512 images is only 0.023s. The results indicate that our algorithm with high security and fast speed can meet the requirements of real-time confidential transmission of massive image data.