University education has been connecting bridges to sophisticated life aimed at propelling the machine of the sustainable economy of any country of the world. This stage of education is characterized by equipping an individual to become a useful and acceptable member of the society, thereby contributing to the continuous existence of the human race on the surface of the earth. It has been observed lately that technological innovations around the world are now creeping into university education in Nigeria; e-learning is now becoming a necessity rather than a choice. Unfortunately, the reality of e-learning in Nigerian University education seems to be hampered by some identified factors ranging from shortage of funds for university education, poor ICT literacy among academic staff, and shortage of relevant ICT for e-learning. It is to these observed realities that this paper is aimed at examining the challenges confronting the actualization of e-learning in Nigerian Universities. Recommendations were made as ways to the fore.