The various hurdles in machine learning are beaten by deep learning techniques and then the deep learning has gradually become preeminent in artificial intelligence. Deep learning uses neural networks to kindle decisions like humans. Deep learning flourished as an energetic approach and clarity marked its success in various domains. The study includes some dominant deep learning algorithms such as convolution neural network, fully convolutional network, autoencoder, and deep belief network to analyze the medical image and to detect and diagnose of cancer at an early stage. As early as the detection of cancer than to treat the disease is uncomplicated. Early diagnosis was particularly relevant for some cancers such as breast, skin, colon, and rectum, which prohibit the chance to grow and spread. Deep learning contributes to enhanced performance and better prediction in detection of cancer with medical images. The paper presents the study of a few deep learning software frameworks such as tensor flow, theano, caffe, torch, and keras. Tensor Flow provides excellent functionality for deep learning. Keras is a high-level neural network API that operates above on tensor flow or theano. The survey winds up by presenting several future avenues and open challenges that should be addressed by the researcher in the future.