Today, modern medical imaging techniques are in the process of developing and implementing machine learning and neural network-based programs to improve diagnosis of several diseases, including cancer. Such methods of image processing are superior to traditional methods of image assessment and reduce the time required and diagnostic error rate. In addition, more advanced programs, in the foreseeable future, will be able to act as a second opinion for the doctor, helping him in making decisions on the choice of techniques for treating patients. In this paper some aspects related to radiomics and radiogenomics, machine learning and the challenges of implementing the latest image evaluation algorithms are discussed.