An increasing body of evidence underlines the prominent role of the immune microenvironment in cancer growth, invasion and metastasis. The local immune responses are specialized in the different organs. We will discuss the composition of the immune microenvironments and their role on tumor development in two cancers developing in opposite contexts: in the lung, which is at the interface of the outside world and in the eye, which is, an immunoprivileged site protected from it. We demonstrate that the immune system plays a major role in control of tumors, despite of these highly different tissue microenvironments.