Abstract Immune checkpoint blockade (ICB) therapies have improved the overall survival (OS) of many patients with advanced cancers. However, the response rate to ICB varies widely among patients, exposing non-responders to potentially severe immune-related adverse events. The discovery of new biomarkers to identify patients responding to ICB is now a critical need in the clinic. We therefore investigated the tumor microenvironment (TME) of advanced clear cell renal cell carcinoma (ccRCC) samples from primary and metastatic sites to identify molecular and cellular markers of response to ICB. We revealed a significant discrepancy in treatment response between subgroups based on cell fractions inferred from metastatic sites. One of the subgroups was enriched in non-responders and harbored a lower fraction of CD8+ T cells and plasma cells, as well as a decreased expression of immunoglobulin genes. In addition, we developed the Tumor-Immunity Differential (TID) score which combines features from tumor cells and the TME to accurately predict response to anti-PD-1 immunotherapy (AUC-ROC=0.88, log-rank tests for PFS P < 0.0001, OS P = 0.01). Finally, we also defined TID-related genes ( YWHAE , CXCR6 and BTF3 ), among which YWHAE was validated as a robust predictive marker of ICB response in independent cohorts of pre- or on-treatment biopsies of melanoma and lung cancers. Overall, these results provide a rationale to further explore variations in the cell composition of metastatic sites, and underlying gene signatures, to predict patient response to ICB treatments. One Sentence Summary Tumor microenvironment balance of metastasis and associated genes are key predictors of immunotherapy patient response in kidney cancer.