This article is devoted to studying the null controllability of evolution equations with memory terms. The problem is challenging not only because the state equation contains memory terms but also because the classical controllability requirement at the final time has to be reinforced, involving the contribution of the memory term, to ensure that the solution reaches the equilibrium. Using duality arguments, the problem is reduced to the obtention of suitable observability estimates for the adjoint system. We first consider finite-dimensional dynamical systems involving memory terms and derive rank conditions for controllability. Then the null controllability property is established for some parabolic equations with memory terms, by means of Carleman estimates.