Let G be a group and Autc(G) be the group of all central automorphisms of G. We know that in a finite p-group G, Autc(G) = Inn(G) if and only if Z(G) = G′ and Z(G) is cyclic. But we shown that we cannot extend this result for infinite groups. In fact, there exist finitely generated nilpotent groups of class 2 in which G′ =Z(G) is infinite cyclic and Inn(G) < C* = Autc(G). In this article, we characterize all finitely generated groups G for which the equality Autc(G) = Inn(G) holds.