In this paper, the Cohen-Grossberg neural networks with distributed delays are considered without assuming any symmetry of connection matrix and differentiability of the activation functions. By constructing a novel Lyapunov functional, new sufficient criteria for the existence of a unique equilibrium and global exponential stability of the network are derived. Those results are shown to generalize the previous global exponential stability results derived in the literature.