The complex potential for neutrons in an infinite nuclear medium is computed in a perturbation calculation up to the second order, using for the nucleon-nucleon interaction a regular potential which fits the low energy two-body data. It is shown that it is possible to fit simultaneously the real and the imaginary part of the optical potential and the binding energy of the nuclear matter at normal density. Some arguments for the convergence of the theory are given.