Summary: We deal with the infinite horizon optimal control problem for a nonlinear system of differential equations with constant delay focussing our attention on its numerical approximation. Dynamic programming is used to get an approximation scheme based on the time discretization of the dynamics and of the pay-off. We prove that the resulting discrete-time approximation scheme converges to the value function of the continuous problem with rate 1.