This report presents an investigation on the convergence behaviour of Backpropagation and Kohonen neural networks. The causes of convergence problems have been identified and current techniques for overcoming them are reported. Two new techniques are also presented for improvement of the convergence rate of the Backpropagation neural network. The outcome of this investigation is encapsulated in a simulation software package which includes most of the current techniques and those proposed by the author.