Diffusion weighted magnetic resonance (DWMR or DW) imaging is a fast evolving technique to investigate the connectivity of brain white matter by measuring the self-diffusion of the water molecules in the tissue. Registration is a key step in group analysis of the DW images that may lead to understanding of functional and structural variability of the normal brain, understanding disease process, and improving neurosurgical planning. In this paper, we present a new method for registering DW images. The method works directly on the diffusion weighted images without using tensor reconstruction, fiber tracking, and fiber clustering. Therefore, the performance of the method does not rely on the accuracy and robustness of these steps. Moreover, since all the information in the original diffusion weighted images is used for registration, the results of the method is robust to imaging noise. We demonstrate the method on intra-subject registration with an affine transform using DW images acquired on the same scanner with the same imaging protocol. Extension to deformable registration for images acquired on different scanners and/or with different imaging protocols is also discussed.