This work presents a method for constructing phantoms suitable for diffuse optical mammography. They are based on Polydimethylsiloxane silicones, with the characteristic of being anthropomorphic, and having similar mechanical and optical properties as a real breast. These phantoms are useful for testing the performance of diffuse optical imaging devices in the near infrared, both in transmittance and reflectance geometries, since they can be constructed containing inclusions, to simulate breast tumors. An alternative component to be used as scattering agent, that is easier to handle than traditional scattering agents, is also studied. The optical properties of the phantoms were tested varying the concentration of scattering and absorbing agents, while their mechanical properties were modified by adding a silicone fluid to the basic mixture. Finally, the phantoms were tested by Diffuse Optical Imaging experiments, and these images were compared to the ones obtained by conventional ultrasound techniques. Results show that the constructed anthropomorphic phantoms properly reproduce the optical and mechanical characteristics of human breasts, and are suitable to be used in Diffuse Optical Imaging.