Diffusion-weighted MRI of the breast is a promising technique that can detect and characterize breast cancer sensitively and safely. However, geometric distortions of echo-planar imaging (EPI) due to field inhomogeneity and eddy currents has limited its clinical application. Conventional correction methods in breast DWI need additional B0 field maps that are either measured or estimated, and achieve limited effects at tissue interfaces. In this work, we attempted the feasibility of the distortion-free breast DWI using a point spread function (PSF) encoded method. The results showed higher fidelity and better image quality on breast DWI, which could facilitate the anatomical/DWI image registration and improve the quantitative measurements of the breast.