We evaluated repeatability and diagnostic performance of commonly used radiomic features for prostate cancer (PCa) DWI obtained using b values up to 2000 s/mm2. Forty-eight men with diagnosed PCa under two repeated 3T MRI examinations performed on the same day. Whole mounts prostatectomy sections were manually matched with in-vivo MRI data. Fourteen of the evaluated 575 features demonstrated high repeatability with ICC(3,1)>0.9 and AUC(Gleason score 3+3 vs >3+3 PCa)>0.6. Many of the conventional radiomics feature demonstrate high AUC but low repeatability (low ICC(3,1) values)stressing the fact that high classification potential using single acquisition does not necessarily mean good overall performance.