Radiomics studies often requires researchers spend large amount of time trying out various combinations of different data preprocessing strategies, feature selection algorithms, classifiers, and associated hyper-parameters to find the best model. We developed a tool with graphics user interface named FeAture Explorer (FAE) to automate this tedious process. With FAE, to find the best model, researchers only need to specify the choices for each step in radiomics pipeline and let FAE do the rest. Results, such as clinical statistics of each model, can be reviewed and visualized. We used the PROSTATEx dataset to illustrate the function of FAE.