Cancer metastases to the brain is a major cause of fatality in patients. Finding all the metastases is crucial to clinical treatment planning as today’s radiation therapy can target up to 20 individual metastases, making it necessary for clinicians to detect and marking multiple metastases in practice. Detecting brain metastases, however, is very challenging because the objects are small and of low contrast. Computer-aided detection of metastases can be highly valuable to improve the accuracy and efficiency of a human reader. In this work, we developed a deep learning-based pipeline for finding metastases on brain MRI.