There has been an increasing interest for systems that combine a linear accelerator with a MRI. The goal of such systems is to allow for real-time adaptive radiotherapy; to have the ability to track a region of interest for the purpose of accurate radiation delivery. This requires the ability to image in real-time. We investigated the use of convolution neural networks (CNNs) for the purpose of real-time imaging. The reconstruction time of our preliminary data was 150 ms using a NVIDIA 1080Ti GTX GPU. Further optimization of the CNN parameters may decrease the reconstruction time below 100 ms.