Fast data acquisition in MRI is vastly in demand and scan time depends on the number of acquired k-space samples. The data-driven methods based on deep networks have resulted in promising improvements, compared to the conventional methods. The connection between deep network and Ordinary Differential Equation (ODE) has been studied recently. Here, we propose an ODE-based deep network for MRI reconstruction to enable the rapid acquisition of MR images with improved image quality. Our results with undersampled data demonstrate that our method can deliver higher quality images in comparison to the reconstruction methods based on the UNet and Residual networks.