Applying deep learning to fast MR imaging has been new and highly evolved. This direction utilizes networks to draw valuable prior information from available big datasets and then assists fast online imaging. Nevertheless, most existing works adopt real-valued network structures while MR images are complex-valued. This paper proposes a complex-valued residual network learning framework for parallel MR imaging. Specifically, complex-valued convolution and initialization strategy are provided. Residual connections are also adopted to learn a more accurate prior. Experimental results show that the proposed method could achieve improved complex-valued image reconstruction with much less time compared to GRAPPA and SPIRiT.