Chemical Shift Imaging (CSI) allows for the quantification of brain metabolite concentrations across multiple voxels/slices. However, issues with model fit (e.g., suboptimal standard deviation, line width/full width at half-maximum, and/or signal-to-noise ratio) can result in the significant loss of usable voxels. Here, we show that an image restoration method called “inpainting” can be successfully used to restore poorly fitted CSI voxels. This method exhibits superior performance (lowest root-mean-square errors) compared to more traditional methods. Inpainting and similar techniques can prove particularly useful as a means of minimizing voxel loss in group voxelwise analyses in standard space.