We propose a dual-polarity readout technique to eliminate residual segmentation artifacts in interleaved multi-shot EPI despite established echo time shifting. The method only requires retrospective averaging of two or more complex-valued images acquired with alternating EPI readout polarity across measurements. The approach has been integrated into a custom skipped-CAIPI 3D-EPI sequence, combining highly segmented EPI with CAIPIRINHA parallel imaging. We present dual-polarity skipped-CAIPI 3D-EPI for ultrahigh-resolution, rapid, motion-robust whole-brain T2*-weighted imaging and quantitative susceptibility mapping at 7 Tesla. We demonstrate its capability to acquire exquisite imaging contrast at 0.7mm and 0.4mm isotropic resolution in only 1:15 and 6:14 [min:s], respectively.