This study investigated the association between alterations in cerebral morphology and neuroticism. Grey matter thickness, cortical area, and volume were calculated in 110 healthy right-handed subjects and correlations with neuroticism scores performed. Negative correlations between neuroticism and cortical area/volume and positive correlations between neuroticism and grey matter thickness were found in occipitotemporal regions. The importance of the ventral visual pathway in emotion processing has been highlighted by structural changes in the occipital and temporal lobe. Alterations in the prefrontal cortex also show the importance emotional control plays in neuroticism. This study provided an additional explanation of structural alterations in neuroticism.