Pre-existing structural connectivity could well explain predisposition to musical aptitude. The study aimed to associate Individual differences in High Angular Resolution Diffusion Imaging (HARDI) derived structural connectivity to music perception abilities as assessed by the performance in a music perception test. An increased whole brain connectivity was found to be associated with increased performance especially in the sequential music perception measures that comprised of Standard Rhythm, Embedded Rhythm, Accent and Melody. A prevalence of interhemispheric connectivity over intrahemispheric connectivity was also observed. Distinct structural connectivity patterns could thus be a determinant of sequential processing aptitude in music.