Meeting Banner
Abstract #0986

A novel deep multimodal contrastive network for early prediction of cognitive deficits using multimodal MRI and clinical data

Zhiyuan Li1,2, Hailong Li1, Nehal Parikh3, Jonathan Dillman1, Anca Ralescu2, and Lili He1
1Imaging Research Center, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, United States, 2Department of Computer Science, University of Cincinnati, Cincinnati, OH, United States, 3The Perinatal Institute, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, United States

Synopsis

Keywords: Machine Learning/Artificial Intelligence, Brain Connectivity, Contrastive Learning, Cognitive DeficitsDeep learning has shown promising results in early predicting cognitive deficits in very preterm infants using multimodal brain MRI data, acquired soon after birth. Prior methods focus on the feature fusion of different modalities but ignore the latent high-order feature similarity information. In this study, we propose a novel deep multimodal contrastive network using T2-weighted structural MRI (sMRI), diffusion tensor imaging (DTI), resting-state functional MRI (rsfMRI), and clinical data to predict later cognitive deficits. Our proposed model significantly improved predictive power compared to other peer models for early diagnosis of cognitive deficits.

How to access this content:

For one year after publication, abstracts and videos are only open to registrants of this annual meeting. Registrants should use their existing login information. Non-registrant access can be purchased via the ISMRM E-Library.

After one year, current ISMRM & ISMRT members get free access to both the abstracts and videos. Non-members and non-registrants must purchase access via the ISMRM E-Library.

After two years, the meeting proceedings (abstracts) are opened to the public and require no login information. Videos remain behind password for access by members, registrants and E-Library customers.

Click here for more information on becoming a member.

Keywords