Meeting Banner
Abstract #0781

Stop copying contours from Cine to LGE: multimodal learning with disentangled representations needs zero annotations

Agisilaos Chartsias1, Haochuan Jiang1, Giorgos Papanastasiou2,3, Chengjia Wang2,3, Colin Stirrat2,3, Scott Semple2,3, David Newby2,3, Rohan Dharmakumar4, and Sotirios A Tsaftaris1,5
1School of Engineering, University of Edinburgh, Institute of Digital Communications, Edinburgh, United Kingdom, 2Edinburgh Imaging Facility QMRI, Edinburgh, United Kingdom, 3Centre for Cardiovascular Science, Edinburgh, United Kingdom, 4Cedars Sinai Medical Center, Los Angeles, CA, United States, 5The Alan Turing Institute, London, United Kingdom

We propose a novel deep learning method, Multi-modal Spatial Disentanglement Network (MMSDNet), to segment anatomy in medical images. MMSDNet takes advantage of complementary information provided by multiple sequences of the same patient. Even when trained without annotations, it can segment anatomy (e.g., myocardium) in Late Gadolinium Enhancement (LGE) images, which is essential for assessing myocardial infarction. This is achieved by transferring knowledge from the simultaneously acquired cine-MR data where annotations are easier to be obtained. MMSDNet outperforms classical methods including non-linear registration, and simple copying of contours, as well as the state-of-the-art U-Net model.

How to access this content:

For one year after publication, abstracts and videos are only open to registrants of this annual meeting. Registrants should use their existing login information. Non-registrant access can be purchased via the ISMRM E-Library.

After one year, current ISMRM & ISMRT members get free access to both the abstracts and videos. Non-members and non-registrants must purchase access via the ISMRM E-Library.

After two years, the meeting proceedings (abstracts) are opened to the public and require no login information. Videos remain behind password for access by members, registrants and E-Library customers.

Click here for more information on becoming a member.

Keywords