Meeting Banner
Abstract #1980

Deep Learning-Based Multistep Deformable Medical Image Registration for Multimodal Minimal-Invasive Image-Guided Intervention

Anika Strittmatter1,2, Lothar R. Schad1,2, and Frank G. Zöllner1,2
1Computer Assisted Clinical Medicine, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany, 2Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany

Synopsis

Keywords: Analysis/Processing, Machine Learning/Artificial Intelligence, Image Registration, Multimodal, Minimal-Invasive, Image-Guided Intervention

Motivation: We developed neural networks for deformable medical image registration using multiple steps and resolutions.

Goal(s): To investigate how multiresolution networks impact registration results compared to monostep-monoresolution networks.

Approach: The networks were trained unsupervised with Mutual Information and Gradient L2 loss. We compared them with a monoresolution-monostep network and the classical registration method SimpleElastix. We evaluated the multistep networks using a three-dimensional liver dataset with CT and T1-weighted MR scans.

Results: Incorporating multiple steps and resolutions in the neural network yielded registration results with high spatial alignment and medically plausible transformations (minimal image folding) and fast registration times of less than half a second.

Impact: Since the inclusion of multiple steps and resolutions within the neural network leads to improved registration results, multistep registration methods should be used whenever possible. Consequently, more work should be invested in developing multistep-multiresolution networks for multimodal medical image registration.

How to access this content:

For one year after publication, abstracts and videos are only open to registrants of this annual meeting. Registrants should use their existing login information. Non-registrant access can be purchased via the ISMRM E-Library.

After one year, current ISMRM & ISMRT members get free access to both the abstracts and videos. Non-members and non-registrants must purchase access via the ISMRM E-Library.

After two years, the meeting proceedings (abstracts) are opened to the public and require no login information. Videos remain behind password for access by members, registrants and E-Library customers.

Click here for more information on becoming a member.

Keywords