Meeting Banner
Abstract #2787

Novel deep learning approach combining image reconstruction and diagnostic segmentation

Vanya Saksena1, Christine Müller2, Bernhard Kainz2, and Florian Knoll1
1Computational Imaging Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany, 2IDEA Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany

Synopsis

Keywords: Image Reconstruction, Image Reconstruction

Motivation: Deep-learning-based image reconstruction methods for accelerated magnetic resonance imaging are optimized for global image quality metrics, but lack focus on diagnostically relevant features during training and reconstruction.

Goal(s): A novel approach combining reconstruction and segmentation during training is investigated, incorporating feedback on clinically relevant features for reconstruction.

Approach: Pretrained reconstruction (E2E-VN) and segmentation models (nnUNet) are connected. The reconstruction model is trained with a weighted combination of reconstruction and segmentation loss. Training and evaluation are performed on fastMRI+ data.

Results: The proposed method resulted in improved image quality of reconstructed images at 8x acceleration compared to baseline E2E-VN, along-with improved downstream segmentation.

Impact: Training deep-learning-based image reconstruction methods for accelerated MRI with additional feedback on diagnostic content improves image quality in the overall image and the region of interest, and subsequently the diagnostic utility of reconstructed images.

How to access this content:

For one year after publication, abstracts and videos are only open to registrants of this annual meeting. Registrants should use their existing login information. Non-registrant access can be purchased via the ISMRM E-Library.

After one year, current ISMRM & ISMRT members get free access to both the abstracts and videos. Non-members and non-registrants must purchase access via the ISMRM E-Library.

After two years, the meeting proceedings (abstracts) are opened to the public and require no login information. Videos remain behind password for access by members, registrants and E-Library customers.

Click here for more information on becoming a member.

Keywords