Meeting Banner
Abstract #0656

Reconstruction-free segmentation from undersampled k-space using transformers

Yundi Zhang1,2, Nil Stolt-Ansó1,3, Jiazhen Pan1,2, Wenqi Huang1,2, Kerstin Hammernik1,4, and Daniel Rueckert1,2,3,4
1School of Computation, Information and Technology, Technical University of Munich, Munich, Germany, 2School of Medicine, Klinikum rechts der Isar, Munich, Germany, 3Munich Center for Machine Learning, Technical University of Munich, Munich, Germany, 4Department of Computing, Imperial College London, London, United Kingdom

Synopsis

Keywords: AI/ML Image Reconstruction, Segmentation, k-space

Motivation: High acceleration factors place a limit on MRI image reconstruction. This limit is extended to segmentation models when treating these as subsequent independent processes.

Goal(s): Our goal is to produce segmentations directly from sparse k-space measurements without the need for intermediate image reconstruction.

Approach: We employ a transformer architecture to encode global k-space information into latent features. The produced latent vectors condition queried coordinates during decoding to generate segmentation class probabilities.

Results: The model is able to produce better segmentations across high acceleration factors than image-based segmentation baselines.

Impact: Cardiac segmentation directly from undersampled k-space samples circumvents the need for an intermediate image reconstruction step. This allows the potential to assess myocardial structure and function on higher acceleration factors than methods that rely on images as input.

How to access this content:

For one year after publication, abstracts and videos are only open to registrants of this annual meeting. Registrants should use their existing login information. Non-registrant access can be purchased via the ISMRM E-Library.

After one year, current ISMRM & ISMRT members get free access to both the abstracts and videos. Non-members and non-registrants must purchase access via the ISMRM E-Library.

After two years, the meeting proceedings (abstracts) are opened to the public and require no login information. Videos remain behind password for access by members, registrants and E-Library customers.

Click here for more information on becoming a member.

Keywords

segmentationspacereconstructionlatentattentionaccelerationmunichmodelcardiacarchitectureglobalvectorssamplesdirectlyfeaturesblockslearningaccelerationsdiceprojectperformance