Meeting Banner
Abstract #1198

Unpaired Image-to-Image Translation of ULF-MRI using Vision Transformers to Advance Volumetric Analyses

Peter Hsu1,2, Elisa Marchetto1,3, Samantha Sanger1, Hersh Chandarana1,3, Jakob Asslaender1,3, Daniel Sodickson1,2,3, Patricia Johnson1,2,3, and Jelle Veraart1,3
1Bernard and Irene Schwartz Center for Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, NY, United States, 2Vilcek Institute of Graduate Biomedical Sciences, New York University Grossman School of Medicine, New York, NY, United States, 3Center for Advanced Imaging Innovation and Research (CAI2R), Department of Radiology, New York University Grossman School of Medicine, New York, NY, United States

Synopsis

Keywords: Analysis/Processing, Low-Field MRI, ULF MRI, Ultra-Low-Field MRI, Deep Learning, Unpaired Image Translation, Brain Segmentation, Vision Transformers, CycleGAN

Motivation: The image quality of ultra-low-field MRI impacts the reliability of volumetric analysis in the brain. Existing techniques that address this issue learn from synthetically generated images, leading to a domain shift problem when presented with real images.

Goal(s): Development of a deep learning method trained with real ULF and HF images to robustly generate an image that can be segmented with routine software tools.

Approach: We introduce a CycleGAN framework with Residual Vision Transformers to improve super-resolved images compared to existing methods.

Results: The accuracy of volumetric estimations improves using our method compared to others based on clinical correlations and test-retest reliability metrics.

Impact: Our new image enhancement method should allow reliable volumetric evaluation using ULF-MRI. This will allow investigators in regions with access to ULF systems to monitor brain health in a way that was previously unattainable.

How to access this content:

For one year after publication, abstracts and videos are only open to registrants of this annual meeting. Registrants should use their existing login information. Non-registrant access can be purchased via the ISMRM E-Library.

After one year, current ISMRM & ISMRT members get free access to both the abstracts and videos. Non-members and non-registrants must purchase access via the ISMRM E-Library.

After two years, the meeting proceedings (abstracts) are opened to the public and require no login information. Videos remain behind password for access by members, registrants and E-Library customers.

Click here for more information on becoming a member.

Keywords