Meeting Banner
Abstract #1008

MR-Transformer: Vision Transformers for Total Knee Replacement Prediction using Magnetic Resonance Imaging

Chaojie Zhang1, Shengjia Chen1, Haresh Rengaraj Rajamohan2, Kyunghyun Cho2, Richard Kijowski3, and Cem M. Deniz1,3
1Bernard and Irene Schwartz Center for Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, NY, United States, 2Center for Data Science, New York University, New York, NY, United States, 3Department of Radiology, New York University Langone Health, New York, NY, United States

Synopsis

Keywords: Diagnosis/Prediction, Data Analysis, Deep Learning

Motivation: Current deep learning methods for assessing knee osteoarthritis have limitations in learning long-range spatial information from magnetic resonance imaging (MRI).

Goal(s): This study aims to develop a new deep learning model for total knee replacement (TKR) prediction using MRI.

Approach: We proposed a novel transformer-based model, MR-Transformer, adapted from the ImageNet pre-trained vision transformer DeiT-Ti. The model can capture long-range spatial information from MR images with transformer architecture. We evaluated our model on TKR prediction using MR images with different tissue contrasts.

Results: The experimental results demonstrated an improved performance of MR-Transformer compared to conventional deep learning models.

Impact: Our proposed MR-Transformer enhances computer-aided diagnosis accuracy in total knee replacement prediction using MRI. It has the potential to provide rapid and quality diagnostic outcomes, assisting physicians in making timely and informed treatment decisions.

How to access this content:

For one year after publication, abstracts and videos are only open to registrants of this annual meeting. Registrants should use their existing login information. Non-registrant access can be purchased via the ISMRM E-Library.

After one year, current ISMRM & ISMRT members get free access to both the abstracts and videos. Non-members and non-registrants must purchase access via the ISMRM E-Library.

After two years, the meeting proceedings (abstracts) are opened to the public and require no login information. Videos remain behind password for access by members, registrants and E-Library customers.

Click here for more information on becoming a member.

Keywords