Meeting Banner
Abstract #0651

Towards a Generalizable Foundation Model for Multi-Tissue Musculoskeletal MRI Segmentation

Gabrielle Hoyer1,2, Michelle Tong*1,2, Sharmila Majumdar1, and Valentina Pedoia1
1Department of Radiology and Biomedical Imaging, University of California, San Francisco, San Francisco, CA, United States, 2Department of Bioengineering, University of California, Berkeley, Berkeley, CA, United States

Synopsis

Keywords: Analysis/Processing, Bone

Motivation: To evaluate the potential of foundation models for medical imaging analysis.

Goal(s): To understand the limitations of foundation models trained for the natural imaging domain, and assess the challenges for translation to complex musculoskeletal anatomy in a rich medical image domain.

Approach: A diverse collection of musculoskeletal MRI data was used to assess the generalizability of SAM when applied to a variety of segmentation tasks common to the medical research and clinical setting.

Results: SAM performed decently on zero-shot of medical data. The ability of SAM to perform well when finetuned on a spectrum of data, is somewhat lacking and requires additional evaluation.

Impact: A foundational model for generalizable musculoskeletal MRI segmentation, such as one fine-tuned on the Segment Anything Model (SAM) has the potential to overcome challenges with generalizability for widespread usage beyond a specific task, reducing burden in medical imaging pipelines.

How to access this content:

For one year after publication, abstracts and videos are only open to registrants of this annual meeting. Registrants should use their existing login information. Non-registrant access can be purchased via the ISMRM E-Library.

After one year, current ISMRM & ISMRT members get free access to both the abstracts and videos. Non-members and non-registrants must purchase access via the ISMRM E-Library.

After two years, the meeting proceedings (abstracts) are opened to the public and require no login information. Videos remain behind password for access by members, registrants and E-Library customers.

Click here for more information on becoming a member.

Keywords