Meeting Banner
Abstract #0236

Multi-modal Adaptive Fusion Model for Breast Cancer Molecular Subtype Prediction Using Mammography and MRI

Muzhen He1, Huijian Chen1, Yunyan Zheng1, Tao Tan2, and Mingping Ma1
1Shengli Clinical College of Fujian Medical University & Department of Radiology, Fujian Provincial Hospital, Fuzhou University Affiliated Provincial Hospital, Fuzhou 350001, China, 2Faculty of Applied Sciences, Macao Polytech University, Macao, 999078, China

Synopsis

Keywords: Diagnosis/Prediction, Machine Learning/Artificial Intelligence

Motivation: While currentartificial intelligence (AI) applications in this domain primarily focus on single-modality imaging,such as mammography or MRI, these approaches are limited in capturing the full complexity of breast cancer's heterogeneity

Goal(s): Developed a deep learning-based model for predicting molecular subtypes of breast cancer through diagnostic mammography (MG) and MRI image.

Approach: We implemented a multimodal deep learning architecture,incorporating a cross-attention mechanism for MG and self-attentionfor MRI.

Results: This deep learning model demonstrates superior predictive accuracy by lever-aging both 2D MG and 3D MRI data, making it a valuable non-invasive tool for molecular subtype identification.

Impact: By uniquely combining 2D mammography and 3D MRI data, the multimodal deep learning model captures complementary tumor characteristics, supporting more accurate and nuanced classification across multiple subtypes, potentially aiding in treatment planning and improving patient outcomes.

How to access this content:

For one year after publication, abstracts and videos are only open to registrants of this annual meeting. Registrants should use their existing login information. Non-registrant access can be purchased via the ISMRM E-Library.

After one year, current ISMRM & ISMRT members get free access to both the abstracts and videos. Non-members and non-registrants must purchase access via the ISMRM E-Library.

After two years, the meeting proceedings (abstracts) are opened to the public and require no login information. Videos remain behind password for access by members, registrants and E-Library customers.

Click here for more information on becoming a member.

Keywords