Meeting Banner
Abstract #4854

A multi-scale pyramid residual weight network for medical image fusion

Yiwei Liu1, Shaoze Zhang2, Xihai Zhao1, and Zuo-Xiang He3
1Center for Biomedical Imaging Research, Department of Biomedical Engineering, Tsinghua University, BeiJing, China, 2Department of Biomedical Engineering, Tsinghua University, BeiJing, China, 3Beijing Tsinghua Changgung Hospital, BeiJing, China

Synopsis

Keywords: Diagnosis/Prediction, PET/MR, Artificial Intelligence,Brain

Motivation: At present, the multi-modal fusion image has the problems of weak functional information performance and much noise.

Goal(s): Based on the existing technology, this research increases the retention of functional information and improves the display quality of the fused image.

Approach: In this study, a multi-scale pyramid convolutional neural network model based on residual structure is constructed, which can extract deeper semantic information while retaining shallow context information.

Results: By constructing a new convolutional neural network, the loss of functional information in the fused image is reduced, the noise of the fused image is reduced, and the image quality is improved.

Impact: The multimodal image fusion technology proposed in this paper preserves the texture information of MRI and CT, and the functional information of PET/SPECT at the same time, which makes more dimensions available for clinical diagnosis in the future.

How to access this content:

For one year after publication, abstracts and videos are only open to registrants of this annual meeting. Registrants should use their existing login information. Non-registrant access can be purchased via the ISMRM E-Library.

After one year, current ISMRM & ISMRT members get free access to both the abstracts and videos. Non-members and non-registrants must purchase access via the ISMRM E-Library.

After two years, the meeting proceedings (abstracts) are opened to the public and require no login information. Videos remain behind password for access by members, registrants and E-Library customers.

Click here for more information on becoming a member.

Keywords