详细信息
A novel multimodel medical image fusion framework with edge enhancement and cross-scale transformer ( SCI-EXPANDED收录)
文献类型:期刊文献
英文题名:A novel multimodel medical image fusion framework with edge enhancement and cross-scale transformer
作者:Luo, Fei[1];Wu, Daoqi[1];Pino, Luis Rojas[2];Ding, Weichao[1]
机构:[1]East China Univ Sci & Technol, Sch Informat Sci & Engn, Shanghai 200237, Peoples R China;[2]Univ San Sebastian, Sch Engn Architecture & Design, Santiago 8320000, Chile
年份:2025
卷号:15
期号:1
外文期刊名:SCIENTIFIC REPORTS
收录:;WOS:【SCI-EXPANDED(收录号:WOS:001459934700017)】;
基金:The work was supported by Natural Science Foundation of Shanghai Municipality (22ZR1416500).
语种:英文
外文关键词:Multimodal medical image fusion; Edge enhancement; Cross-scale transformer; Hierarchical cross-scale embedding; Concise loss function
摘要:Multimodal medical image fusion (MMIF) integrates complementary information from different imaging modalities to enhance image quality and remove redundant data, benefiting a variety of clinical applications such as tumor detection and organ delineation. However, existing MMIF methods often struggle to preserve sharp edges and maintain high contrast, both of which are critical for accurate diagnosis and treatment planning. To address these limitations, this paper proposes ECFusion, a novel MMIF framework that explicitly incorporates edge prior information and leverages a cross-scale transformer. First, an Edge-Augmented Module (EAM) employs the Sobel operator to extract edge features, thereby improving the representation and preservation of edge details. Second, a Cross-Scale Transformer Fusion Module (CSTF) with a Hierarchical Cross-Scale Embedding Layer (HCEL) captures multi-scale contextual information and enhances the global consistency of fused images. Additionally, a multi-path fusion strategy is introduced to disentangle deep and shallow features, mitigating feature loss during fusion. We conduct extensive experiments on the AANLIB dataset, evaluating CT-MRI, PET-MRI, and SPECT-MRI fusion tasks. Compared with state-of-the-art methods (U2Fusion, EMFusion, SwinFusion, and CDDFuse), ECFusion produces fused images with clearer edges and higher contrast. Quantitative results further highlight improvements in mutual information (MI), structural similarity (Qabf, SSIM), and visual perception (VIF, Qcb, Qcv).
参考文献:
正在载入数据...
