Title: DCATNet: dilated convolution attention transformer network for medical image fusion

Authors: Zenghui Wang; Mingliang Gao; Lina Liu; Xiangqin Zeng; Qilei Li; Monire Norouzi

Addresses: School of Electrical and Electronic Engineering, Shandong University of Technology, Zibo, China ' School of Electrical and Electronic Engineering, Shandong University of Technology, Zibo, China ' School of Electrical and Electronic Engineering, Shandong University of Technology, Zibo, China ' Zibo Central Hospital, Zibo, China ' School of Electronic Engineering and Computer Science, Queen Mary University of London, London, UK ' Computer Technology Program, Vocational School, Haliç University, Istanbul, Turkey

Abstract: Medical image fusion is dedicated to extracting structural and functional information from medical images. However, existing medical image fusion methods usually rely on convolutional operations and ignore long-distance information transmission. To address this problem, we propose a dilated convolutional attention transformer network (DCATNet) for medical image fusion. Specifically, to enhance the long-term dependence of the network on the input image, a transformer (TF) module is built. At the same time, a dilated convolutional channel attention (DCCA) module is built to realise the accurate extraction of feature and multi-scale information. This module combines the CPA module with the expansion convolution to enhance the robustness of the model. This enables the proposed method to handle the complexities of long-distance information transfer without losing important contextual and structural details. Experimental results demonstrate that the DCATNet outperforms competitors and proves its potential in medical image fusion for long-distance information transfer processes. Meanwhile, the results highlight the potential of DCATNet to advance medical image fusion, and it can lead to better clinical outcomes and more accurate diagnoses.

Keywords: medical image fusion; transformer; dilated convolution attention; long distance information transmission; embedded system.

DOI: 10.1504/IJES.2025.144934

International Journal of Embedded Systems, 2025 Vol.18 No.1, pp.50 - 60

Received: 21 Apr 2024
Accepted: 27 Jun 2024
Published online: 11 Mar 2025 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article