Title: Alzheimer's disease recognition based on multimodal image fusion
Authors: Xinjie Tao; Lisheng Wei; Shengbo Zhu
Addresses: School of Electrical Engineering, Anhui Polytechnic University, Anhui, 241000, China ' School of Electrical Engineering, Anhui Polytechnic University, Anhui, 241000, China ' School of Electrical Engineering, Anhui Polytechnic University, Anhui, 241000, China
Abstract: In response to the current challenges of low diagnostic accuracy for Alzheimer's disease (AD) and the weak ability of single-modal imaging to extract lesion feature information, a deep learning-based multimodal image fusion method for AD classification has been proposed. First, a novel residual network architecture is used to extract lesion features from three-dimensional images. Then, the improved residual network is employed as a feature extractor to separately extract image features from magnetic resonance imaging (MRI) and positron emission tomography (PET) scans. Afterward, the features from both modalities are fused and subsequently classified. Finally, to enable the fusion network to better capture the spatial relationships between dimensions and channels in three-dimensional medical images, a coordinate attention mechanism is introduced into the network structure. Experimental results show that the improved fusion network achieved an accuracy of 91.07% in the AD/mild cognitive impairment (MCI)/normal cognitive (CN) classification task. This represents a 7.14% improvement over the basic residual network, a 21.43% improvement over single-modal MRI-based methods, and a 12.5% improvement over single-modal PET-based methods. The improved fusion network demonstrates superior classification performance compared to the basic residual network in AD/CN, AD/MCI, and CN/MCI classification tasks, proving its effectiveness.
Keywords: Alzheimer's disease; multimodal feature fusion; attention mechanism; residual network; magnetic resonance imaging; MRI; positron emission tomography; PET; mild cognitive impairment; MCI.
DOI: 10.1504/IJBET.2025.149312
International Journal of Biomedical Engineering and Technology, 2025 Vol.48 No.4, pp.313 - 336
Received: 30 Sep 2024
Accepted: 29 Dec 2024
Published online: 24 Oct 2025 *