Title: Hybrid approach for skin lesion analysis: integrating modified U-Net segmentation with vision transformers for multi-class skin cancer detection

Authors: J. Ramya; K.M. Anil Kumar

Addresses: Computer Science and Engineering, JSS Science and Technology University, Mysuru, Mysore, India ' Computer Science and Engineering, JSS Science and Technology University, Mysuru, Mysore, India

Abstract: Skin cancer is a major global health concern, where early and accurate detection is crucial for patient survival. Traditional CNN-based methods in skin lesion classification face challenges, particularly with the complexity of spatial and semantic features. To address these issues, we propose a unique hybrid deep learning approach integrating vision transformer (ViT) and a modified U-Net model. ViT processes images as tokens instead of pixels, enabling superior feature extraction and classification. Preprocessing techniques, including non-local means filtering for denoising and unsharp masking for contrast enhancement, are applied to enhance model robustness. Our hybrid approach integrates U-Net for precise segmentation, achieving metrics such as IOU of 92.46%, AUC of 97.64%, and dice coefficient of 95.96%. ViT for classification achieves exceptional accuracy, precision, recall, and F1 score, all at 99%. Using the HAM10000 dataset, our method surpasses existing techniques, demonstrating remarkable effectiveness in skin cancer detection and classification.

Keywords: skin cancer images; multi-class classification; vision transformers; ViT; region-of-interest segmentation; computerised; medical image processing.

DOI: 10.1504/IJBET.2025.149311

International Journal of Biomedical Engineering and Technology, 2025 Vol.48 No.4, pp.337 - 370

Received: 03 Oct 2024
Accepted: 15 Jan 2025
Published online: 24 Oct 2025 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article