Article: Exploring CNN-based transfer learning approaches for Arabic alphabets sign language recognition using the ArSL2018 dataset Journal: International Journal of Intelligent Engineering Informatics (IJIEI) 2024 Vol.12 No.2 pp.236 - 260 Abstract: Arabic alphabets sign language (ArASL) recognition is an important topic that has gotten insufficient attention regardless of its significance in the Arab world. This research compares CNN-based transfer learning models for Arabic alphabets sign language (ArASL) recognition using the ArSL2018 dataset, which comprises 54,049 pictures representing 32 sign and letter classes. Three pre-trained models are examined (InceptionV3, VGG16, and MobileNetV2) and compared using a training and evaluation dataset split. We use transfer learning to fine-tune these models on the ArSL2018 dataset and compare their performance. Our experimental findings indicate that the MobileNetV2 model exceeds the other models in terms of accuracy, achieving an overall accuracy of 96%, which exceeds the state-of-the-art results, reported in previous works. Our study demonstrates that transfer learning is an effective approach for recognising Arabic alphabets sign language using CNN-based models and provides insights into the suitability of different pre-trained models for this task. Inderscience Publishers - linking academia, business and industry through research

Title: Exploring CNN-based transfer learning approaches for Arabic alphabets sign language recognition using the ArSL2018 dataset

Authors: Houssem Lahiani; Mondher Frikha

Addresses: National School of Electronics and Telecommunications, University of Sfax, Tunisia; Advanced Technologies for Image and Signal Processing (ATISP) Laboratory, Technopark of Sfax, Tunis Road 10 km, P.O. Box 1163 SFAX 3021, Tunisia ' National School of Electronics and Telecommunications, University of Sfax, Tunisia; Advanced Technologies for Image and Signal Processing (ATISP) Laboratory, Technopark of Sfax, Tunis Road 10 km, P.O. Box 1163 SFAX 3021, Tunisia

Abstract: Arabic alphabets sign language (ArASL) recognition is an important topic that has gotten insufficient attention regardless of its significance in the Arab world. This research compares CNN-based transfer learning models for Arabic alphabets sign language (ArASL) recognition using the ArSL2018 dataset, which comprises 54,049 pictures representing 32 sign and letter classes. Three pre-trained models are examined (InceptionV3, VGG16, and MobileNetV2) and compared using a training and evaluation dataset split. We use transfer learning to fine-tune these models on the ArSL2018 dataset and compare their performance. Our experimental findings indicate that the MobileNetV2 model exceeds the other models in terms of accuracy, achieving an overall accuracy of 96%, which exceeds the state-of-the-art results, reported in previous works. Our study demonstrates that transfer learning is an effective approach for recognising Arabic alphabets sign language using CNN-based models and provides insights into the suitability of different pre-trained models for this task.

Keywords: convolutional neural network; CNN; HMI; transfer learning; Arabic alphabets sign language; ArASL.

DOI: 10.1504/IJIEI.2024.138858

International Journal of Intelligent Engineering Informatics, 2024 Vol.12 No.2, pp.236 - 260

Received: 03 Nov 2023
Accepted: 26 Feb 2024
Published online: 31 May 2024 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article

Title: Exploring CNN-based transfer learning approaches for Arabic alphabets sign language recognition using the ArSL2018 dataset

Keep up-to-date