Title: Real-time sign languages character recognition

Authors: Sari Awwad; Sahar Idwan; Hasan Gharaibeh

Addresses: Department of Computer Science and Applications, The Hashemite University, Zarqa, Jordan ' Department of Computer Science and Applications, The Hashemite University, Zarqa, Jordan ' Department of Software Engineering, University of Technology Sydney University, Sydney, Australia

Abstract: Deaf people face many challenges to communicate with the hearing world. Many studies and industrial solutions came up with interpretation from sign language to normal text but most of them are limited either to static images for letters or static animated character plays the word in motion. Therefore, this research worked on enhancing the feasible algorithms that have been used like image detection, image processing techniques and image translation methods. The contribution consists of two parts, the first one is using our data set, and the second one is proposing a new solution by extracting SURF features after using image filtering based on the existing methods to accelerate the translation process for the long sentences. Experimental results over our data set report improved accuracy compared with other studies in terms of efficiency time and recognition rate of sign language character recognition.

Keywords: sign language data set; image filtering; SURF features; M-SVM2; sign character recognition.

DOI: 10.1504/IJCAT.2021.113640

International Journal of Computer Applications in Technology, 2021 Vol.65 No.1, pp.36 - 44

Received: 01 May 2020
Accepted: 04 Jul 2020

Published online: 15 Mar 2021 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article