Article: Visual substitution system for room labels identification based on text detection and recognition Journal: International Journal of Intelligent Systems Technologies and Applications (IJISTA) 2018 Vol.17 No.1/2 pp.210 - 228 Abstract: Vision is an essential human sense which is playing the most important role in human perception about surrounding environment. However such information is generally inaccessible for blind people. In order to enable these persons to overcome such incapability, we propose a system for identifying the neighbouring scene. In fact, the environment is labelled as a first step and then we present a personalised and adaptive method for labels detection and recognition. The automatic analysis involves the detection of personalised markers employed to extract the region of interest followed by the perspectives rectification based on homography estimation. We use the stroke width transform (SWT) to extract the text from the detected label and crop it into words and letters. The extracted text is identified using images correlation. Finally, as a substitution for visual modality, a vocal transformation of the recognised text is performed. Inderscience Publishers - linking academia, business and industry through research

Title: Visual substitution system for room labels identification based on text detection and recognition

Authors: Hanen Jabnoun; Faouzi Benzarti; Frédéric Morain-Nicolier; Hamid Amiri

Addresses: LR-SITI, National Engineering School of Tunis, Tunis El Manar University, 1002 Tunis, Tunisia ' LR-SITI, National Engineering School of Tunis, Tunis El Manar University, 1002 Tunis, Tunisia ' STIC Research Centre, UIT, Reims Champagne Ardenne University, 10026 Troyes Cedex, France ' LR-SITI, National Engineering School of Tunis, Tunis El Manar University, 1002 Tunis, Tunisia

Abstract: Vision is an essential human sense which is playing the most important role in human perception about surrounding environment. However such information is generally inaccessible for blind people. In order to enable these persons to overcome such incapability, we propose a system for identifying the neighbouring scene. In fact, the environment is labelled as a first step and then we present a personalised and adaptive method for labels detection and recognition. The automatic analysis involves the detection of personalised markers employed to extract the region of interest followed by the perspectives rectification based on homography estimation. We use the stroke width transform (SWT) to extract the text from the detected label and crop it into words and letters. The extracted text is identified using images correlation. Finally, as a substitution for visual modality, a vocal transformation of the recognised text is performed.

Keywords: text recognition; image rectification; text detection; homography estimation; markers detection; SWT; stroke width transform; images correlation; video analysis; indoor navigation; blind people.

DOI: 10.1504/IJISTA.2018.091601

International Journal of Intelligent Systems Technologies and Applications, 2018 Vol.17 No.1/2, pp.210 - 228

Received: 18 Mar 2017
Accepted: 06 Sep 2017
Published online: 08 May 2018 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article

Title: Visual substitution system for room labels identification based on text detection and recognition

Keep up-to-date