Development of pass-through augmented reality interface for human robot interaction
by G. Madhumitha; M. Nandhini; R. Senthilnathan
International Journal of Advanced Mechatronic Systems (IJAMECHS), Vol. 8, No. 2/3, 2020

Abstract: In this technology driven world, human machine interaction is indispensable. Conventional human machine interface techniques pose the challenges of extensive training and increased cognitive load. Usage of hand gestures, face and speech recognition, eye ball tracking, etc. are in the upward trend to overcome these limitations and prove to be more intuitive and user friendly. In this paper, a vision-based pass-through augmented reality system is developed that enables the user to command the mobile robot for various mobility and navigation tasks. A pass-through augmented reality setup is achieved by a combination of a typical virtual reality headset and a stereo camera with depth perception. The stereo camera and a Leap Motion sensor mounted on a wearable VR headset acts as the vision system for the user and the gesture recognition system respectively. Necessary graphical user interface with the list of functions and information will appear on the VR headset display from which the user can select the option/command to be given to the mobile robot. The gesture made by the user in the GUI is detected and communicated to the robot through wireless means to perform the corresponding task.

Online publication date: Thu, 19-Nov-2020

The full text of this article is only available to individual subscribers or to users at subscribing institutions.

 
Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.

Pay per view:
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.

Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Advanced Mechatronic Systems (IJAMECHS):
Login with your Inderscience username and password:

Username:        Password:          Forgotten your password?

Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.

If you still need assistance, please email subs@inderscience.com