Multimodal fusion: progresses and issues for augmented reality environment
by Ajune Wanis Ismail; Mohd Shahrizal Sunar
International Journal of Computational Vision and Robotics (IJCVR), Vol. 7, No. 3, 2017

Abstract: Multimodal fusion enables users to interact with computers through various input modalities like speech, gesture, and eye gaze. At the first stage to propose the multimodal interaction, various input modalities like speech and gesture, needs to be nominated before be integrated in an interface. This paper provides the progresses and issues in multimodal inputs for in augmented reality (AR). The paper presents several related works about to recap the multimodal approaches until it recently has been one of the research trends in AR. It also discusses on the multimodal fusion in AR and reports the various existing works in multimodal interaction with AR tools and techniques. In AR, multimodal considers as the solution to improve the interaction between the virtual and physical entities. It is an ideal interaction technique for AR applications since AR supports interactions in real and virtual worlds in the real-time. This paper describes the recent studies in AR developments that appeal multimodal inputs for AR environment. This paper also looks into multimodal fusion issues and its limitations, followed by the conclusion. This paper will give a guideline on multimodal fusion in AR, about how to integrate the multimodal inputs in AR environment.

Online publication date: Fri, 31-Mar-2017

The full text of this article is only available to individual subscribers or to users at subscribing institutions.

 
Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.

Pay per view:
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.

Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Computational Vision and Robotics (IJCVR):
Login with your Inderscience username and password:

Username:        Password:          Forgotten your password?

Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.

If you still need assistance, please email subs@inderscience.com