Int. J. of Intelligent Engineering Informatics   »   2017 Vol.5, No.1

 

 

Title: A multimodal tactile interface for immersive virtual experience

 

Authors: Margherita Peruzzini; Maura Mengoni; Lorenzo Cavalieri

 

Addresses:
Department of Engineering 'Enzo Ferrari', University of Modena and Reggio Emilia, via Vivarelli 10, 41125 Modena, Italy
Dept. Industrial Engineering and Mathematical Sciences, Polytechnic University of Marche, via Brecce Bianche, 60131 Ancona, Italy
Dept. Industrial Engineering and Mathematical Sciences, Polytechnic University of Marche, via Brecce Bianche, 60131 Ancona, Italy

 

Abstract: Multimodal interaction generally allows the user to exploit multiple modes of interfacing with a system. A multimodal interface activates multiple sensory channels to achieve deeper user involvement and enhance the communication with the system. Sensory stimulation is one of the most important factors to reach multimodality and represents a challenge in human-computer interaction to realise enriched virtual representations. Furthermore, playing successfully in a virtual system requires synchronisation among the reproduced signals stimulating the different sensory channels. This paper presents the design and implementation of a multimodal tactile interface to create an immersive virtual experience. The proposed system is the evolution of a previous tactile platform; the main novelties regard the introduction of audio and visual feedbacks to a tactile feedback, signals' synchronisation, and system testing, with the aim to create a robust application to be integrated into novel human-computer interfaces. Tests are carried out to evaluate the degree of synchronism among the three different outputs, system latency, and the quality of multimodal interaction provided based on the ability of users to discriminate different materials by their virtual simulation.

 

Keywords: virtual reality; haptics; tactile stimulation; multimodal systems; human-computer interaction; HCI; tactile interface; immersive VR.

 

DOI: 10.1504/IJIEI.2017.10003431

 

Int. J. of Intelligent Engineering Informatics, 2017 Vol.5, No.1, pp.29 - 49

 

Available online: 23 Feb 2017

 

 

Editors Full text accessAccess for SubscribersPurchase this articleComment on this article