Article: A multimodal tactile interface for immersive virtual experience Journal: International Journal of Intelligent Engineering Informatics (IJIEI) 2017 Vol.5 No.1 pp.29 - 49 Abstract: Multimodal interaction generally allows the user to exploit multiple modes of interfacing with a system. A multimodal interface activates multiple sensory channels to achieve deeper user involvement and enhance the communication with the system. Sensory stimulation is one of the most important factors to reach multimodality and represents a challenge in human-computer interaction to realise enriched virtual representations. Furthermore, playing successfully in a virtual system requires synchronisation among the reproduced signals stimulating the different sensory channels. This paper presents the design and implementation of a multimodal tactile interface to create an immersive virtual experience. The proposed system is the evolution of a previous tactile platform; the main novelties regard the introduction of audio and visual feedbacks to a tactile feedback, signals' synchronisation, and system testing, with the aim to create a robust application to be integrated into novel human-computer interfaces. Tests are carried out to evaluate the degree of synchronism among the three different outputs, system latency, and the quality of multimodal interaction provided based on the ability of users to discriminate different materials by their virtual simulation. Inderscience Publishers - linking academia, business and industry through research

Title: A multimodal tactile interface for immersive virtual experience

Authors: Margherita Peruzzini; Maura Mengoni; Lorenzo Cavalieri

Addresses: Department of Engineering 'Enzo Ferrari', University of Modena and Reggio Emilia, via Vivarelli 10, 41125 Modena, Italy ' Dept. Industrial Engineering and Mathematical Sciences, Polytechnic University of Marche, via Brecce Bianche, 60131 Ancona, Italy ' Dept. Industrial Engineering and Mathematical Sciences, Polytechnic University of Marche, via Brecce Bianche, 60131 Ancona, Italy

Abstract: Multimodal interaction generally allows the user to exploit multiple modes of interfacing with a system. A multimodal interface activates multiple sensory channels to achieve deeper user involvement and enhance the communication with the system. Sensory stimulation is one of the most important factors to reach multimodality and represents a challenge in human-computer interaction to realise enriched virtual representations. Furthermore, playing successfully in a virtual system requires synchronisation among the reproduced signals stimulating the different sensory channels. This paper presents the design and implementation of a multimodal tactile interface to create an immersive virtual experience. The proposed system is the evolution of a previous tactile platform; the main novelties regard the introduction of audio and visual feedbacks to a tactile feedback, signals' synchronisation, and system testing, with the aim to create a robust application to be integrated into novel human-computer interfaces. Tests are carried out to evaluate the degree of synchronism among the three different outputs, system latency, and the quality of multimodal interaction provided based on the ability of users to discriminate different materials by their virtual simulation.

Keywords: virtual reality; haptics; tactile stimulation; multimodal systems; human-computer interaction; HCI; tactile interface; immersive VR.

DOI: 10.1504/IJIEI.2017.082563

International Journal of Intelligent Engineering Informatics, 2017 Vol.5 No.1, pp.29 - 49

Received: 09 Feb 2015
Accepted: 07 Feb 2016
Published online: 01 Mar 2017 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article

Title: A multimodal tactile interface for immersive virtual experience

Keep up-to-date