Title: Towards an immersive and safer driving experience using computer vision integrated with encoded vibro-tactile feedback

Authors: Rajshekhar Mukherjee; Dharmendra Kumar Mahato; Sangeeta Yadav; Amit Pundir; Geetika Jain Saxena

Addresses: School of Electrical Engineering and Computer Science, University of Ottawa, Ottawa, Ontario, Canada ' Department of Electronics, Maharaja Agrasen College, University of Delhi, New Delhi, India ' Department of Electronics, Maharaja Agrasen College, University of Delhi, New Delhi, India ' Department of Electronics, Maharaja Agrasen College, University of Delhi, New Delhi, India ' Department of Electronics, Maharaja Agrasen College, University of Delhi, New Delhi, India

Abstract: This paper claims to set up an immersive, responsive vehicle driving system and mechanism for an assisted driving technology. The purpose is to expand the sensory horizon of humans while driving and is motivated by absence of any such system in real world. The system can control and direct an assembly of electronic devices in real time, through usage of an image acquisition subsystem, an object-recognition and tracking algorithm and a haptic modelling subsystem working in-tandem with the user. The object tracking subsystem operates in real time to determine the current position of a vehicle in front by using a camera and continuously updates it in a live video feed, while also identifying and tracking the moving or stationary vehicle. The haptic system, which is integrated with the tracking system, has been programmed to warn the driver of the potential threats that moving/stationary vehicles may generate. All the subsystems are updated and synchronised with each other in real-time to produce a seamless and smooth transition between frames, facilitating a precise and immersive driving experience for anyone. The high accuracy and robustness of the proposed system makes it a versatile component, which can be integrated in variety of applications for enhancing a person's reality perception.

Keywords: object tracking; image detection; SURF; vibro-tactile; vision-to-touch; human-centred computing; immersive reality.

DOI: 10.1504/IJVAS.2020.108406

International Journal of Vehicle Autonomous Systems, 2020 Vol.15 No.2, pp.114 - 130

Received: 03 May 2018
Accepted: 10 Mar 2019
Published online: 13 Jul 2020 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article