Title: Virtual speaker tracking by camera using a sound source localisation with two microphones

Authors: Halim Sayoud; Salah Khennouf; Siham Ouamour

Addresses: Institute of Electronics, USTHB University, BP 32, Al-Alia, Bab-Ezzouar, Alger, Algeria ' Institute of Electronics, USTHB University, BP 32, Al-Alia, Bab-Ezzouar, Alger, Algeria ' Institute of Electronics, USTHB University, BP 32, Al-Alia, Bab-Ezzouar, Alger, Algeria

Abstract: Our research work deals with the problem of automatic speaker tracking by camera. Such tracking systems do exist nowadays, but they suffer from a number of mechanical problems. To overcome these problems, we thought of employing a virtual tracking system using a fixed camera that does not require any mechanical part. But, is it possible to track a moving speaker with a fixed camera? If the task is already difficult enough with a mobile camera, how difficult would it be with a fixed camera? Trying to find a solution to the problem, we have proposed and conceived a virtual tracking system, which is able to ensure the required task by using only two cardioid microphones and a classic video camera. In this virtual tracking system, the task of speaker tracking is ensured by the orientation of the region of interest (ROI) of the camera towards the active speaker; we have called this method the virtual region of interest (VROI) based technique. Experiments show the good performance of the new virtual technique.

Keywords: virtual speaker tracking; automatic speaker localisation; virtual camera control; artificial vision; perception; signal processing; artificial intelligence; virtual tracking; cardioid microphones; video cameras; sound source localisation; sound localisation.

DOI: 10.1504/IJNVO.2013.053733

International Journal of Networking and Virtual Organisations, 2013 Vol.12 No.2, pp.85 - 110

Accepted: 01 Jul 2011
Published online: 31 Mar 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article