Title: A proposed FPGA architecture for mean shift based object tracking with bandwidth constrained sensors

Authors: Stefan Wong; John Collins

Addresses: Faculty of Design and Creative Technologies, Auckland University of Technology, 55 Wellesley Street East, Auckland 1010, New Zealand ' Faculty of Design and Creative Technologies, Auckland University of Technology, 55 Wellesley Street East, Auckland 1010, New Zealand

Abstract: In this paper, we propose a CAMShift inspired object tracker for VGA resolution images implemented in an FPGA with a view to using low-cost commercially available CMOS sensors. We discuss architectural issues that arise in trying to meet the dual constraints of serialised input from a camera, and the requirement for iterative computation in the mean shift inner loop. We argue that a system oriented toward vector processing allows us to both meet our timing requirements on the sensor side and perform multiple steps of gradient ascent on the algorithm side, thus mitigating the negative effect of low input bandwidth and allowing iterative algorithms to operate within the frame acquisition time. We show how this can be implemented as a stream process with relatively low memory overhead in an Altera Cyclone IV EP4CE115F29C7FPGA found on the DE2-115 development board paired with a Terasic D5M digital camera.

Keywords: FPGA architecture; field programmable gate arrays; bandwidth constraints; CMOS sensors; object tracking; real time; mean shift; VGA resolution images; low-cost sensors; digital cameras; serialised input; iterative computation.

DOI: 10.1504/IJISTA.2014.059297

International Journal of Intelligent Systems Technologies and Applications, 2014 Vol.13 No.1/2, pp.3 - 16

Published online: 13 Jul 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article