Title: A novel heavy-duty truck reversing safety control based on pedestrian tracking using fisheye stereo vision

Authors: Miankuan Zhu; Lei Han; Fujian Liang; Lei Wu; Chaoxing Xi; Zutao Zhang

Addresses: School of Information Science and Technology, Southwest Jiaotong University, Chengdu, 610031, China ' School of Information Science and Technology, Southwest Jiaotong University, Chengdu, 610031, China ' School of Information Science and Technology, Southwest Jiaotong University, Chengdu, 610031, China ' School of Information Science and Technology, Southwest Jiaotong University, Chengdu, 610031, China ' School of Information Science and Technology, Southwest Jiaotong University, Chengdu, 610031, China ' School of Mechanical Engineering, Southwest Jiaotong University, Chengdu, 610031, China

Abstract: Heavy-duty trucks have caused many reversing accidents due to the large blind area of the body, so the safety of reversing assistance has attracted more and more attention. In this paper, we present a novel heavy-duty truck safety approach for reversing based on pedestrian detection and tracking using fisheye stereo vision. Firstly, an elliptical plate is proposed to calibrate a fisheye camera, and a disparity map is computed using the binocular fisheye camera. Secondly, a pedestrian is detected after the fisheye images are corrected. Thirdly, an improved pedestrian tracking algorithm based on consensus-based tracking and matching of key-points for object tracking (CMT) algorithm combined is applied to track pedestrians. Finally, a heavy-duty truck reversing speed control method is proposed to avoid collisions and improve the safety of truck reversing. This system has been tested on a van truck. Experiments demonstrate the viability of the proposed heavy-duty truck reversing safety system.

Keywords: heavy-duty truck; fisheye stereo vision; pedestrian detection and tracking; reversing safety control; truck reversing safety; fisheye stereo vision; pedestrian detection and tracking.

DOI: 10.1504/IJHVS.2021.121869

International Journal of Heavy Vehicle Systems, 2021 Vol.28 No.6, pp.727 - 751

Accepted: 03 May 2021
Published online: 07 Apr 2022 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article