Title: A fine-tuned feature descriptor for pedestrian action recognition in autonomous vehicles

Authors: P. Ushapreethi; G.G. Lakshmi Priya

Addresses: School of Information Technology and Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India ' School of Information Technology and Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India

Abstract: The autonomous vehicle is the dream project of most of the majestic companies; however, providing a full-fledged autonomous vehicle is very complicated. In this paper, the pedestrian actions are captured using cameras and fine-tuned within a limited amount of time. Certain features of the captured video and their efficient feature descriptors achieve improved accuracy in pedestrian action recognition. The Skeleton based Spatio-Temporal Interest Points (S-STIP) feature is combined with the new interclass discriminative dictionaries. The sparse descriptor is constructed using sparse coding based on orthogonal matching pursuit algorithm and dictionary learning based on Efficient Block Coordinate Descent (EBCD) algorithm. Finally, the sparse descriptor is given as input to the SVM classifier for recognising pedestrian actions. The human action data sets KTH, Weizmann and JAAD are used for experimentation, and the combination of the S-STIP feature and the enhanced sparse descriptor achieves better performance compared to other existing action recognition methods.

Keywords: autonomous vehicles; pedestrian action recognition; skeletonisation; single-width skeletons; spatio-temporal interest points; sparse coding; inter-class discriminative dictionary; SVM classifier.

DOI: 10.1504/IJVICS.2021.113496

International Journal of Vehicle Information and Communication Systems, 2021 Vol.6 No.1, pp.40 - 63

Received: 29 Jun 2020
Accepted: 12 Nov 2020
Published online: 08 Mar 2021 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article