A reinforcement learning-based multimodal scenario hazardous behaviour recognition method
by Di Sun; Yanjing Li; Yuexia Han
International Journal of Computational Intelligence Studies (IJCISTUDIES), Vol. 12, No. 1/2, 2023

Abstract: In order to solve the problems of low recognition accuracy, low accuracy of key frame extraction of dangerous behaviours, and long delay time in risk behaviour recognition methods in multimodal scenes, this paper studies a multimodal scene risk behaviour recognition method based on reinforcement learning. Firstly, static and dynamic dangerous behaviour features are extracted through long short-term memory artificial neural network. Then, the extracted dangerous behaviour key frame set is optimised by reinforcement learning. Finally, a multi-sensory risk behaviour model library is constructed to complete the multi-modal scene dangerous behaviour recognition. Experiments show that the AUC area of the proposed method is closest to 1, which proves that the recognition accuracy is high, and the accuracy of the extracted key frames of dangerous behaviours is high. When the maximum number of video frames is 500 frames, the delay time of this method is 192 ms, and the shorter the delay time; the shortest, the higher the recognition efficiency.

Online publication date: Mon, 24-Jul-2023

The full text of this article is only available to individual subscribers or to users at subscribing institutions.

 
Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.

Pay per view:
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.

Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Computational Intelligence Studies (IJCISTUDIES):
Login with your Inderscience username and password:

Username:        Password:          Forgotten your password?

Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.

If you still need assistance, please email subs@inderscience.com