Title: A novel restricted Boltzmann machine-based temporal-spatial correlation method for student behaviour recognition in depth video

Authors: Fan Zhang

Addresses: Zhengzhou University of Industrial Technology, Zhengzhou 450000, China

Abstract: Human behaviour recognition is an important research hotspot in the field of artificial intelligence. Current behaviour recognition methods have low recognition accuracy under different viewing angles, therefore, this paper proposes a novel restricted Boltzmann machine (RBM)-based temporal-spatial correlation method for student behaviour recognition in depth video. The RBM is used to map the human behaviour from different viewing angles to the high-dimensional space. The time level pooling function is applied in the time series activated by each neuron to realise the encoding of the video time sub-series. Finally, behaviour recognition and classification experiments are conducted on different public datasets and real classroom student behaviour datasets with other methods. The results show that the proposed method improves the accuracy of depth video recognition under different viewing angles and has good generalisation performance. The data analysis of abnormal behaviour in class can play an auxiliary role in dynamic classroom management.

Keywords: restricted Boltzmann machine; RBM; student behaviour recognition; temporal-spatial correlation; Fourier time pyramid algorithm.

DOI: 10.1504/IJCVR.2022.125352

International Journal of Computational Vision and Robotics, 2022 Vol.12 No.5, pp.487 - 505

Received: 08 Feb 2021
Accepted: 31 Jul 2021
Published online: 07 Sep 2022 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article