Title: Fine tuning of adaptive learning of deep belief network for misclassification and its knowledge acquisition

Authors: Shin Kamada; Takumi Ichimura

Addresses: Department of Intelligent Systems, Graduate School of Information Sciences, Hiroshima City University, 3-4-1, Ozuka-Higashi, Asa-Minami-ku, Hiroshima, 731-3194, Japan ' Faculty of Management and Information Systems, Prefectural University of Hiroshima, 1-1-71, Ujina-Higashi, Minami-ku, Hiroshima 734-8558, Japan

Abstract: We have proposed an adaptive structure learning of deep belief network (DBN) that can determine the suitable number of hidden layers and hidden neurons of restricted Boltzmann machines (RBMs). The method shows high classification performance to the big data benchmark test. However, the method could not classify the unknown pattern correctly, since an input data with ambiguous patterns leads the classification to the wrong judgment. In such a case, a fine-tuning method that patches a part of network signal flow based on the knowledge will be a helpful method even in terms of both the improvement of classification capability and the reduction of computational cost by learning again. In this paper, network signal patterns which lead the given misclassified patterns were visualised for knowledge acquisition. By fine-tuning the trained network using the acquired knowledge, the classification capability can achieve great success.

Keywords: deep learning; big data; deep belief network; DBN; adaptive structure learning method; fine tuning; knowledge acquisition.

DOI: 10.1504/IJCISTUDIES.2017.089511

International Journal of Computational Intelligence Studies, 2017 Vol.6 No.4, pp.333 - 348

Received: 01 Jun 2017
Accepted: 26 Jun 2017
Published online: 29 Jan 2018 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article