Title: Self-adaptive network structure tuning method based on NSGA-III
Authors: Lei Du; Zhihua Cui
Addresses: School of Computer Science and Technology, Taiyuan University of Science and Technology, Taiyuan, 030024, China ' School of Computer Science and Technology, Taiyuan University of Science and Technology, Taiyuan, 030024, China
Abstract: Neural networks are arising a wave in the various areas of artificial intelligence and they have adopted in daily life successfully. The structure tuning of neural networks is crucial when building the relative models. The structure of neural networks is usually designed and tuned with experience and plenty of attempts. To reduce the difficulty and cost of structure tuning meanwhile improving its rationality, we propose a new method to tune the structure of neural networks adaptively. In this method, the related structure parameters are optimised. A many-objective algorithm is employed as the optimised tool to get a better structure. We design the experiments combining convolutional neural network (CNN) with Non-dominated Sorting Genetic Algorithm III (NSGA-III). The related experiments are conducted on the MNIST and Malware image datasets. Results show that the method has promising performance on neural networks tuning and can improve the robustness.
Keywords: neural network structure tuning; CNN; convolutional neural network; many-objective algorithm; NSGA-III; Non-dominated Sorting Genetic Algorithm III.
DOI: 10.1504/IJCSM.2021.114197
International Journal of Computing Science and Mathematics, 2021 Vol.13 No.1, pp.54 - 63
Received: 13 May 2020
Accepted: 18 Jun 2020
Published online: 13 Apr 2021 *