Title: Self-adaptive network structure tuning method based on NSGA-III

Authors: Lei Du; Zhihua Cui

Addresses: School of Computer Science and Technology, Taiyuan University of Science and Technology, Taiyuan, 030024, China ' School of Computer Science and Technology, Taiyuan University of Science and Technology, Taiyuan, 030024, China

Abstract: Neural networks are arising a wave in the various areas of artificial intelligence and they have adopted in daily life successfully. The structure tuning of neural networks is crucial when building the relative models. The structure of neural networks is usually designed and tuned with experience and plenty of attempts. To reduce the difficulty and cost of structure tuning meanwhile improving its rationality, we propose a new method to tune the structure of neural networks adaptively. In this method, the related structure parameters are optimised. A many-objective algorithm is employed as the optimised tool to get a better structure. We design the experiments combining convolutional neural network (CNN) with Non-dominated Sorting Genetic Algorithm III (NSGA-III). The related experiments are conducted on the MNIST and Malware image datasets. Results show that the method has promising performance on neural networks tuning and can improve the robustness.

Keywords: neural network structure tuning; CNN; convolutional neural network; many-objective algorithm; NSGA-III; Non-dominated Sorting Genetic Algorithm III.

DOI: 10.1504/IJCSM.2021.114197

International Journal of Computing Science and Mathematics, 2021 Vol.13 No.1, pp.54 - 63

Received: 13 May 2020
Accepted: 18 Jun 2020

Published online: 13 Apr 2021 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article