Title: Seasonal adjustment with 'bad' neural networks: a case of benign underfitting

Authors: Bruce Curry, Peter H. Morgan

Addresses: Cardiff Business School, Colum Drive, Cardiff, CF10 3EU, UK. ' Cardiff Business School, Colum Drive, Cardiff, CF10 3EU, UK

Abstract: This paper is a response to reports by a number of authors of difficulties in using feedforward neural networks (NNs) in the presence of seasonality. Such difficulties appear to contradict the well-known property of |universal approximation|, but arise in fact because the property only applies to suitably smooth functions. We report on what is an unexpected benefit of this limitation of NNs: although the network is unable to follow seasonal movements it can identify an underlying trend, through being forced to steer a middle course. We achieve such deseasonalisation through network pruning, which restricts the approximation capacity of the network by depriving it of connections. Although pruning is in general motivated by the search for the most parsimonious network, in our particular context it forces the network to ignore both seasonal movements and noise.

Keywords: neural networks; seasonality; optimisation; differential evolution; penalty function; network pruning.

DOI: 10.1504/IJAMS.2010.036590

International Journal of Applied Management Science, 2010 Vol.2 No.4, pp.335 - 350

Published online: 04 Nov 2010 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article