Title: Challenges and solutions to improve the scalability of an operational regional meteorological forecasting model

Authors: Alvaro L. Fazenda, Jairo Panetta, Daniel M. Katsurayama, Luiz F. Rodrigues, Luis F.G. Motta, Philippe O.A. Navaux

Addresses: Federal University of Sao Paulo, Institute of Science and Technology, Sao Jose dos Campos, Brazil. ' Brazilian National Institute for Space Research, Center for Weather Prediction and Climate Studies, Cachoeira Paulista, Brazil. ' Brazilian National Institute for Space Research, Center for Weather Prediction and Climate Studies, Cachoeira Paulista, Brazil. ' Brazilian National Institute for Space Research, Center for Weather Prediction and Climate Studies, Cachoeira Paulista, Brazil. ' Brazilian National Institute for Space Research, Center for Weather Prediction and Climate Studies, Cachoeira Paulista, Brazil. ' Federal University of Rio Grande do Sul, Informatics Institute, Porto Alegre, Brazil

Abstract: This work investigates the parallel scalability of BRAMS, a limited area weather forecasting production code, from O(100) cores to O(1,000) cores on large grids (20 km and 10 km resolution runs over South America). Initial experiments show lack of scalability at modest core count. Execution time profiling and source code examination revealed the causes of the limited scalability: sequential algorithms and extensive memory requirements at scarcely used phases of the computation. As processor count increases, these |secondary| phases dominate execution time. Algorithm replacement and memory reduction generate a new code version that possesses strong and weak scaling. The new version achieved a speed-up of 6 from 100 to 700 processors on the 20 km resolution grid and a speed-up of 6.9 on the same processor range on the 10 km resolution grid. Results were confirmed at another machine with a distinct architecture. Further experiments show that the scalability of the 20 km resolution case is limited by load unbalancing at the most demanding computational phase.

Keywords: parallel scalability; regional weather forecasting; weather forecasting models; modelling; load unbalancing; meteorological forecasting; meteorology.

DOI: 10.1504/IJHPSA.2011.040462

International Journal of High Performance Systems Architecture, 2011 Vol.3 No.2/3, pp.87 - 97

Received: 07 Jul 2010
Accepted: 29 Nov 2010

Published online: 21 Mar 2015 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article