Title: Variational inference of cluster-weighted models for local and global sensitivity analysis

Authors: Chris L. Pettit; D. Keith Wilson

Addresses: Aerospace Engineering Department, United States Naval Academy, Annapolis, MD, USA ' Cold Regions Research and Engineering Laboratory, U.S. Army Engineer Research and Development Center, Hanover, NH, USA

Abstract: Variational inference is employed to infer cluster-weighted models from input-output data. Variational relations are derived for hyperparameters of the joint probability density of the model's parameters and latent variables. The result is an alternative to inferring the parameters through expectation maximisation. Surrogate models derived from the resulting predictive distributions have high data fidelity, good regularity between the data, and are quickly evaluated. These traits make them well-suited to sampling-based global sensitivity analyses through variance decomposition. Moreover, analytical local derivatives of the regression functions are readily computed to support sampling of the derivatives throughout the factor space. Results are presented for local and global sensitivities of two examples based on cluster-weighted surrogate models inferred from limited samples. The first example is analytical; the second builds on previous work by the authors in global, full-field sensitivity analysis of computational models of near-ground sound propagation.

Keywords: Bayesian inference; non-parametric regression; sensitivity analysis; mixture models; variational inference; cluster-weighted models; modelling; surrogate models; near-ground sound propagation.

DOI: 10.1504/IJRS.2014.069506

International Journal of Reliability and Safety, 2014 Vol.8 No.2/3/4, pp.196 - 227

Received: 17 Mar 2014
Accepted: 06 Apr 2014
Published online: 20 May 2015 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article