The Annals of Applied Statistics
- Ann. Appl. Stat.
- Volume 12, Number 2 (2018), 846-876.
On the use of bootstrap with variational inference: Theory, interpretation, and a two-sample test example
Variational inference is a general approach for approximating complex density functions, such as those arising in latent variable models, popular in machine learning. It has been applied to approximate the maximum likelihood estimator and to carry out Bayesian inference, however, quantification of uncertainty with variational inference remains challenging from both theoretical and practical perspectives. This paper is concerned with developing uncertainty measures for variational inference by using bootstrap procedures. We first develop two general bootstrap approaches for assessing the uncertainty of a variational estimate and the study the underlying bootstrap theory in both fixed- and increasing-dimension settings. We then use the bootstrap approach and our theoretical results in the context of mixed membership modeling with multivariate binary data on functional disability from the National Long Term Care Survey. We carry out a two-sample approach to test for changes in the repeated measures of functional disability for the subset of individuals present in 1989 and 1994 waves.
Ann. Appl. Stat., Volume 12, Number 2 (2018), 846-876.
Received: November 2017
Revised: April 2018
First available in Project Euclid: 28 July 2018
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Chen, Yen-Chi; Wang, Y. Samuel; Erosheva, Elena A. On the use of bootstrap with variational inference: Theory, interpretation, and a two-sample test example. Ann. Appl. Stat. 12 (2018), no. 2, 846--876. doi:10.1214/18-AOAS1169. https://projecteuclid.org/euclid.aoas/1532743479