Electronic Journal of Statistics
- Electron. J. Statist.
- Volume 11, Number 2 (2017), 3549-3594.
A variational Bayes approach to variable selection
We develop methodology and theory for a mean field variational Bayes approximation to a linear model with a spike and slab prior on the regression coefficients. In particular we show how our method forces a subset of regression coefficients to be numerically indistinguishable from zero; under mild regularity conditions estimators based on our method consistently estimate the model parameters with easily obtainable and (asymptotically) appropriately sized standard error estimates; and select the true model at an exponential rate in the sample size. We also develop a practical method for simultaneously choosing reasonable initial parameter values and tuning the main tuning parameter of our algorithms which is both computationally efficient and empirically performs as well or better than some popular variable selection approaches. Our method is also faster and highly accurate when compared to MCMC.
Electron. J. Statist., Volume 11, Number 2 (2017), 3549-3594.
Received: June 2017
First available in Project Euclid: 6 October 2017
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Ormerod, John T.; You, Chong; Müller, Samuel. A variational Bayes approach to variable selection. Electron. J. Statist. 11 (2017), no. 2, 3549--3594. doi:10.1214/17-EJS1332. https://projecteuclid.org/euclid.ejs/1507255614