Open Access
2014 Geometric ergodicity for Bayesian shrinkage models
Subhadip Pal, Kshitij Khare
Electron. J. Statist. 8(1): 604-645 (2014). DOI: 10.1214/14-EJS896

Abstract

In recent years, a large variety of continuous shrinkage priors have been developed for a Bayesian analysis of the standard linear regression model in high dimensional settings. We consider two such priors, the Dirichlet-Laplace prior (developed in Bhattacharya et al. (2013)), and the Normal-Gamma prior (developed in (Griffin and Brown, 2010)). For both Dirichlet-Laplace and Normal-Gamma priors, Gibbs sampling Markov chains have been developed to generate approximate samples from the corresponding posterior distributions. We show by using a drift and minorization based analysis that the Gibbs sampling Markov chains corresponding to the aforementioned models are geometrically ergodic. Establishing geometric ergodicity of these Markov chains is crucial, as it provides theoretical justification for the use of Markov chain CLT, which can then be used to obtain asymptotic standard errors for Markov chain based estimates of posterior quantities. Both Gibbs samplers in the paper use the Generalized Inverse Gaussian (GIG) distribution, as one of the conditional distributions. A novel contribution of our convergence analysis is the use of drift functions which include terms that are negative fractional powers of normal random variables, to tackle the presence of the GIG distribution.

Citation

Download Citation

Subhadip Pal. Kshitij Khare. "Geometric ergodicity for Bayesian shrinkage models." Electron. J. Statist. 8 (1) 604 - 645, 2014. https://doi.org/10.1214/14-EJS896

Information

Published: 2014
First available in Project Euclid: 20 May 2014

zbMATH: 1297.62057
MathSciNet: MR3211026
Digital Object Identifier: 10.1214/14-EJS896

Subjects:
Primary: 60J05 , 60J20
Secondary: 33C10

Keywords: Bayesian shrinkage , Bessel functions , geometric ergodicity , Markov chain Monte Carlo

Rights: Copyright © 2014 The Institute of Mathematical Statistics and the Bernoulli Society

Vol.8 • No. 1 • 2014
Back to Top