• Bernoulli
  • Volume 23, Number 1 (2017), 603-625.

Convergence rates for a hierarchical Gibbs sampler

Oliver Jovanovski and Neal Madras

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber. If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text


We establish results for the rate of convergence in total variation of a particular Gibbs sampler to its equilibrium distribution. This sampler is for a Bayesian inference model for a gamma random variable, whose only complexity lies in its multiple levels of hierarchy. Our results apply to a wide range of parameter values when the hierarchical depth is 3 or 4. Our method involves showing a relationship between the total variation of two ordered copies of our chain and the maximum of the ratios of their respective coordinates. We construct auxiliary stochastic processes to show that this ratio converges to 1 at a geometric rate.

Article information

Bernoulli, Volume 23, Number 1 (2017), 603-625.

Received: October 2014
Revised: July 2015
First available in Project Euclid: 27 September 2016

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

convergence rate coupling gamma distribution hierarchical Gibbs sampler Markov chain stochastic monotonicity


Jovanovski, Oliver; Madras, Neal. Convergence rates for a hierarchical Gibbs sampler. Bernoulli 23 (2017), no. 1, 603--625. doi:10.3150/15-BEJ758.

Export citation


  • [1] Besag, J., Green, P., Higdon, D. and Mengersen, K. (1995). Bayesian computation and stochastic systems. Statist. Sci. 10 3–66.
  • [2] Chen, J. and Rubin, H. (1986). Bounds for the difference between median and mean of gamma and Poisson distributions. Statist. Probab. Lett. 4 281–283.
  • [3] Constantinou, A., Fenton, N. and Neil, M. (2012). pi-football: A Bayesian network model for forecasting association football match outcomes. Knowl.-Based Syst. 36 322–339.
  • [4] Cowans, P. (2004). Information retrieval using hierarchical Dirichlet process. In Proceedings of the Annual International Conference on Research and Development in Information Retrieval 27 564–565. New York: ACM.
  • [5] Diaconis, P. and Freedman, D. (1999). Iterated random functions. SIAM Rev. 41 45–76.
  • [6] Díez, F.J., Mira, J., Iturralde, E. and Zubillaga, S. (1997). DIAVAL a Bayesian expert system for echocardiography. Artif. Intell. Med. 10 59–73.
  • [7] Geman, S. and Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. 6 721–741.
  • [8] Jiang, X. and Cooper, G.F. A Bayesian spatio-temporal method for disease outbreak detection. J. Am. Med. Inform. Assoc. 17 462–471.
  • [9] Jiang, X., Neapolitan, R., Barmada, M. and Visweswaran, S. (2011). Learning genetic epistasis using Bayesian network scoring criteria. BMC Bioinformatics 12 89.
  • [10] Jovanovski, O. and Madras, N. (2014). Convergence rates for hierarchical Gibbs samplers. Available at arXiv:1402.4733v1.
  • [11] Lindvall, T. (1992). Lectures on the Coupling Method. Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical Statistics. New York: Wiley.
  • [12] Madras, N. and Sezer, D. (2010). Quantitative bounds for Markov chain convergence: Wasserstein and total variation distances. Bernoulli 16 882–908.
  • [13] Roberts, G.O. and Rosenthal, J.S. (2002). One-shot coupling for certain stochastic recursive sequences. Stochastic Process. Appl. 99 195–208.
  • [14] Roberts, G.O. and Rosenthal, J.S. (2004). General state space Markov chains and MCMC algorithms. Probab. Surv. 1 20–71.
  • [15] Rossi, P.E., Allenby, G.M. and McCulloch, R. (2005). Bayesian Statistics and Marketing. Wiley Series in Probability and Statistics. Chichester: Wiley.
  • [16] Royden, H.L. (1988). Real Analysis, 3rd ed. New York: Macmillan Publishing Company.
  • [17] Stephens, M., Smith, N. and Donnelly, P. (2001). A new statistical method for haplotype reconstruction from population data. Am. J. Hum. Genet. 68 978–989.
  • [18] Tierney, L. (1994). Markov chains for exploring posterior distributions. Ann. Statist. 22 1701–1762.