The Annals of Statistics

Posterior consistency of Dirichlet mixtures in density estimation

S. Ghosal, J. K. Ghosh, and R. V. Ramamoorthi

Full-text: Open access


A Dirichlet mixture of normal densities is a useful choice for a prior distribution on densities in the problem of Bayesian density estimation. In recent years, efficient Markov chain Monte Carlo method for the computation of the posterior distribution has been developed. The method has been applied to data arising from different fields of interest. The important issue of consistency was however left open. In this paper, we settle this issue in affirmative.

Article information

Ann. Statist., Volume 27, Number 1 (1999), 143-158.

First available in Project Euclid: 5 April 2002

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

Primary: 62G07: Density estimation 62G20: Asymptotic properties

Consistency Dirichlet process mixture posterior consistency posterior distribution


Ghosal, S.; Ghosh, J. K.; Ramamoorthi, R. V. Posterior consistency of Dirichlet mixtures in density estimation. Ann. Statist. 27 (1999), no. 1, 143--158. doi:10.1214/aos/1018031105.

Export citation


  • Barron, A. R. (1988). The exponential convergence of posterior probabilities with implications for Bayes estimators of density functions. Unpublished manuscript.
  • Barron, A. R. (1989). Uniformly powerful goodness of fit tests. Ann. Statist. 17 107-124.
  • Barron, A. R. (1998). Information theoretic analysis of Bayes performance and the choice of priors in parametric and nonparametric problems. In Bayesian Statistics 6 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) Oxford Univ. Press. To appear.
  • Barron, A. R., Schervish, M. and Wasserman, L. (1998). The consistency of posterior distributions in nonparametric problems. Ann. Statist. To appear.
  • Doss, H. and Sellke, T. (1982). The tails of probabilities chosen from a Dirichlet prior. Ann. Statist. 10 1302-1305.
  • Ferguson, T. S. (1983). Bayesian density estimation by mixtures of Normal distributions. In Recent Advances in Statistics (M. Rizvi, J. Rustagi, and D. Siegmund, eds.) 287-302. Academic Press, New York.
  • Gasparini, M. (1992). Bayes nonparametrics for biased sampling and density estimation. Ph.D. dissertation, Univ. Michigan.
  • Ghorai, J. K. and Rubin, H. (1982). Bayes risk consistency of nonparametric Bayes density estimates. Austral. J. Statist. 24 51-66.
  • Lo, A. Y. (1984). On a class of Bayesian nonparametric estimates I: density estimates. Ann. Statist. 12 351-357.
  • LeCam, L. (1973). Convergence of estimates under dimensionality restrictions. Ann. Statist. 1 38-53.
  • Roeder K. and Wasserman, L. (1995). Practical Bayesian density estimation using mixtures of normal. J. Amer. Statist. Assoc. 92 894-902.
  • Schwartz, L. (1965). On Bayes procedures. Z. Wahrsch. Verw. Gebiete 4 10-26.
  • van der Vaart, A. W. and Wellner, J. A. (1996). Weak Convergence and Empirical Processes. Springer, New York.
  • West, M. (1992). Modeling with mixtures. In Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, eds.) 503-524. Oxford Univ. Press.
  • West, M., Muller, P. and Escobar, M. D. (1994). Hierarchical priors and mixture models, with applications in regression and density estimation. In Aspects of Uncertainty: A Tribute to D. V. Lindley (P. R. Freeman and A. F. M. Smith, eds.) 363-386. Wiley, Chichester.