The Annals of Applied Statistics

When should modes of inference disagree? Some simple but challenging examples

D. A. S. Fraser, N. Reid, and Wei Lin

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber. If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text


At a recent conference on Bayes, fiducial and frequentist inference, David Cox presented eight illustrative examples, chosen to highlight potential difficulties for the theory of inference. We discuss these examples in light of the efforts of the conference, and related meetings, to study the similarities and differences between the approaches to inference. Emphasis is placed on the goal of finding a distribution for an unknown parameter.

Article information

Ann. Appl. Stat., Volume 12, Number 2 (2018), 750-770.

Received: December 2017
Revised: March 2018
First available in Project Euclid: 28 July 2018

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

Asymptotic theory confidence distribution fiducial density marginalization paradox noninformative priors


Fraser, D. A. S.; Reid, N.; Lin, Wei. When should modes of inference disagree? Some simple but challenging examples. Ann. Appl. Stat. 12 (2018), no. 2, 750--770. doi:10.1214/18-AOAS1160SF.

Export citation


  • Barndorff-Nielsen, O. E. (1991). Modified signed log likelihood ratio. Biometrika 78 557–563.
  • Bayes, T. (1763). An essay towards solving a problem in the doctrine of chances. Philos. Trans. R. Soc. 53 370–418.
  • Berger, J. (2006). The case for objective Bayesian analysis. Bayesian Anal. 1 385–402.
  • Bliss, C. (1935a). The calculation of dosage-mortality curves. Ann. Appl. Biol. 22 134–167.
  • Bliss, C. (1935b). The comparison of dosage-mortality data. Ann. Appl. Biol. 22 307–333.
  • Box, G. E. P. (1980). Sampling and Bayes’ inference in scientific modelling and robustness. J. Roy. Statist. Soc. Ser. A 143 383–430.
  • Box, G. E. P. and Cox, D. R. (1964). An analysis of transformations. J. Roy. Statist. Soc. Ser. B 26 211–252.
  • Brazzale, A. R., Davison, A. C. and Reid, N. (2007). Applied Asymptotics: Case Studies in Small-Sample Statistics. Cambridge Series in Statistical and Probabilistic Mathematics 23. Cambridge Univ. Press, Cambridge.
  • Cox, D. R. (1958). Some problems connected with statistical inference. Ann. Math. Stat. 29 357–372.
  • Cox, D. R. (2006). Principles of Statistical Inference. Cambridge Univ. Press, Cambridge.
  • Cox, D. R. and Hinkley, D. V. (1974). Theoretical Statistics. Chapman & Hall, London.
  • Cox, D. R. and Reid, N. (1987). Parameter orthogonality and approximate conditional inference. J. Roy. Statist. Soc. Ser. B 49 1–39.
  • Datta, G. S. and Ghosh, M. (1995). Some remarks on noninformative priors. J. Amer. Statist. Assoc. 90 1357–1363.
  • Datta, G. S. and Mukerjee, R. (2004). Probability Matching Priors: Higher Order Asymptotics. Lecture Notes in Statistics 178. Springer, New York.
  • Davison, A. C., Fraser, D. A. S., Reid, N. and Sartori, N. (2014). Accurate directional inference for vector parameters in linear exponential families. J. Amer. Statist. Assoc. 109 302–314.
  • Efron, B. (1993). Bayes and likelihood calculations from confidence intervals. Biometrika 80 3–26.
  • Efron, B. (2013). Bayes’ theorem in the 21st century. Science 340 1177–1178.
  • Evans, M. (2015). Measuring Statistical Evidence Using Relative Belief. Monographs on Statistics and Applied Probability 144. CRC Press, Boca Raton, FL.
  • Fieller, E. C. (1954). Symposium on interval estimation: Some problems in interval estimation. J. Roy. Statist. Soc. Ser. B 16 175–185.
  • Fienberg, S. E. (2006). Does it make sense to be an “objective Bayesian”? (comment on articles by Berger and by Goldstein). Bayesian Anal. 1 429–432.
  • Fisher, R. A. (1930). Inverse probability. Proc. Camb. Philos. Soc. 26 528–535.
  • Fisher, R. A. (1956). Statistical Methods and Scientific Inference. Oliver and Boyd, Edinburgh.
  • Fraser, D. A. S. (1961). The fiducial method and invariance. Biometrika 48 261–280.
  • Fraser, D. A. S. (1966). Structural probability and a generalization. Biometrika 53 1–9.
  • Fraser, D. A. S. (1990). Tail probabilities from observed likelihoods. Biometrika 77 65–76.
  • Fraser, D. A. S. (2003). Likelihood for component parameters. Biometrika 90 327–339.
  • Fraser, D. A. S. (2011). Is Bayes posterior just quick and dirty confidence? Statist. Sci. 26 299–316.
  • Fraser, D. A. S. (2016). The $p$-value function: The core concept of modern statistical inference. Ann. Rev. Stat. Appl. 4 1–14.
  • Fraser, D. A. S. and Reid, N. (1995). Ancillaries and third order significance. Util. Math. 47 33–53.
  • Fraser, D. A. S., Reid, N. and Sartori, N. (2016). Accurate directional inference for vector parameters. Biometrika 103 625–639.
  • Fraser, D. A. S., Reid, N. and Wu, J. (1999). A simple general formula for tail probabilities for frequentist and Bayesian inference. Biometrika 86 249–264.
  • Fraser, D. A. S., Wong, A. and Sun, Y. (2009). Three enigmatic examples and inference from likelihood. Canad. J. Statist. 37 161–181.
  • Fraser, D. A. S., Reid, N., Marras, E. and Yi, G. Y. (2010). Default priors for Bayesian and frequentist inference. J. R. Stat. Soc. Ser. B. Stat. Methodol. 72 631–654.
  • Fraser, D. A. S., Bédard, M., Wong, A., Lin, W. and Fraser, A. M. (2016). Bayes, reproducibility and the quest for truth. Statist. Sci. 31 578–590.
  • Ghosh, M. (2011). Objective priors: An introduction for frequentists. Statist. Sci. 26 187–202.
  • Goldstein, M. (2006). Subjective Bayesian analysis: Principles and practice. Bayesian Anal. 1 403–420.
  • Hannig, J. (2009). On generalized fiducial inference. Statist. Sinica 19 491–544.
  • Hannig, J., Iyer, H., Lai, R. C. S. and Lee, T. C. M. (2016). Generalized fiducial inference: A review and new results. J. Amer. Statist. Assoc. 111 1346–1361.
  • Hartmann, M., Hosack, G. R., Hillary, R. M. and Vanhatalo, J. (2017). Gaussian process framework for temporal dependence and discrepancy functions in Ricker-type population growth models. Ann. Appl. Stat. 11 1375–1402.
  • Izbicki, R., Lee, A. B. and Freeman, P. E. (2017). Photo-$z$ estimation: An example of nonparametric conditional density estimation under selection bias. Ann. Appl. Stat. 11 698–724.
  • Keele, L. and Quinn, K. M. (2017). Bayesian sensitivity analysis for causal effects from $2\times2$ tables in the presence of unmeasured confounding with application to presidential campaign visits. Ann. Appl. Stat. 11 1974–1997.
  • Laplace, P. S. (1812). Théorie Analytique des Probabilités. Courcier, Paris.
  • McCullagh, P. (2002). What is a statistical model? Ann. Statist. 30 1225–1310.
  • Neyman, J. (1937). Outline of a theory of statistical estimation based on the classical theory of probability. Philos. Trans. R. Soc. A 237 333–380.
  • Neyman, J. and Pearson, E. S. (1933). On the problem of the most efficient tests of statistical hypotheses. Philos. Trans. R. Soc. A 231 289–337.
  • Ogden, H. E. (2017). On asymptotic validity of naive inference with an approximate likelihood. Biometrika 104 153–164.
  • Pierce, D. A. and Bellio, R. (2017). Modern likelihood-frequentist inference. Int. Stat. Rev. 85 519–541.
  • Reid, N. and Cox, D. R. (2015). On some principles of statistical inference. Int. Stat. Rev. 83 293–308.
  • Reid, N. and Sun, Y. (2010). Assessing sensitivity to priors using higher order approximations. Comm. Statist. Theory Methods 39 1373–1386.
  • Rubin, D. B. (1984). Bayesianly justifiable and relevant frequency calculations for the applied statistician. Ann. Statist. 12 1151–1172.
  • Sartori, N. (2003). Modified profile likelihoods in models with stratum nuisance parameters. Biometrika 90 533–549.
  • Schweder, T. and Hjort, N. L. (2016). Confidence, Likelihood, Probability: Statistical Inference with Confidence Distributions. Cambridge Series in Statistical and Probabilistic Mathematics 41. Cambridge Univ. Press, New York.
  • Simoiu, C., Corbett-Davies, S. and Goel, S. (2017). The problem of infra-marginality in outcome tests for discrimination. Ann. Appl. Stat. 11 1193–1216.
  • Stein, C. (1959). An example of wide discrepancy between fiducial and confidence intervals. Ann. Math. Stat. 30 877–880.
  • Tak, H., Mandel, K., van Dyk, D. A., Kashyap, V. L., Meng, X.-L. and Siemiginowska, A. (2017). Bayesian estimates of astronomical time delays between gravitationally lensed stochastic light curves. Ann. Appl. Stat. 11 1309–1348.
  • Wasserman, L. (2006). Frequentist Bayes is objective (comment on articles by Berger and by Goldstein). Bayesian Anal. 1 451–456.
  • Xie, M. and Singh, K. (2013). Confidence distribution, the frequentist distribution estimator of a parameter: A review. Int. Stat. Rev. 81 3–39.