The Annals of Applied Statistics

Estimating limits from Poisson counting data using Dempster–Shafer analysis

Paul T. Edlefsen, Chuanhai Liu, and Arthur P. Dempster

Source: Ann. Appl. Stat. Volume 3, Number 2 (2009), 764-790.

Abstract

We present a Dempster–Shafer (DS) approach to estimating limits from Poisson counting data with nuisance parameters. Dempster–Shafer is a statistical framework that generalizes Bayesian statistics. DS calculus augments traditional probability by allowing mass to be distributed over power sets of the event space. This eliminates the Bayesian dependence on prior distributions while allowing the incorporation of prior information when it is available. We use the Poisson Dempster–Shafer model (DSM) to derive a posterior DSM for the “Banff upper limits challenge” three-Poisson model. The results compare favorably with other approaches, demonstrating the utility of the approach. We argue that the reduced dependence on priors afforded by the Dempster–Shafer framework is both practically and theoretically desirable.

Related Works:

Keywords: Dempster–Shafer; Bayesian; belief function; evidence theory; Poisson; high-energy physics; Higgs boson

Full-text: Access denied (no subscription detected)

In 2007, access to the Annals of Applied Statistics was open. Beginning in 2008, you must hold a subscription or be a member of the IMS to view the full journal. For more information on subscribing, please visit: http://imstat.org/orders.
If you are already an IMS member, you may need to update your Euclid profile following the instructions here: http://imstat.org/publications/eaccess.htm.
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aoas/1245676194
Digital Object Identifier: doi:10.1214/00-AOAS223

References

Almond, R. G. (1988). Fusion and propagation in graphical belief models. Technical Report S-121, Statistics Dept., Harvard, Univ.
Almond, R. G. (1989). Fusion and propagation of graphical belief models: An implementation and an example. Ph.D. thesis, Harvard, Univ.
Almond, R. G. (1995)., Graphical Belief Modeling. Chapman & Hall, London/New York.
Cobb, B. R. and Shenoy, P. P. (2006). On the plausibility transformation method for translating belief function models to probability models., Internat. J. Approx. Reason. 41 314–330.
Mathematical Reviews (MathSciNet): MR2222415
Zentralblatt MATH: 1093.68112
Digital Object Identifier: doi:10.1016/j.ijar.2005.06.008
Conrad, J. and Tegenfeldt, F. (2006). Likelihood ratio intervals with Bayesian treatment of uncertainties: Coverage, power and combined experiments. In, Statistical Problems in Particle Physics, Astrophysics and Cosmology (L. Lyons and M. Karagöz Ünel, eds.) 93. Imperial College Press, London.
Cranmer, K. (2003). Frequentist hypothesis testing with background uncertainty. In, Statistical Problems in Particle Physics, Astrophysics, and Cosmology (L. Lyons, R. Mount and R. Reitmeyer, eds.) 261. Imperial College Press, London.
Demortier, L. (2006). Bayesian reference analysis. In, Statistical Problems in Particle Physics, Astrophysics and Cosmology (L. Lyons and M. Karagöz Ünel, eds.) 11. Imperial College Press, London.
Dempster, A. P. (1967a). Upper and lower probabilities induced by a multivalued mapping., Ann. Math. Statist. 38 325–339.
Mathematical Reviews (MathSciNet): MR207001
Digital Object Identifier: doi:10.1214/aoms/1177698950
Project Euclid: euclid.aoms/1177698950
Dempster, A. P. (1967b). Upper and lower probability inferences based on a sample from a finite univariate population., Biometrika 54 515–528.
Mathematical Reviews (MathSciNet): MR224182
Dempster, A. P. (1968a). A generalization of Bayesian inference., J. R. Stat. Soc. Ser. B Stat. Methodol. 30 205–247.
Dempster, A. P. (1968b). Upper and lower probabilities generated by a random closed interval., Ann. Math. Statist. 39 957–966.
Mathematical Reviews (MathSciNet): MR238429
Digital Object Identifier: doi:10.1214/aoms/1177698328
Project Euclid: euclid.aoms/1177698328
Dempster, A. P. (2008). The Dempster–Shafer calculus for statisticians., Internat. J. Approx. Reason. 48 365–377.
Mathematical Reviews (MathSciNet): MR2419025
Digital Object Identifier: doi:10.1016/j.ijar.2007.03.004
Edlefsen, P. T., Liu, C. and Dempster, A. P. (2008). Supplement to “Estimating limits from Poisson counting data using Dempster–Shafer analysis.” DOI:, 10.1214/08-AOAS223SUPP.
Heinrich, J. (2005). Bayesian limit software: Multi-channel with correlated backgrounds and efficiencies. Technical Report 7587, The Collider Detector at, Fermilab.
Heinrich, J. (2006a). BIRS a1 limits project. Available at, http://newton.hep.upenn.edu/~heinrich/birs/.
Heinrich, J. (2006b). Limits comparison project. Available at, http://newton.hep.upenn.edu/~heinrich/birs/project.pdf.
Heinrich, J. (2006c). Setting the scene for limits and nuisance parameters. Available at, http://newton.hep.upenn.edu/~heinrich/birs/a1.pdf.
Heinrich, J. (2008). Review of the Banff challenge on upper limits. In, Proceedings of the 2007 PHYSTAT LHC Workshop on Statistical Issues for LHC Physics (H. B. Prosper, L. Lyons and A. De Roeck, eds.) 133–142.
Heinrich, J., Blocker, C., Conway, J., Demortier, L., Lyons, L., Punzi, G. and Sinervo, P. K. (2004). Interval estimation in the presence of nuisance parameters. 1. Bayesian approach. Available at, arXiv:physics/0409129.
Igo-Kemenes, P. (2006). Searches for Higgs bosons., J. Phys. G 33 1.
Kennes, R. (1992). Computational aspects of the Möbius transformation of graphs., IEEE Trans. Systems Man Cybernet. 22 201–223.
Mathematical Reviews (MathSciNet): MR1171542
Digital Object Identifier: doi:10.1109/21.148425
Kohlas, J. and Monney, P. A. (1994). Theory of evidence: A survey of its mathematical foundations, applications and computational aspects., Math. Methods Oper. Res. 39 35–68.
Mathematical Reviews (MathSciNet): MR1268635
Kohlas, J. and Monney, P. A. (1995)., A Mathematical Theory of Hints: An Approach to the Dempster–Shafer Theory of Evidence 425. Springer, Berlin.
Mathematical Reviews (MathSciNet): MR1342299
Zentralblatt MATH: 0833.62005
Kong, A. (1986). Multivariate belief functions and graphical models. Ph.D. thesis, Dept. Statistics, Harvard, Univ.
Linnemann, J., Lyons, L. and Reid, N. (2006). BIRS workshop on statistical inference problems in high energy physics and astronomy objectives document. Available at, http://www.birs.ca/workshops/2006/06w5054/Objectives06w5054.html.
Linnemann, J., Lyons, L. and Reid, N. (2007). Report for workshop 06w5054: Statistical inference problems in high energy physics and astronomy. Available at, http://www.birs.ca/workshops/2006/06w5054/report06w5054.pdf.
Pearl, J. (1982). Reverend Bayes on inference engines: A distributed hierarchical approach. In, Proceedings of the American Association of Artificial Intelligence National Conference on AI 133–136.
Punzi, G. (2006). Ordering algorithms and confidence intervals in the presence of nuisance parameters. In, Statistical Problems in Particle Physics, Astrophysics and Cosmology (L. Lyons and M. Karagöz Ünel, eds.) 88. Imperial College Press, London.
Rolke, W. A., Lopez, A. M. and Conrad, J. (2005). Limits and confidence intervals in the presence of nuisance parameters., Nucl. Instrum. Meth. A 551 493–503.
Shafer, G. (1976)., A Mathematical Theory of Evidence. Princeton Univ. Press, Princeton, NJ.
Mathematical Reviews (MathSciNet): MR464340
Zentralblatt MATH: 0359.62002
Shenoy, P. P. and Shafer, G. (1986). Propagating belief functions with local computations., IEEE Expert 1 43–52.
Thoma, H. M. (1989). Factorization of belief functions. Ph.D. thesis, Statistics Dept., Harvard Univ., Cambridge,, MA.
Thoma, H. M. (1991). Belief function computations. In, Conditional Logic in Expert Systems (I. R. Goodman, M. M. Gupta, H. T. Nguyen and G. S. Rogers, eds.). North-Holland, Amsterdam, 269–308.
Mathematical Reviews (MathSciNet): MR1149605

2009 © Institute of Mathematical Statistics