Open Access
November 2016 Approximate Models and Robust Decisions
James Watson, Chris Holmes
Statist. Sci. 31(4): 465-489 (November 2016). DOI: 10.1214/16-STS592

Abstract

Decisions based partly or solely on predictions from probabilistic models may be sensitive to model misspecification. Statisticians are taught from an early stage that “all models are wrong, but some are useful”; however, little formal guidance exists on how to assess the impact of model approximation on decision making, or how to proceed when optimal actions appear sensitive to model fidelity. This article presents an overview of recent developments across different disciplines to address this. We review diagnostic techniques, including graphical approaches and summary statistics, to help highlight decisions made through minimised expected loss that are sensitive to model misspecification. We then consider formal methods for decision making under model misspecification by quantifying stability of optimal actions to perturbations to the model within a neighbourhood of model space. This neighbourhood is defined in either one of two ways. First, in a strong sense via an information (Kullback–Leibler) divergence around the approximating model. Second, using a Bayesian nonparametric model (prior) centred on the approximating model, in order to “average out” over possible misspecifications. This is presented in the context of recent work in the robust control, macroeconomics and financial mathematics literature. We adopt a Bayesian approach throughout although the presentation is agnostic to this position.

Citation

Download Citation

James Watson. Chris Holmes. "Approximate Models and Robust Decisions." Statist. Sci. 31 (4) 465 - 489, November 2016. https://doi.org/10.1214/16-STS592

Information

Published: November 2016
First available in Project Euclid: 19 January 2017

zbMATH: 06946237
MathSciNet: MR3598725
Digital Object Identifier: 10.1214/16-STS592

Keywords: Bayesian nonparametrics , Computational decision theory , D-open problem , Kullback–Leibler divergence , model misspecification , robustness

Rights: Copyright © 2016 Institute of Mathematical Statistics

Vol.31 • No. 4 • November 2016
Back to Top