The Annals of Applied Statistics

The potential for bias in principal causal effect estimation when treatment received depends on a key covariate

Corwin M. Zigler and Thomas R. Belin

Full-text: Open access


Motivated by a potential-outcomes perspective, the idea of principal stratification has been widely recognized for its relevance in settings susceptible to posttreatment selection bias such as randomized clinical trials where treatment received can differ from treatment assigned. In one such setting, we address subtleties involved in inference for causal effects when using a key covariate to predict membership in latent principal strata. We show that when treatment received can differ from treatment assigned in both study arms, incorporating a stratum-predictive covariate can make estimates of the “complier average causal effect” (CACE) derive from observations in the two treatment arms with different covariate distributions. Adopting a Bayesian perspective and using Markov chain Monte Carlo for computation, we develop posterior checks that characterize the extent to which incorporating the pretreatment covariate endangers estimation of the CACE. We apply the method to analyze a clinical trial comparing two treatments for jaw fractures in which the study protocol allowed surgeons to overrule both possible randomized treatment assignments based on their clinical judgment and the data contained a key covariate (injury severity) predictive of treatment received.

Article information

Ann. Appl. Stat., Volume 5, Number 3 (2011), 1876-1892.

First available in Project Euclid: 13 October 2011

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

Complier average causal effect noncompliance principal effect principal stratification


Zigler, Corwin M.; Belin, Thomas R. The potential for bias in principal causal effect estimation when treatment received depends on a key covariate. Ann. Appl. Stat. 5 (2011), no. 3, 1876--1892. doi:10.1214/11-AOAS477.

Export citation


  • Angrist, J. D., Imbens, G. W. and Rubin, D. B. (1996). Identification of causal effects using instrumental variables. J. Amer. Statist. Assoc. 91 444–455.
  • Atchison, K. (1997). The general oral health assessment index. In Measuring Oral Health and Quality of Life 71–80 Univ. North Carolina, Chapel Hill, NC.
  • Barnard, J., Frangakis, C. E., Hill, J. L. and Rubin, D. B. (2003). Principal stratification approach to broken randomized experiments: A case study of school choice Vouchers in New York city. J. Amer. Statist. Assoc. 98 299–323.
  • de Finetti, B. (1974). Theory of Probability: A Critical Introductory Treatment. Wiley, New York.
  • Follmann, D. A. (2000). On the effect of treatment among would-be treatment compliers: An analysis of the Multiple Risk Factor Intervention Trial. J. Amer. Statist. Assoc. 95 1101–1109.
  • Frangakis, C. E. and Rubin, D. B. (1999). Addressing complications of intention-to-treat analysis in the combined presence of all-or-none treatment-noncompliance and subsequent missing outcomes. Biometrika 86 365–379.
  • Frangakis, C. E. and Rubin, D. B. (2002). Principal stratification in causal inference. Biometrics 58 21–29.
  • Frangakis, C. E., Rubin, D. B. and Zhou, X. (2002). Clustered encouragement designs with individual noncompliance: Bayesian inference with randomization, and application to advance directive forms. Biostatistics 3 147–164.
  • Gallop, R., Small, D. S., Lin, J. Y., Elliott, M. R., Joffe, M. and Ten Have, T. R. (2009). Mediation analysis with principal stratification. Stat. Med. 28 1108–1130.
  • Gelfand, A. E. and Smith, A. F. M. (1990). Sampling-based approaches to calculating marginal densities. J. Amer. Statist. Assoc. 85 398–409.
  • Gelman, A. and Rubin, D. B. (1992). Inference from iterative simulation using multiple sequences. Statist. Sci. 7 457–472.
  • Gelman, A., Carlin, J. B., Stern, H. S. and Rubin, D. B. (2004). Bayesian Data Analysis, 2nd ed. Chapman & Hall/CRC, Boca Raton, FL.
  • Geman, S. and Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence 6 721–741.
  • Gilbert, P. B., Bosch, R. J. and Hudgens, M. G. (2003). Sensitivity analysis for the assessment of causal vaccine effects on viral load in HIV vaccine trials. Biometrics 59 531–541.
  • Griffin, B. A., McCaffrey, D. F. and Morral, A. R. (2008). An application of principal stratification to control for institutionalization at follow-up in studies of substance abuse treatment programs. Ann. Appl. Stat. 2 1034–1055.
  • Hill, J. L., Brooks-Gunn, J. and Waldfogel, J. (2003). Sustained effects of high participation in an early intervention for low-birth-weight premature infants. Developmental Psychology 39 730–744.
  • Hirano, K., Imbens, G. W., Rubin, D. B. and Zhou, X. (2000). Assessing the effect of an influenza vaccine in an encouragement design. Biostatistics 1 69–88.
  • Holland, P. W. (1986). Statistics and causal inference. J. Amer. Statist. Assoc. 81 945–960. With discussion and a reply by the author.
  • Hudgens, M. G. and Halloran, M. E. (2006). Causal vaccine effects on binary postinfection outcomes. J. Amer. Statist. Assoc. 101 51–64.
  • Hudgens, M. G., Hoering, A. and Self, S. G. (2003). On the analysis of viral load endpoints in HIV vaccine trials. Stat. Med. 22 2281–2298.
  • Imbens, G. W. and Angrist, J. D. (1994). Identification and estimation of local average treatment effects. Econometrica 62 467–467.
  • Imbens, G. W. and Rubin, D. B. (1997). Bayesian inference for causal effects in randomized experiments with noncompliance. Ann. Statist. 25 305–327.
  • Jin, H. and Rubin, D. B. (2008). Principal stratification for causal inference with extended partial compliance. J. Amer. Statist. Assoc. 103 101–111.
  • Jo, B. and Stuart, E. A. (2009). On the use of propensity scores in principal causal effect estimation. Stat. Med. 28 2857–2875.
  • Joffe, M. M., Small, D. and Hsu, C. Y. (2007). Defining and estimating intervention effects for groups that will develop an auxiliary outcome. Statist. Sci. 22 74–97.
  • Joffe, M. M., Ten Have, T. R. and Brensinger, C. (2003). The compliance score as a regressor in randomized trials. Biostatistics 4 327–340.
  • McClellan, M., McNeil, B. J. and Newhouse, J. P. (1994). Does more intensive treatment of acute myocardial infarction in the elderly reduce mortality? Analysis using instrumental variables. Journal of the American Medical Association 272 859–866.
  • Rosenbaum, P. R. and Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika 70 41–55.
  • Roy, J., Hogan, J. W. and Marcus, B. H. (2008). Principal stratification with predictors of compliance for randomized trials with 2 active treatments. Biostatistics 9 277–289.
  • Rubin, D. B. (1978a). Bayesian inference for causal effects: The role of randomization. Ann. Statist. 6 34–58.
  • Rubin, D. B. (1978b). Multiple imputations in sample surveys—a phenomenological Bayesian approach to nonresponse. In Proceedings of the Section on Survey Research Methods 20–34. American Statistical Association, Alexandria, VA.
  • Shepherd, B. E., Gilbert, P. B., Jemiai, Y. and Rotnitzky, A. (2006). Sensitivity analyses comparing outcomes only existing in a subset selected post-randomization, conditional on covariates, with application to HIV vaccine trials. Biometrics 62 332–342.
  • Shetty, V., Atchison, K., Der-Matirosian, C., Wang, J. and Belin, T. R. (2007). The mandible injury severity score: Development and validity. Journal of Oral and Maxillofacial Surgery 65 663–670.
  • Shetty, V., Atchison, K., Leathers, R., Black, E., Zigler, C. and Belin, T. R. (2008). Do the benefits of rigid internal fixation of mandible fractures justify the added costs? Results from a randomized controlled trial. Journal of Oral and Maxillofacial Surgery 66 2203–2212.
  • Zigler, C. M. and Belin, T. R. (2011). Supplement to “The potential for Bias in principal causal effect estimation when treatment received depends on a key covariate.” DOI:10.1214/11-AOAS477SUPP.

Supplemental materials