Electronic Journal of Statistics

Partial martingale difference correlation

Trevor Park, Xiaofeng Shao, and Shun Yao

Full-text: Open access

Abstract

We introduce the partial martingale difference correlation, a scalar-valued measure of conditional mean dependence of $Y$ given $X$, adjusting for the nonlinear dependence on $Z$, where $X$, $Y$ and $Z$ are random vectors of arbitrary dimensions. At the population level, partial martingale difference correlation is a natural extension of partial distance correlation developed recently by Székely and Rizzo [14], which characterizes the dependence of $Y$ and $X$, after controlling for the nonlinear effect of $Z$. It extends the martingale difference correlation first introduced in Shao and Zhang [10] just as partial distance correlation extends the distance correlation in Székely, Rizzo and Bakirov [13]. Sample partial martingale difference correlation is also defined building on some new results on equivalent expressions of sample martingale difference correlation. Numerical results demonstrate the effectiveness of these new dependence measures in the context of variable selection and dependence testing.

Article information

Source
Electron. J. Statist., Volume 9, Number 1 (2015), 1492-1517.

Dates
Received: February 2015
First available in Project Euclid: 7 July 2015

Permanent link to this document
https://projecteuclid.org/euclid.ejs/1436277595

Digital Object Identifier
doi:10.1214/15-EJS1047

Mathematical Reviews number (MathSciNet)
MR3367668

Zentralblatt MATH identifier
1329.62272

Keywords
Distance correlation nonlinear dependence partial correlation variable selection

Citation

Park, Trevor; Shao, Xiaofeng; Yao, Shun. Partial martingale difference correlation. Electron. J. Statist. 9 (2015), no. 1, 1492--1517. doi:10.1214/15-EJS1047. https://projecteuclid.org/euclid.ejs/1436277595


Export citation

References

  • [1] Cook, R. D. and Li, B. (2002). Dimension reduction for conditional mean in regression., Annals of Statistics, 30, 455–474.
  • [2] Dueck, J., Edelmann, D., Gneiting, T., and Richards, D. (2014). The affinely invariant distance correlation., Bernoulli, 20, 2305–2330.
  • [3] Hastie, T., Tibshirani, R., and Friedman, J. (2009)., Elements of Statistical Learning, 2nd ed, Springer, New York.
  • [4] Kong, J., Klein, B. E. K., Klein, R., Lee, K., and Wahba, G. (2012). Using distance correlation and SS-AVOVA to assess associations of familial relationships, lifestyle factors, diseases, and mortality., Proceeding of the National Academy of Sciences, 109(50), 20352–20357.
  • [5] Legendre, P. (2000). Comparison of permutation methods for the partial correlation and partial Mantel tests., J. Statist. Compu. and Simu., 67, 37–73.
  • [6] Li, G., Li, Y., and Tsai, C.-L. (2014). Quantile correlations and quantile autoregressive modeling., Journal of the American Statistical Association, to appear.
  • [7] Li, R., Zhong, W., and Zhu, L. (2012). Feature Screening via Distance Correlation Learning., Journal of the American Statistical Association, 107, 1129–1139.
  • [8] Lyons, R. (2013). Distance covariance in metric spaces., Annals of Probability, 41, 3284–3305.
  • [9] Sejdinovick, D., Sriperumbudur, B., Gretton, A., and Fukumizu, K. (2013). Equivalence of distance-based and RKHS-based statistics in hypothesis testing., Annals of Statistics, 41, 2263–2291.
  • [10] Shao, X. and Zhang, J. (2014). Martingale difference correlation and its use in high dimensional variable screening., Journal of the American Statistical Association, 109, 1302–1318.
  • [11] Sheng, W. and Yin, X. (2013). Direction estimation in single-index models via distance covariance., Journal of Multivariate Analysis, 122, 148–161.
  • [12] Székely, G. J. and Rizzo, M. L. (2009). Brownian distance covariance., The Annals of Applied Statistics, 3, 1236–1265.
  • [13] Székely, G. J., Rizzo, M. L., and Bakirov, N. K. (2007). Measuring and testing independence by correlation of distances., Annals of Statistics, 35(6), 2769–2794.
  • [14] Székely, G. J. and Rizzo, M. L. (2014). Partial distance correlation with methods for dissimilarities., Annals of Statistics, to appear.
  • [15] Wang, X., Pan, W., Hu, W., Tian, Y., and Zhang, H. (2015). Conditional distance correlation., Journal of the American Statistical Association, to appear.