Electronic Journal of Statistics

Shrinkage estimation with a matrix loss function

Reman Abu-Shanab, John T. Kent, and William E. Strawderman

Full-text: Open access

Enhanced PDF (157 KB)

Abstract

Consider estimating an $n\times p$ matrix of means $\Theta$, say, from an $n\times p$ matrix of observations $X$, where the elements of $X$ are assumed to be independently normally distributed with $E(x_{ij})=\theta_{ij}$ and constant variance, and where the performance of an estimator is judged using a $p\times p$ matrix quadratic error loss function. A matrix version of the James-Stein estimator is proposed, depending on a tuning constant $a$. It is shown to dominate the usual maximum likelihood estimator for some choices of $a$ when $n\geq 3$. This result also extends to other shrinkage estimators and settings.

Article information

Source
Electron. J. Statist., Volume 6 (2012), 2347-2355.

Dates
First available in Project Euclid: 14 December 2012

Permanent link to this document
https://projecteuclid.org/euclid.ejs/1355495988

Digital Object Identifier
doi:10.1214/12-EJS748

Mathematical Reviews number (MathSciNet)
MR3020266

Zentralblatt MATH identifier
1295.62070

Subjects
Primary: 62C99: None of the above, but in this section
Secondary: 62H12: Estimation

Keywords
James-Stein estimator matrix quadratic loss function risk Stein’s Lemma

Citation

Abu-Shanab, Reman; Kent, John T.; Strawderman, William E. Shrinkage estimation with a matrix loss function. Electron. J. Statist. 6 (2012), 2347--2355. doi:10.1214/12-EJS748. https://projecteuclid.org/euclid.ejs/1355495988


Export citation

References

  • Baranchik, A. J. (1970). A family of minimax estimators of the mean of a multivariate normal distribution., Ann. Math. Statist. 41 642–645.
  • Brandwein, A. C. and Strawderman, W. E. (1991). Generalizations of James-Stein estimators under spherical symmetry., Ann. Statist. 19 1639–1650.
    Zentralblatt MATH: 0741.62058
    Digital Object Identifier: doi:10.1214/aos/1176348267
    Project Euclid: euclid.aos/1176348267
  • Cellier, D. and Fourdrinier, D. (1995). Shrinkage estimators under spherical symmetry for the general linear model., J. Multivariate Anal. 52 338–351.
    Zentralblatt MATH: 0814.62029
    Digital Object Identifier: doi:10.1006/jmva.1995.1018
  • Efron, B. and Morris, C. (1972). Empirical Bayes on vector observations: an extension of Stein’s method., Biometrika 59 335–347.
    Zentralblatt MATH: 0238.62072
    Digital Object Identifier: doi:10.1093/biomet/59.2.335
  • Efron, B. and Morris, C. (1976). Multivariate empirical Bayes and estimation of covariance matrices., Ann. Statist. 4 22–32.
    Zentralblatt MATH: 0322.62041
    Digital Object Identifier: doi:10.1214/aos/1176343345
    Project Euclid: euclid.aos/1176343345
  • Fourdrinier, D., Strawderman, W. E. and Wells, M. T. (2003). Robust shrinkage estimation for elliptically symmetric distributions with unknown covariance matrix., J. Multivariate Anal. 85 24–39.
    Zentralblatt MATH: 1014.62061
    Digital Object Identifier: doi:10.1016/S0047-259X(02)00023-4
  • Fourdrinier, D., Strawderman, W. E. and Wells, M. T. (2006). Estimation of a location parameter with restrictions of “vague information” for spherically symmetric distributions., Ann. Inst. Statist. Math. 58 73–92.
    Zentralblatt MATH: 1095.62069
    Digital Object Identifier: doi:10.1007/s10463-005-0001-0
  • Ghosh, M. and Shieh, G. (1991). Empirical Bayes minimax estimators of matrix normal means., J. Multivariate Anal. 38 306–318.
    Zentralblatt MATH: 0727.62011
    Digital Object Identifier: doi:10.1016/0047-259X(91)90048-7
  • Haff, L. R. (1977). Minimax estimators for a multinormal precision matrix., J. Multivariate Anal. 7 374–385.
    Zentralblatt MATH: 0402.62028
    Digital Object Identifier: doi:10.1016/0047-259X(77)90079-3
  • James, W. and Stein, C. (1961). Estimation with quadratic loss. In, Proc. 4th Berkeley Sympos. Math. Statist. and Prob., Vol. I 361–379. Univ. California Press, Berkeley, Calif.
    Zentralblatt MATH: 1281.62026
  • Shinozaki, N. (1984). Simultaneous estimation of location parameters under quadratic loss., Ann. Statist. 12 322–335.
    Zentralblatt MATH: 0542.62042
    Digital Object Identifier: doi:10.1214/aos/1176346410
    Project Euclid: euclid.aos/1176346410
  • Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution. In, Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability, 1954–1955, vol. I 197–206. University of California Press, Berkeley and Los Angeles.
  • Stein, C. M. (1981). Estimation of the mean of a multivariate normal distribution., Ann. Statist. 9 1135–1151. http://links.jstor.org/sici?sici=0090-5364(198111)9:6<1135:EOTMOA>2.0.CO;2-5&origin=MSN
  • Tsukuma, H. (2009). Generalized Bayes minimax estimation of the normal mean matrix with unknown covariance matrix., J. Multivariate Anal. 100 2296–2304.
    Mathematical Reviews (MathSciNet): MR2560370
    Zentralblatt MATH: 1175.62006
    Digital Object Identifier: doi:10.1016/j.jmva.2009.04.009
  • Tsukuma, H. and Kubokawa, T. (2007). Methods for improvement in estimation of a normal mean matrix., J. Multivariate Anal. 98 1592–1610.
    Zentralblatt MATH: 1122.62049
    Digital Object Identifier: doi:10.1016/j.jmva.2007.04.009
  • Zheng, Z. (1986). On estimation of matrix of normal mean., J. Multivariate Anal. 18 70–82.
    Zentralblatt MATH: 0615.62057
    Digital Object Identifier: doi:10.1016/0047-259X(86)90059-X

The Institute of Mathematical Statistics and the Bernoulli Society

Electronic Journal of Statistics

New content alerts

Email RSS ToC RSS Article
  • You have access to this content.
  • You have partial access to this content.
  • You do not have access to this content.
Turn Off MathJax

What is MathJax?

More like this

+ See more