Open Access
VOL. 9 | 2013 Improved matrix uncertainty selector
Mathieu Rosenbaum, Alexandre B. Tsybakov

Editor(s) M. Banerjee, F. Bunea, J. Huang, V. Koltchinskii, M. H. Maathuis

Inst. Math. Stat. (IMS) Collect., 2013: 276-290 (2013) DOI: 10.1214/12-IMSCOLL920


We consider the regression model with observation error in the design:

\begin{eqnarray*}y&=&X\theta^*+\xi,\\ Z&=&X+\Xi.\end{eqnarray*}

Here the random vector $y\in\mathbb{R}^n$ and the random $n\times p$ matrix $Z$ are observed, the $n\times p$ matrix $X$ is unknown, $\Xi$ is an $n\times p$ random noise matrix, $\xi\in\mathbb{R}^n$ is a random noise vector, and $\theta^*$ is a vector of unknown parameters to be estimated. We consider the setting where the dimension $p$ can be much larger than the sample size $n$ and $\theta^*$ is sparse. Because of the presence of the noise matrix $\Xi$, the commonly used Lasso and Dantzig selector are unstable. An alternative procedure called the Matrix Uncertainty (MU) selector has been proposed in Rosenbaum and Tsybakov [ The Annals of Statistics 38 (2010) 2620–2651] in order to account for the noise. The properties of the MU selector have been studied in Rosenbaum and Tsybakov [ The Annals of Statistics 38 (2010) 2620–2651] for sparse $\theta^*$ under the assumption that the noise matrix $\Xi$ is deterministic and its values are small. In this paper, we propose a modification of the MU selector when $\Xi$ is a random matrix with zero-mean entries having the variances that can be estimated. This is, for example, the case in the model where the entries of $X$ are missing at random. We show both theoretically and numerically that, under these conditions, the new estimator called the Compensated MU selector achieves better accuracy of estimation than the original MU selector.


Published: 1 January 2013
First available in Project Euclid: 8 March 2013

zbMATH: 1327.62410
MathSciNet: MR3202640

Digital Object Identifier: 10.1214/12-IMSCOLL920

Primary: 62J05
Secondary: 62F12

Keywords: Errors-in-variables model , matrix uncertainty , measurement error , missing data , MU selector , restricted eigenvalue assumption , Sparsity

Rights: Copyright © 2010, Institute of Mathematical Statistics

Back to Top