Open Access
2014 Sparse model selection under heterogeneous noise: Exact penalisation and data-driven thresholding
Laurent Cavalier, Markus Reiß
Electron. J. Statist. 8(1): 432-455 (2014). DOI: 10.1214/14-EJS889

Abstract

We consider a Gaussian sequence space model $X_{\lambda}=f_{\lambda}+\xi_{\lambda},$ where the noise variables $(\xi_{\lambda})_{\lambda}$ are independent, but with heterogeneous variances $(\sigma_{\lambda}^{2})_{\lambda}$. Our goal is to estimate the unknown signal vector $(f_{\lambda})$ by a model selection approach. We focus on the situation where the non-zero entries $f_{\lambda}$ are sparse. Then the heterogenous case is much more involved than the homogeneous model where $\sigma_{\lambda}^{2}=\sigma^{2}$ is constant. Indeed, we can no longer profit from symmetry inside the stochastic process that one needs to control. The problem and the penalty do not only depend on the number of coefficients that one selects, but also on their position. This appears also in the minimax bounds where the worst coefficients will go to the larger variances. With a careful and explicit choice of the penalty, however, we are able to select the correct coefficients and get a sharp non-asymptotic control of the risk of our procedure. Some finite sample results from simulations are provided.

Citation

Download Citation

Laurent Cavalier. Markus Reiß. "Sparse model selection under heterogeneous noise: Exact penalisation and data-driven thresholding." Electron. J. Statist. 8 (1) 432 - 455, 2014. https://doi.org/10.1214/14-EJS889

Information

Published: 2014
First available in Project Euclid: 18 April 2014

zbMATH: 1294.62058
MathSciNet: MR3195122
Digital Object Identifier: 10.1214/14-EJS889

Subjects:
Primary: 62G05
Secondary: 62J05

Keywords: full subset selection , heteroskedastic noise , optimal threshold , Penalized empirical risk , risk hull , Sparse oracle inequality , Statistical inverse problem

Rights: Copyright © 2014 The Institute of Mathematical Statistics and the Bernoulli Society

Vol.8 • No. 1 • 2014
Back to Top