Open Access
VOL. 9 | 2013 The Lasso, correlated design, and improved oracle inequalities
Chapter Author(s) Sara van de Geer, Johannes Lederer
Editor(s) M. Banerjee, F. Bunea, J. Huang, V. Koltchinskii, M. H. Maathuis
Inst. Math. Stat. (IMS) Collect., 2013: 303-316 (2013) DOI: 10.1214/12-IMSCOLL922

Abstract

We study high-dimensional linear models and the $\ell_1$-penalized least squares estimator, also known as the Lasso estimator. In literature, oracle inequalities have been derived under restricted eigenvalue or compatibility conditions. In this paper, we complement this with entropy conditions which allow one to improve the dual norm bound, and demonstrate how this leads to new oracle inequalities. The new oracle inequalities show that a smaller choice for the tuning parameter and a trade-off between $\ell_1$-norms and small compatibility constants are possible. This implies, in particular for correlated design, improved bounds for the prediction error of the Lasso estimator as compared to the methods based on restricted eigenvalue or compatibility conditions only.

Information

Published: 1 January 2013
First available in Project Euclid: 8 March 2013

zbMATH: 1327.62426

Digital Object Identifier: 10.1214/12-IMSCOLL922

Subjects:
Primary: 62J05
Secondary: 62J99

Keywords: compatibility , Correlation , Entropy , high-dimensional model , Lasso

Rights: Copyright © 2010, Institute of Mathematical Statistics

Back to Top