- Volume 23, Number 1 (2017), 552-581.
On the prediction performance of the Lasso
Although the Lasso has been extensively studied, the relationship between its prediction performance and the correlations of the covariates is not fully understood. In this paper, we give new insights into this relationship in the context of multiple linear regression. We show, in particular, that the incorporation of a simple correlation measure into the tuning parameter can lead to a nearly optimal prediction performance of the Lasso even for highly correlated covariates. However, we also reveal that for moderately correlated covariates, the prediction performance of the Lasso can be mediocre irrespective of the choice of the tuning parameter. We finally show that our results also lead to near-optimal rates for the least-squares estimator with total variation penalty.
Bernoulli, Volume 23, Number 1 (2017), 552-581.
Received: October 2014
Revised: July 2015
First available in Project Euclid: 27 September 2016
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Dalalyan, Arnak S.; Hebiri, Mohamed; Lederer, Johannes. On the prediction performance of the Lasso. Bernoulli 23 (2017), no. 1, 552--581. doi:10.3150/15-BEJ756. https://projecteuclid.org/euclid.bj/1475001366