Open Access
June 2020 GRID: A variable selection and structure discovery method for high dimensional nonparametric regression
Francesco Giordano, Soumendra Nath Lahiri, Maria Lucia Parrella
Ann. Statist. 48(3): 1848-1874 (June 2020). DOI: 10.1214/19-AOS1846

Abstract

We consider nonparametric regression in high dimensions where only a relatively small subset of a large number of variables are relevant and may have nonlinear effects on the response. We develop methods for variable selection, structure discovery and estimation of the true low-dimensional regression function, allowing any degree of interactions among the relevant variables that need not be specified a-priori. The proposed method, called the GRID, combines empirical likelihood based marginal testing with the local linear estimation machinery in a novel way to select the relevant variables. Further, it provides a simple graphical tool for identifying the low dimensional nonlinear structure of the regression function. Theoretical results establish consistency of variable selection and structure discovery, and also Oracle risk property of the GRID estimator of the regression function, allowing the dimension $d$ of the covariates to grow with the sample size $n$ at the rate $d=O(n^{a})$ for any $a\in(0,\infty)$ and the number of relevant covariates $r$ to grow at a rate $r=O(n^{\gamma})$ for some $\gamma\in(0,1)$ under some regularity conditions that, in particular, require finiteness of certain absolute moments of the error variables depending on $a$. Finite sample properties of the GRID are investigated in a moderately large simulation study.

Citation

Download Citation

Francesco Giordano. Soumendra Nath Lahiri. Maria Lucia Parrella. "GRID: A variable selection and structure discovery method for high dimensional nonparametric regression." Ann. Statist. 48 (3) 1848 - 1874, June 2020. https://doi.org/10.1214/19-AOS1846

Information

Received: 1 June 2017; Revised: 1 March 2019; Published: June 2020
First available in Project Euclid: 17 July 2020

zbMATH: 07241614
MathSciNet: MR4124346
Digital Object Identifier: 10.1214/19-AOS1846

Subjects:
Primary: 62G08 , 62G20
Secondary: 62G10 , 62H15

Keywords: empirical likelihood , marginal testing , variable selection consistency

Rights: Copyright © 2020 Institute of Mathematical Statistics

Vol.48 • No. 3 • June 2020
Back to Top