Open Access
March 2012 Efficient regularized isotonic regression with application to gene–gene interaction search
Ronny Luss, Saharon Rosset, Moni Shahar
Ann. Appl. Stat. 6(1): 253-283 (March 2012). DOI: 10.1214/11-AOAS504


Isotonic regression is a nonparametric approach for fitting monotonic models to data that has been widely studied from both theoretical and practical perspectives. However, this approach encounters computational and statistical overfitting issues in higher dimensions. To address both concerns, we present an algorithm, which we term Isotonic Recursive Partitioning (IRP), for isotonic regression based on recursively partitioning the covariate space through solution of progressively smaller “best cut” subproblems. This creates a regularized sequence of isotonic models of increasing model complexity that converges to the global isotonic regression solution. The models along the sequence are often more accurate than the unregularized isotonic regression model because of the complexity control they offer. We quantify this complexity control through estimation of degrees of freedom along the path. Success of the regularized models in prediction and IRPs favorable computational properties are demonstrated through a series of simulated and real data experiments. We discuss application of IRP to the problem of searching for gene–gene interactions and epistasis, and demonstrate it on data from genome-wide association studies of three common diseases.


Download Citation

Ronny Luss. Saharon Rosset. Moni Shahar. "Efficient regularized isotonic regression with application to gene–gene interaction search." Ann. Appl. Stat. 6 (1) 253 - 283, March 2012.


Published: March 2012
First available in Project Euclid: 6 March 2012

zbMATH: 1235.62046
MathSciNet: MR2951537
Digital Object Identifier: 10.1214/11-AOAS504

Keywords: Multivariate isotonic regression , Nonparametric regression , partitioning , regularization path

Rights: Copyright © 2012 Institute of Mathematical Statistics

Vol.6 • No. 1 • March 2012
Back to Top