Translator Disclaimer
June 2014 Bayesian Regularization via Graph Laplacian
Fei Liu, Sounak Chakraborty, Fan Li, Yan Liu, Aurelie C. Lozano
Bayesian Anal. 9(2): 449-474 (June 2014). DOI: 10.1214/14-BA860

Abstract

Regularization plays a critical role in modern statistical research, especially in high-dimensional variable selection problems. Existing Bayesian methods usually assume independence between variables a priori. In this article, we propose a novel Bayesian approach, which explicitly models the dependence structure through a graph Laplacian matrix. We also generalize the graph Laplacian to allow both positively and negatively correlated variables. A prior distribution for the graph Laplacian is then proposed, which allows conjugacy and thereby greatly simplifies the computation. We show that the proposed Bayesian model leads to proper posterior distribution. Connection is made between our method and some existing regularization methods, such as Elastic Net, Lasso, Octagonal Shrinkage and Clustering Algorithm for Regression (OSCAR) and Ridge regression. An efficient Markov Chain Monte Carlo method based on parameter augmentation is developed for posterior computation. Finally, we demonstrate the method through several simulation studies and an application on a real data set involving key performance indicators of electronics companies.

Citation

Download Citation

Fei Liu. Sounak Chakraborty. Fan Li. Yan Liu. Aurelie C. Lozano. "Bayesian Regularization via Graph Laplacian." Bayesian Anal. 9 (2) 449 - 474, June 2014. https://doi.org/10.1214/14-BA860

Information

Published: June 2014
First available in Project Euclid: 26 May 2014

zbMATH: 1327.62152
MathSciNet: MR3217003
Digital Object Identifier: 10.1214/14-BA860

Rights: Copyright © 2014 International Society for Bayesian Analysis

JOURNAL ARTICLE
26 PAGES


SHARE
Vol.9 • No. 2 • June 2014
Back to Top