Abstract
Using a collection of simulated and real benchmarks, we compare Bayesian and frequentist regularization approaches under a low informative constraint when the number of variables is almost equal to the number of observations on simulated and real datasets. This comparison includes new global noninformative approaches for Bayesian variable selection built on Zellner’s -priors that are similar to Liang et al. (2008). The interest of those calibration-free proposals is discussed. The numerical experiments we present highlight the appeal of Bayesian regularization methods, when compared with non-Bayesian alternatives. They dominate frequentist methods in the sense that they provide smaller prediction errors while selecting the most relevant variables in a parsimonious way.
Citation
Gilles Celeux. Mohammed El Anbari. Jean-Michel Marin. Christian P. Robert. "Regularization in Regression: Comparing Bayesian and Frequentist Methods in a Poorly Informative Situation." Bayesian Anal. 7 (2) 477 - 502, June 2012. https://doi.org/10.1214/12-BA716
Information