Shrink Globally, Act Locally: Sparse Bayesian Regularization and Prediction*

Nicholas G. Polson and James G. Scott

in Bayesian Statistics 9

Published in print October 2011 | ISBN: 9780199694587
Published online January 2012 | e-ISBN: 9780191731921 | DOI:
Shrink Globally, Act Locally: Sparse Bayesian Regularization and Prediction*

More Like This

Show all results sharing this subject:

  • Probability and Statistics


Show Summary Details


We study the classic problem of choosing a prior distribution for a location parameter β = (β 1,…, β p) as p grows large. First, we study the standard “global‐local shrinkage” approach, based on scale mixtures of normals. Two theorems are presented which characterize certain desirable properties of shrinkage priors for sparse problems. Next, we review some recent results showing how Lévy processes can be used to generate infinite‐dimensional versions of standard normal scale‐mixture priors, along with new priors that have yet to be seriously studied in the literature. This approach provides an intuitive framework both for generating new regularization penalties and shrinkage rules, and for performing asymptotic analysis on existing models.

Keywords: Lévy Processes; Shrinkage; Sparsity

Chapter.  19752 words.  Illustrated.

Subjects: Probability and Statistics

Full text: subscription required

How to subscribe Recommend to my Librarian

Buy this work at Oxford University Press »

Users without a subscription are not able to see the full content. Please, subscribe or login to access all content.