Regularized optimization in statistical learning: A bayesian perspective

Statistica Sinica

Volumn 16, Issue 2, 2006, Pages 411-424

  Li, Bin ^a   Goel, Prem K ^a  

^a OHIO STATE UNIVERSITY   (United States)

Author keywords

Bayesian robustness; Bridge regression; Flat tailed prior; Group LASSO; LASSO; Regularized optimization

Indexed keywords

EID: 33746164477     PISSN: 10170405     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (22)

1. Berger, J. O. (1985). Statistical Decision Theory and Bayesian Analysis. Springer-Verlag, New York.
2. Berger, J. O. (1994). An overview of robustness Bayesian analysis. Test 3, 5-58.
3. Box, G. E. P. and Tiao, G. C. (1973). Bayesian Inference in Statistical Analysis. Addison-Wesley, New York.
4. Donoho, D. L., Johnstone, I. M., Kerkyacharian, G. and Picard, D. (1996). Density estimation by wavelet thresholding. Ann. Statist. 24, 508-539.
5. Fan, J. and Li, R. Z. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. J. Amer. Statist. Assoc. 96, 1348-1360.
6. Frank, I. E. and Friedman, J. H. (1993). A statistical view of some chemometrics regression tools. Technometrics 35, 109-148.
7. Fan, T. H. and Berger, J. O. (1992). Behavior of the posterior distribution and inferences for a normal mean with t prior distributions. Statist. Decisions 10, 99-120.
8. Fu, W. (1998). Penalized regressions: the Bridge versus the LASSO. J. Comput. Graph. Statist. 7, 397-416.
9. Gustafson, P. (2000). Local robustness in Bayesian analysis. In Robust Bayesian Analysis (Edited by D. R. Insua and F. Ruggeri), 71-88. Springer-Verlag, New York.
10. Gustafson, P., Srinivasan, C. and Wasserman, L. (1996). Local sensitivity analysis. In Bayesian Statistics 5 (Edited by J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith), 197-210. Oxford University Press, London.
11. Hoerl, A. E. and Kennard, R. W. (1970). Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12, 55-67.
12. Knight, K. and Fu, W. (2000). Asymptotics for lasso-type estimators. Ann. Statist. 28, 1356-1378.
13. Leng, C., Lin, Y. and Wahba, G. (2004). A note on the LASSO and related procedures in model selection. Technical Report 1091r.
14. Moreno, E. (2000). Global Bayesian robustness for some classes of prior distributions. In Robust Bayesian Analysis (Edited by D. R. Insua and F. Ruggeri), 45-70. Springer-Verlag, New York.
15. O'Hagan, A. (1988). Modelling with heavy tails. In Bayesian Statistics 3 (Edited by J. M. Bernardo, M. H. DeGroot, D. V. Lindley and A. F. M. Smith), 345-359. Oxford University Press, London.
16. Pericchi, L. R. and Smith, A. F. M. (1992). Exact and approximate posterior moments for a normal location parameter. J. Roy. Statist. Soc. Ser. B 54, 793-804.
17. Sivaganesan, S. (2000). Global and local robustness approaches: uses and limitations. In Robust Bayesian Analysis (Edited by D. R. Insua and F. Ruggeri), 89-108. Springer-Verlag, New York.
18. Stone, M. (1977). An asymptotic equivalence of choice of model by cross-validation and Akaike's criterion. J. Roy. Statist. Soc. Ser. B 39, 44-47.
19. Tibshirani, R. (1996). Regression shrinkage and selection via the LASSO. J. Roy. Statist. Soc. Ser. B 58, 267-288.
20. Vapnik, V. (1998). Statistical Learning Theory. John Wiley, New York.
21. Yuan, M. and Lin, Y. (2006). Model selection and estimation in regression with grouped variables. J. Roy. Statist. Soc. Ser. B 68, 49-67.
22. Zou, H. and Hastie, T. (2005). Regularization and variable selection via the elastic net. J. Roy. Statist. Soc. Ser. B 67, 301-320.