A bayesian approach to multicollinearity and the simultaneous selection and clustering of predictors in linear regression

Journal of Statistical Theory and Practice

Volumn 5, Issue 4, 2011, Pages 715-735

  Curtis, S McKay ^a   Ghosh, Sujit K ^b  

^a UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

^b NORTH CAROLINA STATE UNIVERSITY   (United States)

Author keywords

Dirichlet process; Stochastic search; Variable selection

Indexed keywords

EID: 84860813282     PISSN: 15598608     EISSN: 15598616     Source Type: Journal    
DOI: 10.1080/15598608.2011.10483741     Document Type: Article

References (40)

1. Akaike, H. Information theory and an extension of the maximum likelihood principle. Second International Symposium on Information Theory. Edited by: Petrov, B. N. and Csaki, F.
2. Belsley, D. A. 1984. Demeaning conditioning diagnostics through centering (with discussion). The American Statistician, 38: 73-93.
3. Belsley, D. A. 1991. Conditioning Diagnostics: Collinearity and Weak Data in Regression, Wiley.
4. Belsley, D. A., Kuh, E., and, Welsch, R. E. 1980. Regression Diagnostics: Identifying Influential Data and Sources of Collinearity, Wiley.
5. Blackwell, D., and, MacQueen, J. B. 1973. Ferguson distributions via polya urn schemes. Annals of Statistics, 1: 353-355.
6. Blanchard, O. J. 1987. Comment. Journal of Business and Economic Statisitics, 5: 449-451.
7. Bondell, H. D., and, Reich, B. J. 2008. Simultaneous regression shrinkage, variable selection, and supervised clustering of predictors with oscar. Biometrics, 64: 115-123. (Pubitemid 351316873)
8. Bondell, H. D., and, Reich, B. J. 2009. Simultaneous factor selection and collapsing levels in anova. Biometrics, 65: 169-177.
9. Buse, A. 1994. Brickmaking and the collinear arts: A cautionary tale. Canadian Journal of Economics, 27: 408-414.
10. Ehrlich, I. 1973. Participation in illegitimate activities: a theoretical and empirical investigation. Journal of Political Economy, 81: 521-567.
11. Ehrlich, I. 1975. The deterrent effect of capital punishment: a question of life or death. American Economic Review, 65: 397-417.
12. Ferguson, T. 1973. A Bayesian analysis of some nonparmetric problems. Annals of Statistics, 1 (2): 209-230.
13. Gelman, A., and, Rubin, D. 1992. Inference from iterative simulation using multiple sequences. Statistical Science, 7: 457-511.
14. George, E. I., and, McCulloch, R. E. 1993. Variable selection via Gibbs sampling. Journal of the American Statistical Association, 88: 881-889.
15. Ghosh, J. K., and, Ramamoorthi, R. V. 2003. Bayesian Nonparametrics, Springer.
16. Goldberger, A. S. 1991. A Course in Econometrics, Harvard University Press.
17. Gopalan, R., and, Berry, D. A. 1998. Bayesian multiple comparisons using Dirichlet process priors. Journal of the American Statistical Association, 93: 1130-1139.
18. Hald, A. 1952. Statistical Theory with Engineering Applications, New York: Wiley.
19. Hill, R. C., and, Adkins, L. C. 2003. Collinearity. In A Companion to Theoretical Econometrics, Edited by: Baltagi, B. H. 256-278. Blackwell Publishing. Chapter 12
20. Hoerl, A. E., and, Kennard, R. W. 1970. Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12: 55-67.
21. Ishwaran, H., and, Zarepour, M. 2002. Exact and approximate sum representations for the dirichlet process. The Canadian Journal of Statistics, 30 (2): 269-283.
22. Kennedy, P. 1982. Eliminating problems caused by multicollinearity: A warning. Journal of Economic Education, 13: 62-64.
23. Kennedy, P. E. 1983. On an inappropriate means of reducing multicollinearity. Regional Science and Urban Economics, 13: 579-581.
24. Kim, S., Dahl, D. B., and, Vannucci, M. 2009. Spiked dirichlet process prior for bayesian multiple hypothesis testing in random effects models. Bayesian Analysis, 4 (4): 707-732.
25. MacLehose, R. F., Dunson, D. B., Herring, A. H., and, Hoppin, J. A. 2007. Bayesian methods for highly correlated exposure data. Epidemiology, 18: 199-2007.
26. McQuarrie, A. D.R., and, Tsai, C. 1998. Regression and Time Series Model Selection, World Scientific.
27. Neal, R. M. 2003. Density modeling and clustering using dirichlet diffusion trees. In Bayesian Statistics, Vol. 7, 619-629. Oxford University Press.
28. Nott, D. J. 2008. Predictive performance of dirichlet process shrinkage methods in linear regression. Computational Statistics & Data Analysis, 52 (7): 3658-3669.
29. Plummer, M., Best, N., Cowles, K., and, Vines, K. 2007. Coda: Output analysis and diagnostics for MCMC. R package, version 0.12-1
30. Segal, M. R., Dahlquist, K. D., and, Conklin, B. R. 2003. Regression approaches for microarray data analysis. Journal of Computational Biology, 10: 961-980. (Pubitemid 38156408)
31. Sturtz, S., Ligges, U., and, Gelman, A. 2005. R2winbugs: A package for running winbugs from R. Journal of Statistical Software, 12 (3): 1-16. (Pubitemid 40218003)
32. Theil, H. 1963. On the use of incomplete prior information in regression analysis. Journal of the American Statistical Association, 58: 401-414.
33. Theil, H., and, Goldberger, A. S. 1961. On pure and mixed statistical estimation in economics. International Economic Review, 2 (1): 65-78.
34. Thomas, A., O'Hara, B., Ligges, U., and, Sturtz, S. 2006. Making BUGS open. R News, 6: 12-17.
35. Tibshirani, R. 1996. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society, Series B, 58 (1): 267-288.
36. Vandaele, W. 1978. Participation in illegitimate activities: Ehrlich revisited. In Deterrence and Incapacitation, Edited by: Blumstein, A., Cohen, J. and Nagin, D. 270-335. National Academy of Sciences Press.
37. Venables, W. N., and, Ripley, B. D. 2002. Modern Applied Statistics with S, Springer.
38. West, M. 2003. Bayesian factor regression in the large p small n problem. In Bayesian Statistics, Vol. 7, 733-743. Oxford University Press.
39. Woods, H., Steinour, H. H., and, Starke, H. R. 1932. Effect of composition of portland cement on heat evolved during hardening. Industrial Engineering and Chemistry, 24: 1207-1214.
40. Zou, H., and, Hastie, T. 2005. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society, Series B, 67 (2): 301-320. (Pubitemid 40465877)