Ridge regression in prediction problems: Automatic choice of the ridge parameter

Genetic Epidemiology

Volumn 37, Issue 7, 2013, Pages 704-714

  Cule, Erika ^a,b   De Iorio, Maria ^c  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b GLAXOSMITHKLINE   (United Kingdom)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

GWAS; Penalised regression; Prediction; Shrinkage methods; Software

Indexed keywords

ALGORITHM; ARTICLE; COMPARATIVE STUDY; GENE LINKAGE DISEQUILIBRIUM; GENETIC ASSOCIATION; GENETIC RISK; GENETIC VARIABILITY; HUMAN; MULTIPLE REGRESSION; NONHUMAN; PHENOTYPE; RIDGE REGRESSION; RISK ASSESSMENT; SIMULATION; SINGLE NUCLEOTIDE POLYMORPHISM; STATISTICAL ANALYSIS;

GWAS; PENALISED REGRESSION; PREDICTION; SHRINKAGE METHODS; SOFTWARE;

ALGORITHMS; BIPOLAR DISORDER; GENETIC PREDISPOSITION TO DISEASE; GENETIC VARIATION; GENOTYPE; HUMANS; MODELS, GENETIC; PHENOTYPE; POLYMORPHISM, SINGLE NUCLEOTIDE; REGRESSION ANALYSIS; ROC CURVE; SOFTWARE;

EID: 84885833101     PISSN: 07410395     EISSN: 10982272     Source Type: Journal    
DOI: 10.1002/gepi.21750     Document Type: Article

References (43)

1. Abraham G, Kowalczyk A, Zobel J, Inouye M. 2013. Performance and robustness of penalized and unpenalized methods for genetic prediction of complex human disease. Genet Epidemiol 37:184-195.
2. Aguilera A, Escabias M, Valderrama M. 2006. Using principal components for estimating logistic regression with high-dimensional multicollinear data. Comput Stat Data Anal 50:1905-1924.
3. Alsabban S, Rivera M, McGuffin P. 2011. Genome-wide searches for bipolar disorder genes. Curr Psychiatr Rep 13:1-6.
4. Anderson J. 1972. Separate sample logistic discrimination. Biometrika 59:19-35.
5. Ayers K, Cordell H. 2010. Snp selection in genome-wide and candidate gene studies via penalized logistic regression. Genet Epidemiol 34:879-891.
6. Brier G. 1950. Verification of forecasts expressed in terms of probability. Monthly Weather Rev 78:1-3.
7. Brown PJ. 1993. Measurement, Regression and Calibration. Oxford Statistical Science Series, Oxford, UK: Clarendon Press.
8. Chadeau-Hyam M, Hoggart CJ, O'Reilly P, Whittaker J, Iorio MD, Balding DJ. 2008. Fregene: simulation of realistic sequence-level data in populations and ascertained samples. BMC Bioinformatics 9:364.
9. De Iorio M, Ebbels TMD, Stephens DA. 2008. Statistical Techniques in Metabolic Profiling, Handbook of Statistical Genetics. Chichester, UK: John Wiley & Sons, Ltd., chapter 11. p. 347-373.
10. de los Campos G, Hickey JM, Pong-Wong R, Daetwyler HD, Calus MPL. 2013. Whole genome regression and prediction methods applied to plant and animal breeding. Genetics 193:327-345.
11. Eichler EE, Flint J, Gibson G, Kong A, Leal SM, Moore JH, Nadeau JH. 2010. Missing heritability and strategies for finding the underlying causes of complex disease. Nat Rev Genet 11:446.
12. Eleftherohorinou H, Wright V, Hoggart C, Hartikainen A, Jarvelin M, Balding D, Coin L, Levin M. 2009. Pathway analysis of GWAS provides new insights into genetic susceptibility to 3 inflammatory diseases. PLOS ONE 4:e8068.
13. Frank I, Friedman J. 1993. A statistical view of some chemometrics regression tools. Technometrics 35:109-135.
14. Friedman J, Hastie T, Tibshirani R. 2010. Regularization paths for generalized linear models via coordinate descent. J Stat Software 33:1-22.
15. Genkin A, Lewis D, Madigan D. 2007. Large-scale Bayesian logistic regression for text categorization. Technometrics 49:291-304.
16. Goldstein D. 2005. The genetics of human drug response. Philosophical Trans Royal Soc B 360:1571-1572.
17. Greenland S. 2004. Model-based estimation of relative risks and other epidemiologic measures in studies of common outcomes and in case-control studies. Am J Epidemiol 160:301-305.
18. Hindorff LA, Sethupathy P, Junkins HA, Ramos EM, Mehta JP, Collins FS, Manolio TA. 2009. Potential etiologic and functional implications of genome-wide association loci for human diseases and traits. Proc Natl Acad Sci USA 106:9362-9367.
19. Hoerl AE, Kennard R. 1970. Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12:55-67.
20. Hoerl AE, Kennard RW, Baldwin KF. 1975. Ridge regression: some simulations. Comm Stat Theory Methods 4:105-123.
21. Hoggart CJ, Chadeau M, Clark T, Lampariello R, Iorio MD, Whittaker J, Balding DJ. 2007. Sequence-level population simulations over large genomic regions. Genetics 177:1725-1731.
22. Hoggart CJ, Whittaker J, Iorio MD, Balding DJ. 2008. Simultaneous analysis of all SNPs in genome-wide and re-sequencing association studies. PLOS Genet 4:e1000130.
23. Howie B, Donnelly P, Marchini J. 2009. A flexible and accurate genotype imputation method for the next generation of genome-wide association studies. PLOS Genet 5:e1000529.
24. Le Cessie S, Houwelingen JCV. 1992. Ridge estimators in logistic regression. J Roy Stat Soc Series C (Appl Stat) 41:191-201.
25. Makowsky R, Pajewski NM, Klimentidis YC, Vazquez AI, Duarte CW, Allison DB, de los Campos G. 2011. Beyond missing heritability: prediction of complex traits. PLOS Genet 7:e1002051.
26. Malo N, Libiger O, Schork NJ. 2008. Accommodating linkage disequilibrium in genetic-association analyses via ridge regression. Am J Hum Genet 82: 375-385.
27. Malovini A, Barbarini N, Bellazzi R, Michelis FD. 2012. Hierarchical naive bayes for genetic association studies. BMC Bioinformatics 13:S6.
28. Marchini J, Howie B, Myers S, McVean G, Donnelly P. 2007. A new multipoint method for genome-wide association studies by imputation of genotypes. Nat Genet 39:906-913.
29. McGuffin P, Rijsdijk F, Andrew M, Sham P, Katz R, Cardno A. 2003. The heritability of bipolar affective disorder and the genetic relationship to unipolar depression. Arch Gen Psychiatry 60:497.
30. Meuwissen T, Hayes B, Goddard M. 2001. Prediction of total genetic value using genome-wide dense marker maps. Genetics 157:1819.
31. Moser, G, Tier B, Crump R, Khatkar M, Raadsma H. 2009. A comparison of five methods to predict genomic breeding values of dairy bulls from genome-wide SNP markers. Genet Selection Evol 41:56.
32. Oh S, Lee J, Kwon MS, Weir B, Ha K, Park T. 2012. A novel method to identify high order gene-gene interactions in genome-wide association studies: gene-based MDR. BMC Bioinformatics 13:1-9.
33. Price A, Patterson N, Plenge R, Weinblatt M, Shadick N, Reich D. 2006. Principal components analysis corrects for stratification in genome-wide association studies. Nat Genet 38:904-909.
34. Purcell S, Neale B, Todd-Brown K, Thomas L, Ferreira M, Bender D, Maller J, Sklar P, Bakker PD, Daly M. 2007. Plink: a tool set for whole-genome association and population-based linkage analyses. Am J Hum Genet 81:559-575.
35. Rose S, van der Laan M. 2008. Simple optimal weighting of cases and controls in case-control studies. Int J Biostatistics 4:1-24.
36. Schaefer R, Roi L, Wolfe R. 1984. A ridge logistic estimator. Comm Stat Theory Methods 13:99-113.
37. Serretti A, Mandelli L. 2008. The genetics of bipolar disorder: genome 'hot regions, ' genes, new potential candidates and future directions. Mol Psychiatry 13:742.
38. Smith E, Bloss C, Badner J, Barrett T, Belmonte P, Berrettini W, Byerley W, Coryell W, Craig D, Edenberg H. 2009. Genome-wide association study of bipolar disorder in European American and African American individuals. Mol Psychiatry 14:755-763.
39. Tibshirani R. 1996. Regression shrinkage and selection via the lasso. J Royal Stat Soc B 58:267-288.
40. WTCCC, 2007. Genome-wide association study of 14, 000 cases of seven common diseases and 3, 000 shared controls. Nature 447:661-678.
41. Yang J, Benyamin B, Mcevoy BP, Gordon S, Henders AK, Nyholt DR, Madden PA, Heath AC, Martin NG, Montgomery GW, and others,. 2010. Common SNPs explain a large proportion of the heritability for human height. Nat Genet 42:565-569.
42. Zou H, Hastie T. 2005a. Addendum: regularization and variable selection via the elastic net. J Roy Stat Soc B 67:768.
43. Zou H, Hastie T. 2005b. Regularization and variable selection via the elastic net. J Roy Stat Soc B 67:301-320.