Estimating the predictive ability of genetic risk models in simulated data based on published results from genome-wide association studies

Frontiers in Genetics

Volumn 5, Issue JUN, 2014, Pages

  Kundu, Suman ^a   Mihaescu, Raluca ^a   Meijer, Catherina M C ^a   Bakker, Rachel ^a   Janssens, A Cecile J W ^a,b  

^a ERASMUS MEDICAL CENTER   (Netherlands)

^b EMORY UNIVERSITY   (United States)

Author keywords

AUC; Genetic; GWAS; Modeling; Predictive ability; Risk prediction

Indexed keywords

CELL CYCLE PROTEIN; CYCLIN DEPENDENT KINASE INHIBITOR 2A; CYCLIN DEPENDENT KINASE INHIBITOR 2B; INWARDLY RECTIFYING POTASSIUM CHANNEL SUBUNIT KIR6.2; PEROXISOME PROLIFERATOR ACTIVATED RECEPTOR GAMMA; TRANSCRIPTION FACTOR 7 LIKE 2;

AREA UNDER THE CURVE; ARTICLE; BAYES THEOREM; COLORECTAL CANCER; COMPUTER PROGRAM; CROHN DISEASE; DISEASE RISK; GENE FREQUENCY; GENETIC ASSOCIATION; GENETIC MODEL; GENETIC RISK; GENETIC VARIABILITY; GENOTYPE; HEALTH HAZARD; HEALTH STATUS; HUMAN; INSULIN DEPENDENT DIABETES MELLITUS; LOGISTIC REGRESSION ANALYSIS; META ANALYSIS (TOPIC); NON INSULIN DEPENDENT DIABETES MELLITUS; PREDICTIVE VALUE; PROSTATE CANCER; PUBLICATION; RECEIVER OPERATING CHARACTERISTIC; RETINA MACULA AGE RELATED DEGENERATION; SENSITIVITY AND SPECIFICITY; SIMULATION; SINGLE NUCLEOTIDE POLYMORPHISM;

EID: 84906234346     PISSN: None     EISSN: 16648021     Source Type: Journal    
DOI: 10.3389/fgene.2014.00179     Document Type: Article

References (56)

1. 1000 Genomes Project Consortium. (2012). An integrated map of genetic variation from 1,092 human genomes. Nature 491, 56-65. doi: 10.1038/nature11632
2. Aly, M., Wiklund, F., Xu, J., Isaacs, W. B., Eklund, M., D'Amato, M., et al. (2011). Polygenic risk score improves prostate cancer risk prediction: results from the Stockholm-1 cohort study. Eur. Urol . 60, 21-28. doi: 10.1016/j.eururo.2011.01.017
3. Cook, N. R. (2007). Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation 115, 928-935. doi: 10.1161/circulationaha.106.672402
4. Dabelea, D., Mayer-Davis, E. J., Saydah, S., Imperatore, G., Linder, B., Divers, J., et al. (2014). Prevalence of type 1 and type 2 diabetes among children and adolescents from 2001 to 2009. JAMA 311, 1778-1786. doi: 10.1001/jama.2014.3201
5. Dunlop, M. G., Tenesa, A., Farrington, S. M., Ballereau, S., Brewster, D. H., Koessler, T., et al. (2013). Cumulative impact of common genetic variants and other risk factors on colorectal cancer risk in 42,103 individuals. Gut 62, 871-881. doi: 10.1136/gutjnl-2011-300537
6. Fontaine-Bisson, B., Renstrom, F., Rolandsson, O., MAGIC, Payne, F., Hallmans, G., et al. (2010). Evaluating the discriminative power of multi-trait genetic risk scores for type 2 diabetes in a northern Swedish population. Diabetologia 53, 2155-2162. doi: 10.1007/s00125-010-1792-y
7. Forberg, J. L., Green, M., Bjork, J., Ohlsson, M., Edenbrandt, L., Ohlin, H., et al. (2009). In search of the best method to predict acute coronary syndrome using only the electrocardiogram from the emergency department. J. Electrocardiol . 42, 58-63. doi: 10.1016/j.jelectrocard.2008.07.010
8. Gail, M. H. (2008). Discriminatory accuracy from single-nucleotide polymorphisms in models to predict breast cancer risk. J. Natl. Cancer Inst . 100, 1037-1041. doi: 10.1093/jnci/djn180
9. Grassmann, F., Fritsche, L. G., Keilhauer, C. N., Heid, I. M., and Weber, B. H. (2012). Modelling the genetic risk in age-related macular degeneration. PLoS ONE 7:e37979. doi: 10.1371/journal.pone.0037979
10. Gulkesen, K. H., Koksal, I. T., Bilge, U., and Saka, O. (2010). Comparison of methods for prediction of prostate cancer in Turkish men with PSA levels of 0-10 ng/mL. J. BUON 15, 537-542.
11. Hanley, J. A., and McNeil, B. J. (1982). The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143, 29-36. doi: 10.1148/radiology.143.1.7063747
12. Hecker, L. A., Edwards, A. O., Ryu, E., Tosakulwong, N., Baratz, K. H., Brown, W. L., et al. (2010). Genetic control of the alternative pathway of complement in humans and age-related macular degeneration. Hum. Mol. Genet . 19, 209-215. doi: 10.1093/hmg/ddp472
13. Helfand, B. T., Fought, A. J., Loeb, S., Meeks, J. J., Kan, D., and Catalona, W. J. (2010). Genetic prostate cancer risk assessment: common variants in 9 genomic regions are associated with cumulative risk. J. Urol . 184, 501-505. doi: 10.1016/j.juro.2010.04.032
14. Howlader, N., Noone, A. M., Krapcho, M., Garshell, J., Neyman, N., Altekruse, S. F., et al. (2012). SEER Cancer Statistics Review, 1975-2010 , Bethesda, MD: National Cancer Institute. Available online at: http://seer.cancer.gov/csr/1975_2010/
15. Hu, C., Zhang, R., Wang, C., Wang, J., Ma, X., Lu, J., et al. (2009). PPARG, KCNJ11, CDKAL1, CDKN2A-CDKN2B, IDE-KIF11-HHEX, IGF2BP2 and SLC30A8 are associated with type 2 diabetes in a Chinese population. PLoS ONE 4:e7643. doi: 10.1371/journal.pone.0007643
16. Husing, A., Canzian, F., Beckmann, L., Garcia-Closas, M., Diver, W. R., Thun, M. J., et al. (2012). Prediction of breast cancer risk by genetic risk factors, overall and by hormone receptor status. J. Med. Genet . 49, 601-608. doi: 10.1136/jmedgenet-2011-100716
17. Janssens, A. C., Aulchenko, Y. S., Elefante, S., Borsboom, G. J., Steyerberg, E. W., and Van Duijn, C. M. (2006). Predictive testing for complex diseases using multiple genes: fact or fiction? Genet. Med . 8, 395-400. doi: 10.1097/01.gim.0000229689.18263.f4
18. Janssens, A. C., and Van Duijn, C. M. (2009). Genome-based prediction of common diseases: methodological considerations for future research. Genome Med . 1:20. doi: 10.1186/gm20
19. Johansson, M., Holmstrom, B., Hinchliffe, S. R., Bergh, A., Stenman, U. H., Hallmans, G., et al. (2012). Combining 33 genetic variants with prostate-specific antigen for prediction of prostate cancer: longitudinal study. Int. J. Cancer 130, 129-137. doi: 10.1002/ijc.25986
20. Kader, A. K., Sun, J., Reck, B. H., Newcombe, P. J., Kim, S. T., Hsu, F. C., et al. (2012). Potential impact of adding genetic markers to clinical parameters in predicting prostate biopsy outcomes in men following an initial negative biopsy: findings from the REDUCE trial. Eur. Urol . 62, 953-961. doi: 10.1016/j.eururo.2012.05.006
21. Kalf, R. R., Mihaescu, R., Kundu, S., De Knijff, P., Green, R. C., and Janssens, A. C. (2014). Variations in predicted risks in personal genome testing for common complex diseases. Genet. Med . 16, 85-91. doi: 10.1038/gim.2013.80
22. Kappelman, M. D., Rifas-Shiman, S. L., Kleinman, K., Ollendorf, D., Bousvaros, A., Grand, R. J., et al. (2007). The prevalence and geographic distribution of Crohn's disease and ulcerative colitis in the United States. Clin. Gastroenterol. Hepatol . 5, 1424-1429. doi: 10.1016/j.cgh.2007.07.012
23. Kim, S., Kim, W., and Park, R. W. (2011). A comparison of intensive care unit mortality prediction models through the use of data mining techniques. Healthc. Inform. Res . 17, 232-243. doi: 10.4258/hir.2011.17.4.232
24. Klein, R., Chou, C. F., Klein, B. E., Zhang, X., Meuer, S. M., and Saaddine, J. B. (2011). Prevalence of age-related macular degeneration in the US population. Arch. Ophthalmol . 129, 75-80. doi: 10.1001/archophthalmol.2010.318
25. Kundu, S., Aulchenko, Y. S., Van Duijn, C. M., and Janssens, A. C. (2011). PredictABEL: an R package for the assessment of risk prediction models. Eur. J. Epidemiol . 26, 261-264. doi: 10.1007/s10654-011-9567-4
26. Kundu, S., Karssen, L. C., and Janssens, A. C. (2012). Analytical and simulation methods for estimating the potential predictive ability of genetic profiling: a comparison of methods and results. Eur. J. Hum. Genet . 20, 1270-1274. doi: 10.1038/ejhg.2012.89
27. Lango, H., Consortium, U. K. T. D. G., Palmer, C. N., Morris, A. D., Zeggini, E., Hattersley, A. T., et al. (2008). Assessing the combined impact of 18 common genetic variants of modest effect sizes on type 2 diabetes risk. Diabetes 57, 3129-3135. doi: 10.2337/db08-0504
28. Lee, H. J., Hwang, S. I., Han, S. M., Park, S. H., Kim, S. H., Cho, J. Y., et al. (2010). Image-based clinical decision support for transrectal ultrasound in the diagnosis of prostate cancer: comparison of multiple logistic regression, artificial neural network, and support vector machine. Eur. Radiol . 20, 1476-1484. doi: 10.1007/s00330-009-1686-x
29. Lin, X., Song, K., Lim, N., Yuan, X., Johnson, T., Abderrahmani, A., et al. (2009). Risk prediction of prevalent diabetes in a Swiss population using a weighted genetic score-the CoLaus Study. Diabetologia 52, 600-608. doi: 10.1007/s00125-008-1254-y
30. Lu, Q., and Elston, R. C. (2008). Using the optimal receiver operating characteristic curve to design a predictive genetic test, exemplified with type 2 diabetes. Am. J. Hum. Genet . 82, 641-651. doi: 10.1016/j.ajhg.2007.12.025
31. Lubbe, S. J., Di Bernardo, M. C., Broderick, P., Chandler, I., and Houlston, R. S. (2012). Comprehensive evaluation of the impact of 14 genetic variants on colorectal cancer phenotype and risk. Am. J. Epidemiol . 175, 1-10. doi: 10.1093/aje/kwr285
32. Maller, J., George, S., Purcell, S., Fagerness, J., Altshuler, D., Daly, M. J., et al. (2006). Common variation in three genes, including a noncoding variant in CFH, strongly influences risk of age-related macular degeneration. Nat. Genet . 38, 1055-1059. doi: 10.1038/ng1873
33. Meigs, J. B., Shrader, P., Sullivan, L. M., McAteer, J. B., Fox, C. S., Dupuis, J., et al. (2008). Genotype score in addition to common risk factors for prediction of type 2 diabetes. N. Engl. J. Med . 359, 2208-2219. doi: 10.1056/NEJMoa0804742
34. Mihaescu, R., Pencina, M. J., Alonso, A., Lunetta, K. L., Heckbert, S. R., Benjamin, E. J., et al. (2013). Incremental value of rare genetic variants for the prediction of multifactorial diseases. Genome Med . 5:76. doi: 10.1186/gm480
35. Miyake, K., Yang, W., Hara, K., Yasuda, K., Horikawa, Y., Osawa, H., et al. (2009). Construction of a prediction model for type 2 diabetes mellitus in the Japanese population based on 11 genes with strong evidence of the association. J. Hum. Genet . 54, 236-241. doi: 10.1038/jhg.2009.17
36. Moonesinghe, R., Khoury, M. J., Liu, T., and Janssens, A. C. (2011). Discriminative accuracy of genomic profiling comparing multiplicative and additive risk models. Eur. J. Hum. Genet . 19, 180-185. doi: 10.1038/ejhg.2010.165
37. Moonesinghe, R., Liu, T., and Khoury, M. J. (2010). Evaluation of the discriminative accuracy of genomic profiling in the prediction of common complex diseases. Eur. J. Hum. Genet . 18, 485-489. doi: 10.1038/ejhg.2009.209
38. Muniz, A. M., Liu, H., Lyons, K. E., Pahwa, R., Liu, W., Nobre, F. F., et al. (2010). Comparison among probabilistic neural network, support vector machine and logistic regression for evaluating the effect of subthalamic stimulation in Parkinson disease on ground reaction force during gait. J. Biomech . 43, 720-726. doi: 10.1016/j.jbiomech.2009.10.018
39. Pepe, M. S., Gu, J. W., and Morris, D. E. (2010). The potential of genes and other markers to inform about risk. Cancer Epidemiol. Biomarkers Prev . 19, 655-665. doi: 10.1158/1055-9965.EPI-09-0510
40. Peter, I., Mitchell, A. A., Ozelius, L., Erazo, M., Hu, J., Doheny, D., et al. (2011). Evaluation of 22 genetic variants with Crohn's disease risk in the Ashkenazi Jewish population: a case-control study. BMC Med. Genet . 12:63. doi: 10.1186/1471-2350-12-63
41. Qi, Q., Li, H., Wu, Y., Liu, C., Wu, H., Yu, Z., et al. (2010). Combined effects of 17 common genetic variants on type 2 diabetes risk in a Han Chinese population. Diabetologia 53, 2163-2166. doi: 10.1007/s00125-010-1826-5
42. Romanos, J., Van Diemen, C. C., Nolte, I. M., Trynka, G., Zhernakova, A., Fu, J., et al. (2009). Analysis of HLA and non-HLA alleles can identify individuals at high risk for celiac disease. Gastroenterology 137, 834-840. doi: 10.1053/j.gastro.2009.05.040
43. Scholl, H. P., Charbel Issa, P., Walier, M., Janzer, S., Pollok-Kopp, B., Borncke, F., et al. (2008). Systemic complement activation in age-related macular degeneration. PLoS ONE 3:e2593. doi: 10.1371/journal.pone.0002593
44. Sparso, T., Grarup, N., Andreasen, C., Albrechtsen, A., Holmkvist, J., Andersen, G., et al. (2009). Combined analysis of 19 common validated type 2 diabetes susceptibility gene variants shows moderate discriminative value and no evidence of gene-gene interaction. Diabetologia 52, 1308-1314. doi: 10.1007/s00125-009-1362-3
45. Sun, J., Kader, A. K., Hsu, F. C., Kim, S. T., Zhu, Y., Turner, A. R., et al. (2011). Inherited genetic markers discovered to date are able to identify a significant number of men at considerably elevated risk for prostate cancer. Prostate 71, 421-430. doi: 10.1002/pros.21256
46. Talmud, P. J., Hingorani, A. D., Cooper, J. A., Marmot, M. G., Brunner, E. J., Kumari, M., et al. (2010). Utility of genetic and non-genetic risk factors in prediction of type 2 diabetes: whitehall II prospective cohort study. BMJ 340, b4838. doi: 10.1136/bmj.b4838
47. Van Der Ploeg, T., Smits, M., Dippel, D. W., Hunink, M., and Steyerberg, E. W. (2011). Prediction of intracranial findings on CT-scans by alternative modelling techniques. BMC Med. Res. Methodol . 11:143. doi: 10.1186/1471-2288-11-143
48. Van Hoek, M., Dehghan, A., Witteman, J. C., Van Duijn, C. M., Uitterlinden, A. G., Oostra, B. A., et al. (2008). Predicting type 2 diabetes based on polymorphisms from genome-wide association studies: a population-based study. Diabetes 57, 3122-3128. doi: 10.2337/db08-0425
49. Vaxillaire, M., Veslot, J., Dina, C., Proenca, C., Cauchi, S., Charpentier, G., et al. (2008). Impact of common type 2 diabetes risk polymorphisms in the DESIR prospective study. Diabetes 57, 244-254. doi: 10.2337/db07-0615
50. Wang, J., Stancakova, A., Kuusisto, J., and Laakso, M. (2010). Identification of undiagnosed type 2 diabetic individuals by the finnish diabetes risk score and biochemical and genetic markers: a population-based study of 7232 Finnish men. J. Clin. Endocrinol. Metab . 95, 3858-3862. doi: 10.1210/jc.2010-0012
51. Weedon, M. N., McCarthy, M. I., Hitman, G., Walker, M., Groves, C. J., Zeggini, E., et al. (2006). Combining information from common type 2 diabetes risk polymorphisms improves disease prediction. PLoS Med . 3:e374. doi: 10.1371/journal.pmed.0030374
52. Willems, S. M., Mihaescu, R., Sijbrands, E. J., Van Duijn, C. M., and Janssens, A. C. (2011). A methodological perspective on genetic risk prediction studies in type 2 diabetes: recommendations for future research. Curr. Diab. Rep . 11, 511-518. doi: 10.1007/s11892-011-0235-6
53. Wu, C., Walsh, K. M., Dewan, A. T., Hoh, J., and Wang, Z. (2011). Disease risk prediction with rare and common variants. BMC Proc . 5(Suppl. 9):S61. doi: 10.1186/1753-6561-5-S9-S61
54. Wu, J., Pfeiffer, R. M., and Gail, M. H. (2013). Strategies for developing prediction models from genome-wide association studies. Genet. Epidemiol . 37, 768-777. doi: 10.1002/gepi.21762
55. Wu, J., Roy, J., and Stewart, W. F. (2010). Prediction modeling using EHR data: challenges, strategies, and a comparison of machine learning approaches. Med. Care 48, S106-S113. doi: 10.1097/MLR.0b013e3181de9e17
56. Yamashita, H., Awata, T., Kawasaki, E., Ikegami, H., Tanaka, S., Maruyama, T., et al. (2011). Analysis of the HLA and non-HLA susceptibility loci in Japanese type 1 diabetes. Diabetes Metab. Res. Rev . 27, 844-848. doi: 10.1002/dmrr.1234