A metabolome-wide association study of kidney function and disease in the general population

Journal of the American Society of Nephrology

Volumn 27, Issue 4, 2016, Pages 1175-1188

  Sekula, Peggy ^a   Goek, Oemer Necmi ^a   Quaye, Lydia ^b   Barrios, Clara ^b,c   Levey, Andrew S ^d   Römisch Margl, Werner ^e   Menni, Cristina ^b   Yet, Idil ^b   Gieger, Christian ^e   Adamski, Jerzy ^e,f,g   Gronwald, Wolfram ^h   Illig, Thomas ^e,i   Dettmer, Katja ^h   Krumsiek, Jan ^e   Oefner, Peter J ^h   Valdes, Ana M ^j   Meisinger, Christa ^e   Coresh, Josef ^k   Spector, Tim D ^b   Mohney, Robert P ^l   Suhre, Karsten ^e,m   Kastenmüller, Gabi ^b,e,f   Köttgen, Anna ^a   more..

^a UNIVERSITY OF FREIBURG   (Germany)

^b KING'S COLLEGE LONDON   (United Kingdom)

^c HOSPITAL DEL MAR   (Spain)

^d TUFTS MEDICAL CENTER   (United States)

^e INSTITUTE OF EPIDEMIOLOGY   (Germany)

^f GERMAN CENTER FOR DIABETES RESEARCH DZD   (Germany)

^g TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^h UNIVERSITY OF REGENSBURG   (Germany)

ⁱ HANNOVER MEDICAL SCHOOL   (Germany)

^j UNIVERSITY OF NOTTINGHAM   (United Kingdom)

^k JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

^l METABOLON INC   (United States)

^m WEILL CORNELL MEDICAL COLLEGE   (Qatar)

more..

Author keywords

[No Author keywords available]

Indexed keywords

ALANINE DERIVATIVE; C MANNOSYLTRYPTOPHAN; CARNOSINE; CREATININE; CYSTATIN C; INOSITOL; N ACETYLALANINE; N ACETYLCARNOSINE; PSEUDOURIDINE; TRYPTOPHAN DERIVATIVE; TYROSINE DERIVATIVE; UNCLASSIFIED DRUG;

ADULT; ARTICLE; CHRONIC KIDNEY FAILURE; CREATININE BLOOD LEVEL; CROSS-SECTIONAL STUDY; FEMALE; GAS LIQUID CHROMATOGRAPHY; GLOMERULUS FILTRATION RATE; HUMAN; KIDNEY DISEASE; KIDNEY FUNCTION; MAJOR CLINICAL STUDY; MALE; MASS SPECTROMETRY; METABOLOMICS; POPULATION; PRIORITY JOURNAL; SERUM; GENETICS; GENOME-WIDE ASSOCIATION STUDY; METABOLISM; METABOLOME; MIDDLE AGED; PATHOPHYSIOLOGY;

CROSS-SECTIONAL STUDIES; FEMALE; GENOME-WIDE ASSOCIATION STUDY; GLOMERULAR FILTRATION RATE; HUMANS; MALE; METABOLOME; MIDDLE AGED; RENAL INSUFFICIENCY, CHRONIC;

EID: 85017080584     PISSN: 10466673     EISSN: 15333450     Source Type: Journal    
DOI: 10.1681/ASN.2014111099     Document Type: Article

References (59)

1. Eckardt KU, Coresh J, Devuyst O, Johnson RJ, Köttgen A, Levey AS, Levin A: Evolving importance of kidney disease: From subspecialty to global health burden. Lancet 382: 158–169, 2013
2. Gansevoort RT, Correa-Rotter R, Hemmelgarn BR, Jafar TH, Heerspink HJ, Mann JF, Matsushita K, Wen CP: Chronic kidney disease and cardiovascular risk: Epidemiology, mechanisms, and prevention. Lancet 382: 339–352, 2013
3. Stevens LA, Coresh J, Greene T, Levey AS: Assessing kidney function–measured and estimated glomerular filtration rate. N Engl J Med 354: 2473–2483, 2006
4. Inker LA, Schmid CH, Tighiouart H, Eckfeldt JH, Feldman HI, Greene T, Kusek JW, Manzi J, Van Lente F, Zhang YL, Coresh J, Levey AS; CKD-EPI Investigators: Estimating glomerular filtration rate from serum creatinine and cystatin C. N Engl J Med 367: 20–29, 2012
5. Shlipak MG, Matsushita K, Ärnlöv J, Inker LA, Katz R, Polkinghorne KR, Rothenbacher D, Sarnak MJ, Astor BC, Coresh J, Levey AS, Gansevoort RT; CKD Prognosis Consortium: Cystatin C versus creatinine in determining risk based on kidney function. N Engl J Med 369: 932–943, 2013
6. Goek ON, Döring A, Gieger C, Heier M, Koenig W, Prehn C, Römisch-Margl W, Wang-Sattler R, Illig T, Suhre K, Sekula P, Zhai G, Adamski J, Köttgen A, Meisinger C: Serum metabolite concentrations and decreased GFR in the general population. Am J Kidney Dis 60: 197–206, 2012
7. Goek ON, Prehn C, Sekula P, Römisch-Margl W, Döring A, Gieger C, Heier M, Koenig W, Wang-Sattler R, Illig T, Suhre K, Adamski J, Köttgen A, Meisinger C: Metabolites associate with kidney function decline and incident chronic kidney disease in the general population. Nephrol Dial Transplant 28: 2131–2138, 2013
8. Rhee EP, Clish CB, Ghorbani A, Larson MG, Elmariah S, McCabe E, Yang Q, Cheng S, Pierce K, Deik A, Souza AL, Farrell L, Domos C, Yeh RW, Palacios I, Rosenfield K, Vasan RS, Florez JC, Wang TJ, Fox CS, Gerszten RE: A combined epidemiologic and metabolomic approach improves CKD prediction. J Am Soc Nephrol 24: 1330–1338, 2013
9. Niewczas MA, Sirich TL, Mathew AV, Skupien J, Mohney RP, Warram JH, Smiles A, Huang X, Walker W, Byun J, Karoly ED, Kensicki EM, Berry GT, Bonventre JV, Pennathur S, Meyer TW, Krolewski AS: Uremic solutes and risk of end-stage renal disease in type 2 diabetes: Metabolomic study. Kidney Int 85: 1214–1224, 2014
10. Yu B, Zheng Y, Nettleton JA, Alexander D, Coresh J, Boerwinkle E: Serum metabolomic profiling and incident CKD among African Americans. Clin J Am Soc Nephrol 9: 1410–1417, 2014
11. Petersen AK, Krumsiek J, Wägele B, Theis FJ, Wichmann HE, Gieger C, Suhre K: On the hypothesis-free testing of metabolite ratios in genomewide and metabolome-wide association studies. BMC Bioinformatics 13: 120, 2012
12. Krumsiek J, Suhre K, Evans AM, Mitchell MW, Mohney RP, Milburn MV, Wägele B, Römisch-Margl W, Illig T, Adamski J, Gieger C, Theis FJ, Kastenmüller G: Mining the unknown: A systems approach to metabolite identification combining genetic and metabolic information. PLoS Genet 8: e1003005, 2012
13. Rutkowski P, Słominska EM, Szołkiewicz M, Aleksandrowicz E, Smolenski RT, Wołyniec W, Renke M, Wisterowicz K, Swierczynski J, Rutkowski B: Relationship between uremic toxins and oxidative stress in patients with chronic renal failure. Scand J Urol Nephrol 41: 243–248, 2007
14. Shin SY, Fauman EB, Petersen AK, Krumsiek J, Santos R, Huang J, Arnold M, Erte I, Forgetta V, Yang TP, Walter K, Menni C, Chen L, Vasquez L, Valdes AM, Hyde CL, Wang V, Ziemek D, Roberts P, Xi L, Grundberg E, Waldenberger M, Richards JB, Mohney RP, Milburn MV, John SL, Trimmer J, Theis FJ, Overington JP, Suhre K, Brosnan MJ, Gieger C, Kastenmüller G, Spector TD, Soranzo N; Multiple Tissue Human Expression Resource (MuTHER) Consortium: An atlas of genetic influences on human blood metabolites. Nat Genet 46: 543–550, 2014
15. Köttgen A, Pattaro C, Böger CA, Fuchsberger C, Olden M, Glazer NL, Parsa A, Gao X, Yang Q, Smith AV, O’Connell JR, Li M, Schmidt H, Tanaka T, Isaacs A, Ketkar S, Hwang SJ, Johnson AD, Dehghan A, Teumer A, Paré G, Atkinson EJ, Zeller T, Lohman K, Cornelis MC, Probst-Hensch NM, Kronenberg F, Tönjes A, Hayward C, Aspelund T, Eiriksdottir G, Launer LJ, Harris TB, Rampersaud E, Mitchell BD, Arking DE, Boerwinkle E, Struchalin M, Cavalieri M, Singleton A, Giallauria F, Metter J, de Boer IH, Haritunians T, Lumley T, Siscovick D, Psaty BM, Zillikens MC, Oostra BA, Feitosa M, Province M, de Andrade M, Turner ST, Schillert A, Ziegler A, Wild PS, Schnabel RB, Wilde S, Munzel TF, Leak TS, Illig T, Klopp N, Meisinger C, Wichmann HE, Koenig W, Zgaga L, Zemunik T, Kolcic I, Minelli C, Hu FB, Johansson A, Igl W, Zaboli G, Wild SH, Wright AF, Campbell H, Ellinghaus D, Schreiber S, Aulchenko YS, Felix JF, Rivadeneira F, Uitterlinden AG, Hofman A, Imboden M, Nitsch D, Brandstätter A, Kollerits B, Kedenko L, Mägi R, Stumvoll M, Kovacs P, Boban M, Campbell S, Endlich K, Völzke H, Kroemer HK, Nauck M, Völker U, Polasek O, Vitart V, Badola S, Parker AN, Ridker PM, Kardia SL, Blankenberg S, Liu Y, Curhan GC, Franke A, Rochat T, Paulweber B, Prokopenko I, Wang W, Gudnason V, Shuldiner AR, Coresh J, Schmidt R, Ferrucci L, Shlipak MG, van Duijn CM, Borecki I, Krämer BK, Rudan I, Gyllensten U, Wilson JF, Witteman JC, Pramstaller PP, Rettig R, Hastie N, Chasman DI, Kao WH, Heid IM, Fox CS: New loci associated with kidney function and chronic kidney disease. Nat Genet 42: 376–384, 2010
16. Pattaro C, Köttgen A, Teumer A, Garnaas M, Böger CA, Fuchsberger C, Olden M, Chen MH, Tin A, Taliun D, Li M, Gao X, Gorski M, Yang Q, Hundertmark C, Foster MC, O’Seaghdha CM, Glazer N, Isaacs A, Liu CT, Smith AV, O’Connell JR, Struchalin M, Tanaka T, Li G, Johnson AD, Gierman HJ, Feitosa M, Hwang SJ, Atkinson EJ, Lohman K, Cornelis MC, Johansson Å, Tönjes A, Dehghan A, Chouraki V, Holliday EG, Sorice R, Kutalik Z, Lehtimäki T, Esko T, Deshmukh H, Ulivi S, Chu AY, Murgia F, Trompet S, Imboden M, Kollerits B, Pistis G, Harris TB, Launer LJ, Aspelund T, Eiriksdottir G, Mitchell BD, Boerwinkle E, Schmidt H, Cavalieri M, Rao M, Hu FB, Demirkan A, Oostra BA, de Andrade M, Turner ST, Ding J, Andrews JS, Freedman BI, Koenig W, Illig T, Döring A, Wichmann HE, Kolcic I, Zemunik T, Boban M, Minelli C, Wheeler HE, Igl W, Zaboli G, Wild SH, Wright AF, Campbell H, Ellinghaus D, Nöthlings U, Jacobs G, Biffar R, Endlich K, Ernst F, Homuth G, Kroemer HK, Nauck M, Stracke S, Völker U, Völzke H, Kovacs P, Stumvoll M, Mägi R, Hofman A, Uitterlinden AG, Rivadeneira F, Aulchenko YS, Polasek O, Hastie N, Vitart V, Helmer C, Wang JJ, Ruggiero D, Bergmann S, Kähönen M, Viikari J, Nikopensius T, Province M, Ketkar S, Colhoun H, Doney A, Robino A, Giulianini F, Krämer BK, Portas L, Ford I, Buckley BM, Adam M, Thun GA, Paulweber B, Haun M, Sala C, Metzger M, Mitchell P, Ciullo M, Kim SK, Vollenweider P, Raitakari O, Metspalu A, Palmer C, Gasparini P, Pirastu M, Jukema JW, Probst-Hensch NM, Kronenberg F, Toniolo D, Gudnason V, Shuldiner AR, Coresh J, Schmidt R, Ferrucci L, Siscovick DS, van Duijn CM, Borecki I, Kardia SL, Liu Y, Curhan GC, Rudan I, Gyllensten U, Wilson JF, Franke A, Pramstaller PP, Rettig R, Prokopenko I, Witteman JC, Hayward C, Ridker P, Parsa A, Bochud M, Heid IM, Goessling W, Chasman DI, Kao WH, Fox CS; CARDIoGRAM Consortium; ICBP Consortium; CARe Consortium; Wellcome Trust Case Control Consortium 2 (WTCCC2): Genome-wide association and functional follow-up reveals new loci for kidney function. PLoS Genet 8: e1002584, 2012
17. Lu J, Zhou J, Bao Y, Chen T, Zhang Y, Zhao A, Qiu Y, Xie G, Wang C, Jia W, Jia W: Serum metabolic signatures of fulminant type 1 diabetes. J Proteome Res 11: 4705–4711, 2012
18. Gillery P, Jaisson S: Post-translational modification derived products (PTMDPs): Toxins in chronic diseases? Clin Chem Lab Med 52: 33–38, 2014
19. D’Agati V, Schmidt AM: RAGE and the pathogenesis of chronic kidney disease. Nat Rev Nephrol 6: 352–360, 2010
20. Furmanek A, Hofsteenge J: Protein C-mannosylation: Facts and questions. Acta Biochim Pol 47: 781–789, 2000
21. Doucey MA, Hess D, Cacan R, Hofsteenge J: Protein C-mannosylation is enzyme-catalysed and uses dolichyl-phosphate-mannose as a precursor. Mol Biol Cell 9: 291–300, 1998
22. Gutsche B, Grun C, Scheutzow D, Herderich M: Tryptophan glyco-conjugates in food and human urine. Biochem J 343: 11–19, 1999
23. Takahira R, Yonemura K, Yonekawa O, Iwahara K, Kanno T, Fujise Y, Hishida A: Tryptophan glycoconjugate as a novel marker of renal function. Am J Med 110: 192–197, 2001
24. Yonemura K, Takahira R, Yonekawa O, Wada N, Hishida A: The diagnostic value of serum concentrations of 2-(alpha-mannopyranosyl)-L-tryptophan for normal renal function. Kidney Int 65: 1395–1399, 2004
25. Asatoor AM: Retention of pseudouridine and 4-amino-5-imidazole carboxamide in uraemia. Clin Chim Acta 20: 407–411, 1968
26. Schoots AC, Gerlag PG, Mulder AW, Peeters JA, Cramers CA: Liquid-chromatographic profiling of solutes in serum of uremic patients undergoing hemodialysis and chronic ambulatory peritoneal dialysis (CAPD); high concentrations of pseudouridine in CAPD patients. Clin Chem 34: 91–97, 1988
27. Niwa T, Takeda N, Yoshizumi H: RNA metabolism in uremic patients: Accumulation of modified ribonucleosides in uremic serum. Technical note. Kidney Int 53: 1801–1806, 1998
28. Dzúrik R, Lajdová I, Spustová V, Opatrný K Jr: Pseudouridine excretion in healthy subjects and its accumulation in renal failure. Nephron 61: 64–67, 1992
29. Schleicher ED, Wagner E, Nerlich AG: Increased accumulation of the glycoxidation product N(epsilon)-(carboxymethyl)lysine in human tissues in diabetes and aging. J Clin Invest 99: 457–468, 1997
30. Engelke UF, Zijlstra FS, Mochel F, Valayannopoulos V, Rabier D, Kluijtmans LA, Perl A, Verhoeven-Duif NM, de Lonlay P, Wamelink MM, Jakobs C, Morava E, Wevers RA: Mitochondrial involvement and er-ythronic acid as a novel biomarker in transaldolase deficiency. Biochim Biophys Acta 1802: 1028–1035, 2010
31. Loeffen YG, Biebuyck N, Wamelink MM, Jakobs C, Mulder MF, Tylki-Szymanska A, Fung CW, Valayannopoulos V, Bökenkamp A: Nephro-logical abnormalities in patients with transaldolase deficiency. Nephrol Dial Transplant 27: 3224–3227, 2012
32. Karve TM, Cheema AK: Small changes huge impact: The role of protein posttranslational modifications in cellular homeostasis and disease. J Amino Acids 2011: 207691, 2011
33. Chambers JC, Zhang W, Lord GM, van der Harst P, Lawlor DA, Sehmi JS, Gale DP, Wass MN, Ahmadi KR, Bakker SJ, Beckmann J, Bilo HJ, Bochud M, Brown MJ, Caulfield MJ, Connell JM, Cook HT, Cotlarciuc I, Davey Smith G, de Silva R, Deng G, Devuyst O, Dikkeschei LD, Dimkovic N, Dockrell M, Dominiczak A, Ebrahim S, Eggermann T, Farrall M, Ferrucci L, Floege J, Forouhi NG, Gansevoort RT, Han X, Hedblad B, Homan van der Heide JJ, Hepkema BG, Hernandez-Fuentes M, Hypponen E, Johnson T, de Jong PE, Kleefstra N, Lagou V, Lapsley M, Li Y, Loos RJ, Luan J, Luttropp K, Maréchal C, Melander O, Munroe PB, Nordfors L, Parsa A, Peltonen L, Penninx BW, Perucha E, Pouta A, Prokopenko I, Roderick PJ, Ruokonen A, Samani NJ, Sanna S, Schalling M, Schlessinger D, Schlieper G, Seelen MA, Shuldiner AR, Sjögren M, Smit JH, Snieder H, Soranzo N, Spector TD, Stenvinkel P, Sternberg MJ, Swaminathan R, Tanaka T, Ubink-Veltmaat LJ, Uda M, Vollenweider P, Wallace C, Waterworth D, Zerres K, Waeber G, Wareham NJ, Maxwell PH, McCarthy MI, Jarvelin MR, Mooser V, Abecasis GR, Lightstone L, Scott J, Navis G, Elliott P, Kooner JS: Genetic loci influencing kidney function and chronic kidney disease. Nat Genet 42: 373–375, 2010
34. Suhre K, Wallaschofski H, Raffler J, Friedrich N, Haring R, Michael K, Wasner C, Krebs A, Kronenberg F, Chang D, Meisinger C, Wichmann HE, Hoffmann W, Völzke H, Völker U, Teumer A, Biffar R, Kocher T, Felix SB, Illig T, Kroemer HK, Gieger C, Römisch-Margl W, Nauck M: A genome-wide association study of metabolic traits in human urine. Nat Genet 43: 565–569, 2011
35. Yu B, Zheng Y, Alexander D, Morrison AC, Coresh J, Boerwinkle E: Genetic determinants influencing human serum metabolome among African Americans. PLoS Genet 10: e1004212, 2014
36. Croze ML, Soulage CO: Potential role and therapeutic interests of myo-inositol in metabolic diseases. Biochimie 95: 1811–1827, 2013
37. Hoffhines AJ, Damoc E, Bridges KG, Leary JA, Moore KL: Detection and purification of tyrosine-sulfated proteins using a novel anti-sulfotyrosine monoclonal antibody. J Biol Chem 281: 37877–37887, 2006
38. Wichmann HE, Gieger C, Illig T; MONICA/KORA Study Group: KORA-gen–resource for population genetics, controls and a broad spectrum of disease phenotypes. Gesundheitswesen 67[Suppl 1]: S26–S30, 2005
39. Andrew T, Hart DJ, Snieder H, de Lange M, Spector TD, MacGregor AJ: Are twins and singletons comparable? A study of disease-related and lifestyle characteristics in adult women. Twin Res 4: 464–477, 2001
40. Beck GJ, Berg RL, Coggins CH, Gassman JJ, Hunsicker LG, Schluchter MD, Williams GW; The Modification of Diet in Renal Disease Study Group: Design and statistical issues of the Modification of Diet in Renal Disease Trial. Control Clin Trials 12: 566–586, 1991
41. Gassman JJ, Greene T, Wright JT Jr, Agodoa L, Bakris G, Beck GJ, Douglas J, Jamerson K, Lewis J, Kutner M, Randall OS, Wang SR: Design and statistical aspects of the African American Study of Kidney Disease and Hypertension (AASK). J Am Soc Nephrol 14[Suppl 2]: S154–S165, 2003
42. Kwong YT, Stevens LA, Selvin E, Zhang YL, Greene T, Van Lente F, Levey AS, Coresh J: Imprecision of urinary iothalamate clearance as a gold-standard measure of GFR decreases the diagnostic accuracy of kidney function estimating equations. Am J Kidney Dis 56: 39–49, 2010
43. Evans AM, DeHaven CD, Barrett T, Mitchell M, Milgram E: Integrated, nontargeted ultrahigh performance liquid chromatography/electrospray ionization tandem mass spectrometry platform for the identification and relative quantification of the small-molecule complement of biological systems. Anal Chem 81: 6656–6667, 2009
44. Dehaven CD, Evans AM, Dai H, Lawton KA: Organization of GC/MS and LC/ MS metabolomics data into chemical libraries. J Cheminform 2: 9, 2010
45. Coresh J, Inker LA, Levey AS: Precise estimation of glomerular filtration rate from multiple blood biomarkers [Abstract]. J Am Soc Nephrol 25: 52A, 2014
46. Meisinger C, Stöckl D, Rückert IM, Döring A, Thorand B, Heier M, Huth C, Belcredi P, Kowall B, Rathmann W: Serum potassium is associated with prediabetes and newly diagnosed diabetes in hypertensive adults from the general population: The KORA F4-study. Diabetologia 56: 484–491, 2013
47. Junge W, Wilke B, Halabi A, Klein G: Determination of reference intervals for serum creatinine, creatinine excretion and creatinine clearance with an enzymatic and a modified Jaffé method. Clin Chim Acta 344: 137–148, 2004
48. Coresh J, Astor BC, McQuillan G, Kusek J, Greene T, Van Lente F, Levey AS: Calibration and random variation of the serum creatinine assay as critical elements of using equations to estimate glomerular filtration rate. Am J Kidney Dis 39: 920–929, 2002
49. Selvin E, Manzi J, Stevens LA, Van Lente F, Lacher DA, Levey AS, Coresh J: Calibration of serum creatinine in the National Health and Nutrition Examination Surveys (NHANES) 1988-1994, 1999-2004. Am J Kidney Dis 50: 918–926, 2007
50. Levey AS, Stevens LA, Schmid CH, Zhang YL, Castro AF 3rd, Feldman HI, Kusek JW, Eggers P, Van Lente F, Greene T, Coresh J; CKD-EPI (Chronic Kidney Disease Epidemiology Collaboration): A new equation to estimate glomerular filtration rate. Ann Intern Med 150: 604–612, 2009
51. Bhavsar NA, Appel LJ, Kusek JW, Contreras G, Bakris G, Coresh J, Astor BC; AASK Study Group: Comparison of measured GFR, serum creatinine, cystatin C, and beta-trace protein to predict ESRD in African Americans with hypertensive CKD. Am J Kidney Dis 58: 886–893, 2011
52. Stevens PE, Levin A; Kidney Disease: Improving Global Outcomes Chronic Kidney Disease Guideline Development Work Group Members: Evaluation and management of chronic kidney disease: Synopsis of the kidney disease: improving global outcomes 2012 clinical practice guideline. Ann Intern Med 158: 825–830, 2013
53. Fox CS, Larson MG, Leip EP, Culleton B, Wilson PW, Levy D: Predictors of new-onset kidney disease in a community-based population. JAMA 291: 844–850, 2004
54. Storey JD, Tibshirani R: Statistical significance for genomewide studies. Proc Natl Acad Sci U S A 100: 9440–9445, 2003
55. Tutz G, Binder H: Boosting ridge regression. Comput Stat Data Anal 51: 6044–6059, 2007
56. DeLong ER, DeLong DM, Clarke-Pearson DL: Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach. Biometrics 44: 837–845, 1988
57. Binder H, Schumacher M: Adapting prediction error estimates for biased complexity selection in high-dimensional bootstrap samples. Stat Appl Genet Mol Biol 7: Article 12, 2008
58. Steyerberg E: Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating, New York, Springer-Verlag, 2009
59. Pencina MJ, D’Agostino RB Sr, D’Agostino RB Jr, Vasan RS: Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond. Stat Med 27: 157–172, discussion 207–212, 2008