Weak associations between prognostic biomarkers and disease in preliminary studies illustrates the breach between statistical significance and diagnostic discrimination

Clinica Chimica Acta

Volumn 411, Issue 7-8, 2010, Pages 467-473

  Levinson, Stanley S ^a,b  

^a VETERANS AFFAIRS MEDICAL CENTER   (United States)

^b University of Louisville School of Medicine   (United States)

Author keywords

C Statistic; Odds ratio; Outcome studies; Positive predictive values; Reclassification; Relative risk; ROC curves

Indexed keywords

BIOLOGICAL MARKER; C REACTIVE PROTEIN; HIGH DENSITY LIPOPROTEIN CHOLESTEROL; LOW DENSITY LIPOPROTEIN CHOLESTEROL;

CLINICAL PRACTICE; DIAGNOSTIC ACCURACY; DIAGNOSTIC PROCEDURE; FALSE POSITIVE RESULT; MEDICAL INFORMATION; PRACTICE GUIDELINE; PREDICTION; PRIORITY JOURNAL; PROGNOSIS; RECEIVER OPERATING CHARACTERISTIC; REVIEW; RISK FACTOR; SENSITIVITY AND SPECIFICITY;

BIOLOGICAL MARKERS; DATA INTERPRETATION, STATISTICAL; DISEASE; HUMANS; ODDS RATIO; PROGNOSIS; RISK FACTORS; SENSITIVITY AND SPECIFICITY;

EID: 77649185648     PISSN: 00098981     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cca.2010.01.015     Document Type: Review

References (64)

1. Levinson S.S. Clinical validation of biomarkers for predicting risk. Adv Clin Chem 2009, 48:1-25.
2. Bozkurt B., Mann D.L. Use of biomarkers in the management of heart failure: are we there yet?. Circulation 2003, 107:1231-1233.
3. Sackett D.L., Haynes R.B. The architecture of diagnostic research. BMJ 2002, 324:539-541.
4. Lauer M.S. Discarding logic: 2008 Ancel Keys Memorial Lecture. Circulation 2009, 119:1533-1537.
5. Vittorini S., Clerico A. Cardiovascular biomarkers: increasing impact of laboratory medicine in cardiology practice. Clin Chem Lab Med 2008, 46:748-763.
6. Krumholz H.M., Lee T.H. Redefining quality-implications of recent clinical trials. N Engl J Med 2008, 358:2537-2539.
7. Mosca L. C-reactive protein-to screen or not to screen?. N Engl J Med 2002, 347:1615-1617.
8. Levinson S.S. Inflammatory and long-term risk markers. Clin Lab Med 2006, 26:553-570.
9. Pearson T.A., Mensah G.A., Alexander R.W., et al. Markers of inflammation and cardiovascular disease: application to clinical and public health practice: a statement for healthcare professionals from the Centers for Disease Control and Prevention and the American Heart Association. Circulation 2003, 107:499-511.
10. Ridker P.M., Cook N. Clinical usefulness of very high and very low levels of C-reactive protein across the full range of Framingham Risk Scores. Circulation 2004, 109:1955-1959.
11. Rifai N., Ridker P.M. Proposed cardiovascular risk assessment algorithm using high-sensitivity C-reactive protein and lipid screening. Clin Chem 2001, 47:28-30.
12. Smulders Y.M., Thijs A., Twisk J.W. New cardiovascular risk determinants do exist and are clinically useful. Eur Heart J 2008, 29:436-440.
13. Goodman S.N. Towards evidence-based medical statistics. 1: The p value fallacy. Ann Intern Med 1999, 130:995-1004.
14. Efron B. Bayesians, frequentists, and scientists. J Am Stat Assoc 2005, 100:1-5.
15. Vasan R.S. Biomarkers of cardiovascular disease: molecular basis and practical considerations. Circulation 2006, 113:2335-2362.
16. Ware J.H. The limitations of risk factors as prognostic tools. N Engl J Med 2006, 355:2615-2617.
17. Henderson A. Chemistry with confidence: should clinical chemistry require confidence intervals for analytical and other data?. Clin Chem 1993, 39:929-935.
18. Rifai N., Altman D.G., Bossuyt P.M. Reporting bias in diagnostic and prognostic studies: time for action. Clin Chem 2008, 54:1101-1103.
19. Trenti T. Evidence-based laboratory medicine as a tool for continuous professional improvement. Clin Chim Acta 2003, 2003:155-167.
20. Swets J.A. Measuring the accuracy of diagnostic systems. Science 1988, 240:1285-1293.
21. Pepe M.S., Janes H., Longton G., Leisenring W., Newcomb P. Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. Am J Epidemiol 2004, 159:882-890.
22. Zweig M.H., Campbell G. Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem 1993, 39:561-577.
23. Pepe M.S., Janes H., Gu J.W. Letter by Pepe et al. regarding article, "Use and misuse of the receiver operating characteristic curve in risk prediction". Circulation 2007, 116:e132. author reply e134.
24. Wang T.J. New cardiovascular risk factors exist, but are they clinically useful?. Eur Heart J 2008, 29:441-444.
25. Tricoci P., Allen J.M., Kramer J.M., Califf R.M., Smith S.C. Scientific evidence underlying the ACC/AHA clinical practice guidelines. JAMA 2009, 301:831-841.
26. Fletcher R., Fletcher S.W. Clinical epidemiology 2005, Lippincott Williams and Wilkins, Baltimore.
27. Zhang J., Yu K.F. What's the relative risk? A method of correcting the odds ratio in cohort studies of common outcomes. JAMA 1998, 280:1690-1691.
28. Krouwer J.S. Cumulative distribution analysis graphs-an alternative to ROC curves. Clin Chem 1987, 33:2305-2306.
29. Shultz E.K. Multivariate receiver-operating characteristic curve analysis: prostate cancer screening as an example. Clin Chem 1995, 41:1248-1255.
30. Zweig M.H., Broste S.K., Reinhart R.A. ROC curve analysis: an example showing the relationships among serum lipid and apolipoprotein concentrations in identifying patients with coronary artery disease. Clin Chem 1992, 38:1425-1428.
31. Heagerty P.J., Lumley T., Pepe M.S. Time-dependent ROC curves for censored survival data and a diagnostic marker. Biometrics 2000, 56:337-344.
32. Levinson S.S. Comparison of apolipoprotein B and non-high-density lipoprotein cholesterol for identifying coronary artery disease risk based on receiver operating curve analysis. Am J Clin Pathol 2007, 127:449-455.
33. Wang T.J., Gona P., Larson M.G., et al. Multiple biomarkers for the prediction of first major cardiovascular events and death. N Engl J Med 2006, 355:2631-2639.
34. Pepe M.S., Feng Z., Gu J.W. Comments on 'Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond' by M. J. Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929). Stat Med 2008, 27:173-181.
35. Rosenson R.S. Management of non-high-density lipoprotein abnormalities. Atherosclerosis 2009, 207:328-335.
36. Hlatky M.A., Greenland P., Arnett D.K., et al. Criteria for evaluation of novel markers of cardiovascular risk: a scientific statement from the American Heart Association. Circulation 2009, 119:2408-2416.
37. Cook N.R. Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation 2007, 115:928-935.
38. Cook N. Statistical evaluation of prognostic versus diagnostic models: beyond the ROC curve. Clin Chem 2008, 54:17-23.
39. Ridker P.M., Buring J.E., Shih J., Matias M., Hennekens C.H. Prospective study of C-reactive protein and the risk of future cardiovascular events among apparently healthy women. Circulation 1998, 98:731-733.
40. Ridker P.M., Rifai N., Rose L., Buring J.E., Cook N.R. Comparison of C-reactive protein and low-density lipoprotein cholesterol levels in the prediction of first cardiovascular events. N Engl J Med 2002, 347:1557-1565.
41. Ridker P.M., Hennekens C.H., Buring J.E., Rifai N. C-reactive protein and other markers of inflammation in the prediction of cardiovascular disease in women. N Engl J Med 2000, 342:836-843.
42. St-Pierre A.C., Cantin B., Bergeron J., et al. Inflammatory markers and long-term risk of ischemic heart disease in men: a 13-year follow-up of the Quebec Cardiovascular Study. Atherosclerosis 2005, 182:315-321.
43. Tzoulaki I., Murray G.D., Lee A.J., Rumley A., Lowe G.D., Fowkes F.G. Relative value of inflammatory, hemostatic, and rheological factors for incident myocardial infarction and stroke: the Edinburgh Artery Study. Circulation 2007, 115:2119-2127.
44. Levinson S.S. High density- and beta-lipoprotein screening for risk of coronary artery disease in the context of new findings on reverse cholesterol transport. Ann Clin Lab Sci 2002, 32:123-136.
45. Pauker S.G., Kopelman R.I. Interpreting hoofbeats: can Bayes help clear the haze?. N Engl J Med 1992, 327:1009-1013.
46. Korngold E.C., Januzzi J.L., Gantzer M.L., Moorthy M.V., Cook N.R., Albert C.M. Amino-terminal pro-B-type natriuretic peptide and high-sensitivity C-reactive protein as predictors of sudden cardiac death among women. Circulation 2009, 119:2868-2876.
47. Ridker P.M., Danielson E., Fonseca F.A., et al. Rosuvastatin to prevent vascular events in men and women with elevated C-reactive protein. N Engl J Med 2008, 359:2195-2207.
48. Hlatky M.A. Expanding the orbit of primary prevention-beyond JUPITER. N Engl J Med 2008, 359:2280-2282.
49. Levinson S.S. Brief review and critical examination of the use of hs-CRP for cardiac risk assessment with the conclusion that it is premature to use this test. Clin Chim Acta 2005, 356:1-8.
50. Kahn R., Buse J., Ferrannini E., Stern M. The metabolic syndrome: time for a critical appraisal: joint statement from the American Diabetes Association and the European Association for the Study of Diabetes. Diabetes Care 2005, 28:2289-2304.
51. Reaven G.M. Banting lecture 1988: role of insulin resistance in human disease. Diabetes 1988, 37:1595-1607.
52. Aguilar Salinas C.A., Zamora M., Gomez-Diaz R.A., Mehta R., Gomez Perez F.J., Rull J.A. Familial combined hyperlipidemia: controversial aspects of its diagnosis and pathogenesis. Semin Vasc Med 2004, 4:203-209.
53. Austin M.A., Breslow J.L., Hennekens C.H., Buring J.E., Willett W.C., Krauss R.M. Low-density lipoprotein subclass patterns and risk of myocardial infarction. JAMA 1988, 260:1917-1921.
54. Austin M.A., McKnight B., Edwards K.L., et al. Cardiovascular disease mortality in familial forms of hypertriglyceridemia: a 20-year prospective study. Circulation 2000, 101:2777-2782.
55. Ridker P.M., Danielson E., Fonseca F.A., et al. Reduction in C-reactive protein and LDL cholesterol and cardiovascular event rates after initiation of rosuvastatin: a prospective study of the JUPITER trial. Lancet 2009, 373:1175-1182.
56. Pencina M.J., D'Agostino R.B., D'Agostino R.B., Vasan R.S. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med 2008, 27:157-172. discussion 207-112.
57. Janket S.J., Shen Y., Baird A.E. Why must new cardiovascular risk factors be carefully re-assessed prior to clinical application?. Eur Heart J 2008, 29:1336-1337. author reply 1337.
58. Wang T.J., Larson M.G., Vasan R.S. Biomarkers for prediction of cardiovascular events. New Engl J Med 2007, 356:1472-1475.
59. Melander O., Newton-Cheh C., Almgren P., et al. Novel and conventional biomarkers for prediction of incident cardiovascular events in the community. JAMA 2009, 302:49-57.
60. Loscalzo J. Association studies in an era of too much information: clinical analysis of new biomarker and genetic data. Circulation 2007, 116:1866-1870.
61. Wald N.J., Hackshaw A.K., Frost C.D. When can a risk factor be used as a worthwhile screening test?. BMJ 1999, 319:1562-1565.
62. Schenk S., Saberi M., Olefsky J.M. Insulin sensitivity: modulation by nutrients and inflammation. J Clin Invest 2008, 118:2992-3002.
63. Rutter M.K., Meigs J.B., Sullivan L.M., D'Agostino R.B., Wilson P.W. C-reactive protein, the metabolic syndrome, and prediction of cardiovascular events in the Framingham Offspring Study. Circulation 2004, 110:380-385.
64. Brunzell J.D., Davidson M., Furberg C.D., et al. Lipoprotein management in patients with cardiometabolic risk: consensus conference report from the American Diabetes Association and the American College of Cardiology Foundation. J Am Coll Cardiol 2008, 51:1512-1524.