Bioinformatics for protein biomarker panel classification: What is needed to bring biomarker panels into in vitro diagnostics?

Expert Review of Proteomics

Volumn 6, Issue 6, 2009, Pages 675-689

  Robin, Xavier ^a   Turck, Natacha ^a   Hainard, Alexandre ^a   Lisacek, Frédérique ^b   Sanchez, Jean Charles ^a   Müller, Markus ^b  

^a UNIVERSITY OF GENEVA MEDICAL SCHOOL   (Switzerland)

^b SWISS INSTITUTE OF BIOINFORMATICS   (Switzerland)

Author keywords

Biomarker; Classification; Combination of biomarkers; In vitro diagnostics; Panel; Proteomics; Validation

Indexed keywords

BIOLOGICAL MARKER; PROTEIN;

AFRICAN TRYPANOSOMIASIS; BIOINFORMATICS; BLOOD SAMPLING; BOOTSTRAPPING; CARDIOVASCULAR DISEASE; CLINICAL PRACTICE; DECISION TREE; DIAGNOSTIC ACCURACY; DIAGNOSTIC TEST; DIAGNOSTIC VALUE; ENZYME LINKED IMMUNOSORBENT ASSAY; FOOD AND DRUG ADMINISTRATION; GENE EXPRESSION; GENE MUTATION; HUMAN; IMMUNOHISTOCHEMISTRY; IN VITRO DIAGNOSTICS; IN VITRO STUDY; LABORATORY TEST; LOGISTIC REGRESSION ANALYSIS; MATRIX ASSISTED LASER DESORPTION IONIZATION TIME OF FLIGHT MASS SPECTROMETRY; MICROARRAY ANALYSIS; PANEL STUDY; PATIENT CODING; PROGNOSIS; PROTEOMICS; RECEIVER OPERATING CHARACTERISTIC; REPRODUCIBILITY; REVIEW; SENSITIVITY AND SPECIFICITY; STROKE; SUPPORT VECTOR MACHINE; SURFACE ENHANCED LASER DESORPTION IONIZATION TIME OF FLIGHT MASS SPECTROMETRY; VALIDATION PROCESS;

ALGORITHMS; BIOLOGICAL MARKERS; COMPUTATIONAL BIOLOGY; HUMANS; MODELS, STATISTICAL; PROTEINS;

EID: 74049111984     PISSN: 14789450     EISSN: 17448387     Source Type: Journal    
DOI: 10.1586/epr.09.83     Document Type: Review

References (94)

1. Hanash S. Disease proteomics. Nature 422(6928), 226-232 (2003).
2. Steel LF, Haab BB, Hanash SM. Methods of comparative proteomic profiling for disease diagnostics. J. Chromatogr. B Analyt. Technol. Biomed. Life Sci. 815(1-2), 275-284 (2005).
3. Domon B, Aebersold R. Mass spectrometry and protein analysis. Science 312(5771), 212-217 (2006).
4. Hanash SM, Pitteri SJ, Faca VM. Mining the plasma proteome for cancer biomarkers. Nature 452(7187), 571-579 (2008).
5. Panchaud A, Affolter M, Moreillon P, Kussmann M. Experimental and computational approaches to quantitative proteomics: status quo and outlook. J. Proteomics 71(1), 19-33 (2008).
6. Knickerbocker T, Chen JR, Thadhani R, MacBeath G. An integrated approach to prognosis using protein microarrays and nonparametric methods. Mol. Syst. Biol. 3(123), 1-8 (2007). • A complete study with a multiplex protein array approach and a thorough statistical analysis.
7. Turck N, Vutskits L, Sanchez-Pena P et al. A multiparameter panel method for outcome prediction following aneurysmal subarachnoid hemorrhage. Intensive Care Med. DOI: 10.1007/s00134-009-1641-y (2009) (Epub ahead of print).
8. Hainard A, Tiberti N, Robin X et al. A combined CXCL10, CXCL8 and H-FABP panel for the staging of human African trypanosomiasis patients. PLoS Negl. Trop. Dis. 3(6), E459 (2009). • Impressive results on a neglected tropical disease and a potential clinical application in the short to medium term.
9. Baggerly KA, Morris JS, Coombes KR. Reproducibility of SELDI-TOF protein patterns in serum: comparing datasets from different experiments. Bioinformatics 20(5), 777-785 (2004).
10. Diamandis EP. Analysis of serum proteomic patterns for early cancer diagnosis: drawing attention to potential problems. J. Natl Cancer Inst. 96(5), 353-356 (2004).
11. Feng Z, Yasui Y. Statistical considerations in combining biomarkers. Dis. Markers 20(2), 45-51 (2004).
12. Stead DA, Paton NW, Missier P et al. Information quality in proteomics. Brief Bioinform. 9(2), 174-188 (2008).
13. Oberg AL, Vitek O. Statistical design of quantitative mass spectrometry-based proteomic experiments. J. Proteome Res. 8(5), 2144-2156 (2009).
14. Vitzthum F, Behrens F, Anderson NL, Shaw JH. Proteomics: from basic research to diagnostic application. A review of requirements and needs. J. Proteome Res. 4(4), 1086-1097 (2005).
15. Dodd LE, Pepe MS. Partial AUC estimation and regression. Biometrics 59(3), 614-623 (2003).
16. Hackett JL, Gutman SI. Introduction to the Food and Drug Administration (FDA) regulatory process. J. Proteome Res. 4(4), 1110-1113 (2005).
17. Vanni S, Polidori G, Pepe G et al. Use of biomarkers in triage of patients with suspected stroke. J. Emerg. Med. DOI: 10.1016/j.jemermed. 2008.09.028 (2009) (Epub ahead of print).
18. Sibon I, Rouanet F, Meissner W, Orgogozo JM. Use of the Triage Stroke Panel in a neurologic emergency service. Am. J. Emerg. Med. 27(5), 558-562 (2009).
19. Brouns R, Van Den Bossche J, De Surgeloose D, Sheorajpanday R, De Deyn PP. Clinical and biochemical diagnosis of small-vessel disease in acute ischemic stroke. J. Neurol. Sci. 285(1-2), 185-190 (2009).
20. Apple FS, Christenson RH, Valdes R et al. Simultaneous rapid measurement of whole blood myoglobin, creatine kinase MB, and cardiac troponin I by the triage cardiac panel for detection of myocardial infarction. Clin. Chem. 45(2), 199-205 (1999).
21. Hoffer A, Osmond H. A card sorting test helpful in making psychiatric diagnosis. J. Neuropsychiatr. 2, 306-330 (1961).
22. Report of World Federation of Neurological Surgeons Committee on a Universal Subarachnoid Hemorrhage Grading Scale. J. Neurosurg. 68(6), 985-986 (1988).
23. Woolas RP, Xu F-J, Jacabs IJ et al. Elevation of multiple serum markers in patients with stage I ovarian cancer. J. Natl Cancer Inst. 85(21), 1748-1751 (1993).
24. Hill MD, Jackowski G, Bayer N, Lawrence M, Jaeschke R. Biochemical markers in acute ischemic stroke. Can. Med. Assoc. J. 162(8), 1139-1140 (2000).
25. Ferguson RE, Hochstrasser DF, Banks RE. Impact of preanalytical variables on the analysis of biological fluids in proteomic studies. Proteomics Clin. Appl. 1(8), 739-746 (2007).
26. Rai AJ, Vitzthum F. Effects of preanalytical variables on peptide and protein measurements in human serum and plasma: implications for clinical proteomics. Expert Rev. Proteomics 3(4), 409-426 (2006).
27. Little RR, Rohlfing CL, Tennill AL et al. Standardization of C-peptide measurements. Clin. Chem. 54(6), 1023-1026 (2008).
28. Yeo I-K, Johnson RA. A new family of power transformations to improve normality or symmetry. Biometrika 87(4), 954-959 (2000).
29. Gentleman R, Huber W, Carey V, Irizarry RA, Dudoit S. Bioinformatics and Computational Biology Solutions Using R and Bioconductor. Gentleman R, Huber W, Carey V, Irizarry RA, Dudoit S (Eds). Springer-Verlag, NY, USA (2005).
30. Hilario M, Kalousis A. Approaches to dimensionality reduction in proteomic biomarker studies. Brief Bioinform. 9(2), 102-118 (2008).
31. Saeys Y, Inza I, Larranaga P. A review of feature selection techniques in bioinformatics. Bioinformatics 23(19), 2507-2517 (2007).
32. Baggerly KA, Morris JS, Wang J, Gold D, Xiao L-C, Coombes KR. A comprehensive approach to the analysis of matrix-assisted laser desorption/ionization-time of flight proteomics spectra from serum samples. Proteomics 3(9), 1667-1672 (2003).
33. Petricoin EF, Ardekani AM, Hitt BA et al. Use of proteomic patterns in serum to identify ovarian cancer. Lancet 359(9306), 572-577 (2002).
34. Hastie T, Tibshirani R, Friedman J. Elements of Statistical Learning: data mining, inference, and prediction. Springer-Verlag, NY, USA (2003). • Reference book for statistical learning.
35. Faca VM, Song KS, Wang H et al. A mouse to human search for plasma proteome changes associated with pancreatic tumor development. PLoS Med. 5(6), E123 (2008).
36. Reynolds MA, Kirchick HJ, Dahlen JR et al. Early biomarkers of stroke. Clin. Chem. 49(10), 1733-1739 (2003). • First attempt to select a panel with thresholds defined in a multivariate manner.
37. Montaner J, Perea-Gainza M, Delgado P et al. Etiologic diagnosis of ischemic stroke subtypes with plasma biomarkers. Stroke 39(8), 2280-2287 (2008).
38. Lejon V, Roger I, Mumba Ngoyi D et al. Novel markers for treatment outcome in late-stage Trypanosoma brucei gambiense trypanosomiasis. Clin. Infect. Dis. 47(1), 15-22 (2008).
39. Wang P, Kim Y, Pollack J, Tibshirani R. Boosted PRIM with application to searching for oncogenic pathway of lung cancer. Proceedings of the 2004 IEEE Computational Systems Bioinformatics Conference. Stanford, CA, USA, 16-19 August 2004.
40. Ralhan R, DeSouza LV, Matta A et al. Discovery and verification of head-andneck cancer biomarkers by differential protein expression analysis using iTRAQ labeling, multidimensional liquid chromatography, and tandem mass spectrometry. Mol. Cell. Proteomics 7(6), 1162-1173 (2008).
41. Webb GI, Boughton JR, Wang Z. Not so naive Bayes: aggregating one-dependence estimators. Machine Learn. 58(1), 5-24 (2005).
42. Seeber B, Sammel MD, Fan X et al. Panel of markers can accurately predict endometriosis in a subset of patients. Fertil. Steril. 89(5), 1073-1081 (2008).
43. Rosen RC, Cappelleri JC, Smith MD, Lipsky J, Peña BM. Development and evaluation of an abridged 5-item version of the International Index of Erectile Function (IIEF-5) as a diagnostic tool for erectile dysfunction. Int. J. Impot. Res. 11(6), 319-326 (1999).
44. Patz EF, Campa MJ, Gottlin EB, Kusmartseva I, Guan XR, Herndon JE. Panel of serum biomarkers for the diagnosis of lung cancer. J. Clin. Oncol. 25(35), 5578-5583 (2007).
45. Reddy A, Wang H, Yu H et al. Logical Analysis of Data (LAD) model for the early diagnosis of acute ischemic stroke. BMC Med. Inform. Decis. Mak. 8, 30 (2008). •• Comparison of five methods (Logical Analysis of Data, support vector machine, decision tree, logistic regression and multilayer perceptron) on SELDI data. Exemplary validation with tenfold cross-validation and an independent validation set.
46. Prados J, Kalousis A, Sanchez J-C, Allard L, Carrette O, Hilario M. Mining mass spectra for diagnosis and biomarker discovery of cerebral accidents. Proteomics 4(8), 2320-2332 (2004).
47. Ring BZ, Seitz RS, Beck R et al. Novel prognostic immunohistochemical biomarker panel for estrogen receptorpositive breast cancer. J. Clin. Oncol. 24(19), 3039-3047 (2006).
48. Wu B, Abbott T, Fishman D et al. Comparison of statistical methods for classification of ovarian cancer using mass spectrometry data. Bioinformatics 19(13), 1636-1643 (2003).
49. Breiman L. Random forests. Machine Learn. 45(1), 5-32 (2001).
50. Visintin I, Feng Z, Longton G et al. Diagnostic markers for early detection of ovarian cancer. Clin. Cancer Res. 14(4), 1065-1072 (2008). •• Describes several logistic regression models fitted with a very clear validation. Data were acquired in a multiplex bead assay.
51. Lynch JR, Blessing R, White WD, Grocott HP, Newman MF, Laskowitz DT. Novel diagnostic test for acute stroke. Stroke 35(1), 57-63 (2004).
52. Rosengart AJ, Schultheiss KE, Tolentino J, Macdonald RL. Prognostic factors for outcome in patients with aneurysmal subarachnoid hemorrhage. Stroke 38(8), 2315-2321 (2007).
53. Zheng Y, Katsaros D, Shan SJC et al. A multiparametric panel for ovarian cancer diagnosis, prognosis, and response to chemotherapy. Clin. Cancer Res. 13(23), 6984-6992 (2007).
54. Laskowitz DT, Kasner SE, Saver J, Remmel KS, Jauch EC; BRAIN Study Group. Clinical usefulness of a biomarker-based diagnostic test for acute stroke: the Biomarker Rapid Assessment in Ischemic Injury (BRAIN) study. Stroke 40(1), 77-85 (2009).
55. Welsh P, Barber M, Langhorne P, Rumley A, Lowe GDO, Stott DJ. Associations of inflammatory and haemostatic biomarkers with poor outcome in acute ischaemic stroke. Cerebrovasc. Dis. 27(3), 247-253 (2009).
56. Wicki J, Perneger TV, Junod AF, Bounameaux H, Perrier A. Assessing clinical probability of pulmonary embolism in the emergency ward: a simple score. Arch. Intern. Med. 161(1), 92-97 (2001).
57. Zervakis M, Blazadonakis ME, Tsiliki G, Danilatou V, Tsiknakis M, Kafetzopoulos D. Outcome prediction based on microarray analysis: a critical perspective on methods. BMC Bioinformatics 10, 53 (2009).
58. Schramm A, Schulte JH, Klein-Hitpass L et al. Prediction of clinical outcome and biological characterization of neuroblastoma by expression profiling. Oncogene 24(53), 7902-7912 (2005).
59. Petricoin EF, Liotta LA. SELDI-TOFbased serum proteomic pattern diagnostics for early detection of cancer. Curr. Opin. Biotechnol. 15(1), 24-30 (2004).
60. Ressom HW, Varghese RS, Drake SK et al. Peak selection from MALDI-TOF mass spectra using ant colony optimization. Bioinformatics 23(5), 619-626 (2007).
61. Liu JJ, Cutler G, Li W et al. Multiclass cancer classification and biomarker discovery using GA-based algorithms. Bioinformatics 21(11), 2691-2697 (2005).
62. Wild N, Karl J, Grunert VP et al. Diagnosis of rheumatoid arthritis: multivariate analysis of biomarkers. Biomarkers 13(1), 88-105 (2008).
63. Gevaert O, Smet FD, Timmerman D, Moreau Y, Moor BD. Predicting the prognosis of breast cancer by integrating clinical and microarray data with Bayesian networks. Bioinformatics 22(14), E184-E190 (2006).
64. James GM, Hastie TJ. functional linear discriminant analysis for irregularly sampled curves. J. R. Statist. Soc. B 63(3), 533-550 (2001).
65. Ishino M, Takeishi Y, Niizeki T et al. Implications of BNP, H-FABP, and PTX3. Circ. J. 72(11), 1800-1805 (2008).
66. Ross DT, Kim C-Y, Tang G et al. Chemosensitivity and stratification by a five monoclonal antibody immunohistochemistry test in the NSABP B14 and B20 trials. Clin. Cancer Res. 14(20), 6602-6609 (2008).
67. Linkov F, Lisovich A, Yurkovetsky Z et al. Early detection of head and neck cancer: development of a novel screening tool using multiplexed immunobead-based biomarker profiling. Cancer Epidemiol. Biomarkers Prev. 16(1), 102-107 (2007).
68. Bhaskar H, Hoyle DC, Singh S. Machine learning in bioinformatics: a brief survey and recommendations for practitioners. Comput. Biol. Med. 36(10), 1104-1125 (2006).
69. Whiteley W, Tseng M-C, Sandercock P. Blood biomarkers in the diagnosis of ischemic stroke: a systematic review. Stroke 39(10), 2902-2909 (2008).
70. Smit S, van Breemen MJ, Hoefsloot HCJ, Smilde AK, Aerts JMFG, de Koster CG. Assessing the statistical validity of proteomics based biomarkers. Anal. Chim. Acta 592(2), 210-217 (2007).
71. Hesterberg T, Moore DS, Monaghan S, Clipson A, Epstein R. Bootstrap methods and permutation tests. In: Introduction to the Practice of Statistics (5th Edition). WH Freeman & Company, NY, USA (2005).
72. Carpenter J, Bithell J. Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. Stat. Med. 19(9), 1141-1164 (2000).
73. Taylor CF. Minimum reporting requirements for proteomics: a MIAPE primer. Proteomics 6(Suppl. 2), 39-44 (2006).
74. Bossuyt PM, Reitsma JB, Bruns DE et al. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Clin. Chem. 49(1), 7-18 (2003).
75. LaBaer J. So, you want to look for biomarkers (introduction to the special biomarkers issue). J. Proteome Res. 4(4), 1053-1059 (2005).
76. Hilario M, Kalousis A, Pellegrini C, Müller M. Processing and classification of protein mass spectra. Mass Spectrom. Rev. 25(3), 409-449 (2006).
77. Fawcett T. An introduction to ROC analysis. Pattern Recogn. Lett. 27(8), 861-874 (2006).
78. McClish DK. Analyzing a portion of the ROC Curve. Med. Decis. Making 9(3), 190-195 (1989).
79. Thompson ML, Zucchini W. On the statistical analysis of ROC curves. Stat. Med. 8(10), 1277-1290 (1989).
80. Hanley JA, McNeil BJ. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology 148(3), 839-843 (1983).
81. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44(3), 837-845 (1988).
82. McClish DK. Determining a range of false-positive rates for which ROC curves differ. Med. Decis. Making 10(4), 283-287 (1990).
83. Baker SG. Identifying combinations of cancer markers for further study as triggers of early intervention. Biometrics 56(4), 1082-1087 (2000).
84. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143(1), 29-36 (1982).
85. Gu J, Ghosal S, Roy A. Bayesian bootstrap estimation of ROC curve. Stat. Med. 27(26), 5407-5420 (2008).
86. Morais DF, Spotti AR, Tognola WA, Gaia FFP, Andrade AF. Clinical application of magnetic resonance in acute traumatic brain injury. Arquivos de Neuro-Psiquiatria 66(1), 53-58 (2008).
87. Vasconcelos OM Jr, Prokhorenko OA, Kelley KF et al. A comparison of fatigue scales in postpoliomyelitis syndrome. Arch. Phys. Med. Rehabil. 87(9), 1213-1217 (2006).
88. Salzberg S. On comparing classifiers: pitfalls to avoid and a recommended approach. Data Min. Knowl. Discov. 1(3), 317-328 (1997).
89. Gillette MA, Mani DR, Carr SA. Place of pattern in proteomic biomarker discovery. J. Proteome Res. 4(4), 1143-1154 (2005).
90. Han J, Kamber M. Data Mining. Morgan Kaufmann, CA, USA (2001).
91. Pepe MS, Janes H, Longton G, Leisenring W, Newcomb P. Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. Am. J. Epidemiol. 159(9), 882-890 (2004).
92. Cortes C, Vapnik V. Support-vector networks. Machine Learn. 20(3), 273-297 (1995).
93. McCormick T, Martin K, Hehenberger M. The evolving role of biomarkers - Focusing on patients from research to clinical practice. IBM Global Business Services (2007) www.03.ibm.com/industries/healthcare/ doc/content/resource/ insight/2799019105. html
94. Hammer PL, Bonates T. Logical analysis of data: from combinatorial optimization to medical applications. RUTCOR Research Report (10-2005) (2005) http://rutcor.rutgers.edu/pub/rrr/ reports2005/10-2005.pdf