A gentle introduction to support vector machines in biomedicine: Volume 2: Case studies and benchmarks

A Gentle Introduction to Support Vector Machines in Biomedicine: Volume 2: Case Studies and Benchmarks

Volumn , Issue , 2013, Pages 1-201

  Statnikov, Alexander ^a   Aliferis, Constantin F ^a   Hardin, Douglas P ^b   Guyon, Isabelle ^c  

^a NEW YORK UNIVERSITY   (United States)

^b VANDERBILT UNIVERSITY   (United States)

^c ClopiNet   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

PATTERN RECOGNITION;

CASE-STUDIES; STATISTICAL MACHINE LEARNING; SUPPORT VECTOR MACHINE (SVMS); TECHNICAL BACKGROUND; THEORY AND METHODS;

SUPPORT VECTOR MACHINES;

EID: 84995493653     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1142/7923     Document Type: Book

References (121)

1. Aliferis CF, etal. (2010a) Local Causal and Markov Blanket Induction for Causal Discovery and Feature Selection for Classification. Part I: Algorithms and Empirical Evaluation. Journal of Machine Learning Research 11: 171-234.
2. Aliferis CF, etal. (2010b) Local Causal and Markov Blanket Induction for Causal Discovery and Feature Selection for Classification. Part II: Analysis and Extensions. Journal of Machine Learning Research 11: 235-284.
3. Aliferis CF, Tsamardinos I, Statnikov A. (2003) HITON: a novel Markov blanket algorithm for optimal variable selection. AMIA 2003 Annual Symposium Proceedings 21-25.
4. Alizadeh AA, et al. (2000) Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling. Nature 403: 503-511.
5. Alon U, etal. (1999) Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proc Natl Acad Sci USA 96: 6745-6750.
6. Aphinyanaphongs Y, Aliferis CF. (2007) Text categorization models for identifying unproven cancer treatments on the web. Stud Health Technol Inform 129: 968-972.
7. Aphinyanaphongs Y, Aliferis CF. (2006) Prospective validation of text categorization models for identifying high- quality content-specific articles in PubMed. AMIA 2006 Annual Symposium Proceedings.
8. Aphinyanaphongs Y, Statnikov A, Aliferis CF. (2006) A comparison of citation metrics to machine learning filters for the identification ofhigh quality MEDLINE documents. JAm Med Inform Assoc 13: 446-455.
9. Aphinyanaphongs Y. etal. (2005) Text categorization models for high-quality article retrieval in internal medicine. J. Am. Med. Inform. Assoc., 12, 207-216.
10. Argenziano G, etal. (2003) Dermoscopy of pigmented skin lesions: results of a consensus meeting via the Internet. J Am Acad Dermatol 48: 679-693.
11. Armstrong SA, et al. (2002) MLL translocations specify a distinct gene expression profile that distinguishes a unique leukemia. Nat Genet 30: 41-47.
12. Beer DG, et al. (2002) Gene-expression profiles predict survival of patients with lung adenocarcinoma. Nat Med 8: 816-824.
13. Berrar DP, Dubitzky W, Granzow M. (2003) A practical approach to microarray data analysis. Kluwer Academic Publishers, Boston, MA.
14. Bhattacharjee A, et al. (2001) Classification of human lung carcinomas by mRNA expression profiling reveals distinct adenocarcinoma subclasses. Proc Natl Acad Sci USA 98: 13790-13795.
15. Binder M, et al. (1995) Epiluminescence Microscopy. A Useful Tool for the Diagnosis of Pigmented Skin Lesions for Formally Trained Dermatologists. Archives of Dermatology 131:3 286-291.
16. Braga-Neto UM, Dougherty ER. (2004) Is cross-validation valid for small-sample microarray classification? Bioinformatics 20: 374-380.
17. Breiman L. (2001) Random forests. Machine Learning 45: 5-32.
18. Breiman L. (2003) Manual on setting up, using, and understanding Random Forests v4.0. \ftp://ftp.stat.berkeley. edu/pub/users/breiman/]
19. Bromley J, etal. (2005) Life-threatening interaction between complementary medicines: cyanide toxicity following ingestion of amygdalin and vitamin C. The Annals of pharmacotherapy 39: 1566-1569.
20. Caporaso JG, et al. (2010) QIIME allows analysis of high-throughput community sequencing data. Nat Methods 7: 335-336.
21. Chen X, Zeng X, van Alphen D. (2006) Multi-class feature selection for texture classification. Pattern Recognition Letters 27: 1685-1691.
22. Conrads TP, et al. (2004) High-resolution serum proteomic features for ovarian cancer detection. Endocr Relat Cancer 11: 163-178.
23. Cortes C, et al. (1994) Learning curves: Asymptotic values and rate of convergence. Advances in Neural Information Processing Systems 327.
24. Crammer K, Singer Y. (2000) On the learnability and design of output codes for multiclass problems. Proceedings ofthe Thirteenth Annual Conference on Computational Learning Theory (COLT).
25. DeLong ER, DeLong DM, Clarke-Pearson DL. (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44: 837-845.
26. Demuth H, Beale M. (2001) Neural network toolbox user’s guide. MathworksMatlab user’sguide.
27. Diaz-Uriarte R, Alvarez de Andres S. (2006) Gene selection and classification of microarray data using random forest. BMC Bioinformatics 7: 3.
28. Dietterich TG. (1998) Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation 10: 1895-1923.
29. Duda S, et al. (2005) Extracting drug-drug interaction articles from MEDLINE to improve the content of drug databases. AMIA 2005 Annual Symposium Proceedings 216-220.
30. Dudoit S, Fridlyand J, Speed TP. (2002) Comparison of discrimination methods for the classification of tumors using gene expression data. Journal of the American Statistical Association 97: 77-88.
31. Efron B, Tibshirani R. (1997) Improvements on cross-validation: the.632+ bootstrap method. Journal of the American Statistical Association 92: 548-560.
32. Fan RE, et al. (2008) LIBLINEAR: A library for large linear classification. The Journal of Machine Learning Research 9: 1871-1874.
33. Fawcett T. (2003) ROC Graphs: Notes and Practical Considerations for Researchers. Technical Report, HPL-2003-4, HP Laboratories.
34. Forman G. (2003) An extensive empirical study of feature selection metrics for text classification. The Journal of Machine Learning Research 3: 1289-1305.
35. Foster DP, Stine RA. (2004) Variable SelecioninData Mining: Building a Predictive Model for Bankruptcy. Journal of the American Statistical Association 99: 303-314.
36. Freund Y. (1995) Boosting a weak learning algorithm by majority. Information and computation 121: 256-285.
37. Fu LD, Aliferis CF. (2010) Using content-based and bibliometric features for machine learning models to predict citation counts in the biomedical literature. Scientometrics 85: 257-270.
38. Furey T S, etal. (2000) Support vector machine classification and validation of cancer tissue samples using microarray expression data. Bioinformatics 16: 906-914.
39. Genkin A, Lewis DD, Madigan D. (2004) Large-scale Bayesian logistic regression for text categorization. Technical Report DIMACS.
40. Genkin A, Lewis DD, Madigan D. (2007) Large-scale Bayesian logistic regression for text categorization. Technometrics 49:291-304.
41. Golub TR, et al. (1999) Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286: 531-537.
42. Good PI. (2000) Permutation tests:apracticalguideto resampling methods for testing hypotheses. Springer, New York.
43. Goodman PH. (1996) NevProp software, version 3. Reno, NV: University of Nevada.
44. Guyon I, et al. (2006) Feature extraction: foundations and applications. Springer-Verlag, Berlin.
45. Guyon I, Elisseeff A. (2003) An introduction to variable and feature selection. Journal of Machine Learning Research 3: 1157-1182.
46. Guyon I, et al. (2002) Gene selection for cancer classification using support vector machines. Machine Learning 46: 389-422.
47. Hainer MI, et al. (2000) Fatal hepatorenal failure associated with hydrazine sulfate. Annals of internal medicine 133: 877.
48. Hardin D, Tsamardinos I, Aliferis CF. (2004) A theoretical characterization of linear SVM-based feature selection. Proceedings of the Twenty First International Conference on Machine Learning (ICML).
49. Harrell FE Jr, Lee KL, Mark DB. (1996) Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 15: 361-387.
50. Hastie T, Tibshirani R, Friedman JH. (2001) The elements of statistical learning: data mining, inference, and prediction. Springer, New York.
51. Haynes RB, etal. (1994) Developing optimal search strategies for detecting clinically sound studies in MEDLINE. JAm Med Inform Assoc 1: 447-458.
52. Ho TK, Hull JJ, Srihari SN. (1994) Decision combination in multiple classifier systems. Pattern Analysis and Machine Intelligence, IEEE Transactions on 16: 66-75.
53. Hollander M, Wolfe D. (1999) Nonparametric statistical methods. Wiley, New York, NY, USA.
54. Hsu CW, Lin CJ. (2002) A comparison of methods for multiclass support vector machines. Neural Networks, IEEE Transactions on 13: 415-425.
55. Iizuka N, et al. (2003) Oligonucleotide microarray for prediction of early intrahepatic recurrence of hepatocellular carcinoma after curative resection. Lancet 361: 923-929.
56. Joachims T. (2002) Learning to classify text using support vector machines. Kluwer Academic Publishers, Boston.
57. Kayaalp M, Cooper GF, Clermont G. (2000) Predicting ICU mortality: a comparison of stationary and nonsta- tionary temporal models. Proc AMIA Symp 418-422.
58. Khan J, etal. (2001) Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks. Nat Med 7: 673-679.
59. Knights D, Costello EK, Knight R. (2011) Supervised classification of human microbiota. FEMS Microbiol Rev 35: 343-359.
60. Kohavi R. (1995) A study of cross-validation and bootstrap for accuracy estimation and model selection. Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence (IJCAI) 2: 1137-1145.
61. Kohavi R, John GH. (1997) Wrappers for feature subset selection. Artificial Intelligence 97: 273-324.
62. Kressel U. (1999) Pairwise classification and support vector machines. In: Smola A, etal. (eds), Advances in Kernel Methods: Support Vector Learning. MIT Press, Cambridge, MA, pp. 255-268.
63. Kupferberg N, Jones HL. (2004) Evaluation of five full-text drug databases by pharmacy students, faculty, and librarians: do the groups agree? J Med Libr Assoc 92: 66-71.
64. Leopold E, Kindermann J. (2002) Text categorization with support vector machines. How to represent texts in input space? Machine Learning 46: 423-444.
65. Liaw A, Wiener M. (2002) Classification and regression by randomForest. R News 2: 18-22.
66. Lin CJ, Weng RC, Keerthi SS. (2008) Trust region newton method for logistic regression. The Journal of Machine Learning Research 9: 627-650.
67. Ling C X, Huang J, Zhang H. (2003) AUC: a statistically consistent and more discriminating measure than accuracy. Proceedings of the Eighteenth International Joint Conference of Artificial Intelligence (IJCAI).
68. Lu J, etal. (2002) Classical statistical approaches to molecular classification of cancer from gene expression profiling. Methods of microarray data analysis 97-108.
69. MacRoberts MH, MacRoberts BR. (1996) Problems of citation analysis. Scientometrics 36: 435-444.
70. Mani S, Cooper GF. (1999) A Study in Causal Discovery from Population-Based Infant Birth and Death Records. Proceedings of the AMIA Annual Fall Symposium 319.
71. McCullagh P, Nelder JA. (1989) Generalized linear models. Chapman and Hall, London.
72. Menke J, Martinez TR. (2004) Using permutations instead of student’s t distribution for p-values in paired- difference algorithm comparisons. Proceedings of 2004 IEEE International Joint Conference on Neural Networks 2: 1331-1335.
73. Mercer RE, Di Marco C. (2004) A design methodology for a biomedical literature indexing tool using the rhetoric of science. Proceedings ofBioLink 2004 Workshop on Linking Biological Literature, Ontologies and Databases: Tools for Users 77-84.
74. Mitchell T. (1997) Machine learning. McGraw-Hill, New York, NY, USA.
75. Murthy SK. (1998) Automatic construction of decision trees from data: a multi-disciplinary survey. Data Mining and Knowledge Discovery 2: 345-389.
76. Nachbar F, et al. (1994) The ABCD rule of dermatoscopy. High prospective value in the diagnosis of doubtful melanocytic skin lesions. J Am Acad Dermatol 30: 551-559.
77. Nutt CL, et al. (2003) Gene expression-based classification of malignant gliomas correlates better with survival than histological classification. Cancer Res 63: 1602-1607.
78. Odom DT, et al. (2006) Core transcriptional regulatory circuitry in human hepatocytes. Mol Syst Biol 2: 2006.
79. Page L, et al. (1999) The PageRank citation ranking: Bringing order to the web. Technical Report, Stanford University.
80. Pagnanelli G, et al. (2003) Diagnosis of Pigmented Skin Lesions by Dermoscopy: Web-based Training Improves Diagnostic Performance of Non-experts. British Journal of Dermatology 148:4 698-702.
81. Park J, Sandberg IW. (1991) Universal Approximation Using Radial-Basis-Function Networks. Neural Computation 3:2 246-257.
82. Pehamberger H, Steiner A, Wolff K. (1987) In vivo epiluminescence microscopy of pigmented skin lesions. I. Pattern analysis of pigmented skin lesions. J Am Acad Dermatol 17: 571-583.
83. Phelan TJ. (1999) A compendium ofissues for citation analysis. Scientometrics 45: 117-136.
84. Platt JC. (1999) Probabilistic outputs for support vector machines and comparison to regularized likelihood methods. In: Smola A, etal. (eds), Advances in Large Margin Classifiers. MIT press, Cambridge, MA.
85. Platt JC, Cristianini N, ShaweTaylor J. (2000) Large margin DAGs for multiclass classification. Advances in Neural Information Processing Systems (NIPS) 12: 547-553.
86. Pomeroy SL, et al. (2002) Prediction of central nervous system embryonal tumour outcome based on gene expression. Nature 415: 436-442.
87. Porter MF. (1980) An algorithm for suffix stripping. Program: electronic library and information systems 14: 130-137.
88. Potts AL, et al. (2004) Computerized physician order entry and medication errors in a pediatric critical care unit. Pediatrics 113: 59-63.
89. Ramaswamy S, etal. (2003) A molecular signature of metastasis in primary solid tumors. Nat Genet 33: 49-54.
90. Ramaswamy S. et al. (2001) Multiclass cancer diagnosis using tumor gene expression signatures. Proc Natl Acad Sci USA 98: 15149-15154.
91. Richardson MA, etal. (2000) Complementary/alternative medicine use in a comprehensive cancer center and the implications for oncology. Journal of Clinical Oncology 18: 2505.
92. Rifkin R, et al. (2003) An analytical method for multi-class molecular cancer classification. SIAM Reviews 45: 706-723.
93. Rosenwald A, et al. (2002) The use of molecular profiling to predict survival after chemotherapy for diffuse large-B-cell lymphoma. N Engl J Med 346: 1937-1947.
94. Sboner A, Aliferis CF. (2005) Modeling clinical judgment and implicit guideline compliance in the diagnosis of melanomas using machine learning. AMIA 2005 Annual Symposium Proceedings 664-668.
95. Schapire R. (1999) Theoretical views of boosting and applications. Algorithmic Learning Theory 13-25.
96. Schapire RE, Singer Y. (2000) BoosTexter: A boosting-based system for text categorization. Machine Learning 39: 135-168.
97. Seglen PO. (1998) Citation rates and journal impact factors are not suitable for evaluation of research. Acta Orthopaedica Scandinavica 69: 224.
98. Sharkey AJC. (1996) On combining artificial neural nets. Connection Science 8: 299-314.
99. Shipp MA, et al. (2002) Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning. Nat Med 8: 68-74.
100. Sindhwani V, Bhattacharyya P, Rakshit S. (2001) Information Theoretic Feature Crediting in Multiclass Support Vector Machines. Proceedings of the First SIAM International Conference on Data Mining.
101. Singh D, et al. (2002) Gene expression correlates of clinical prostate cancer behavior. Cancer Cell 1: 203-209.
102. Sparreboom A, et al. (2004) Herbal remedies in the United States: potential adverse interactions with anticancer agents. Journal of Clinical Oncology 22: 2489-2503.
103. Specht DF. (1990) Probabilistic neural networks. Neural Networks 3: 109-118.
104. Spirtes P, Glymour CN, Scheines R. (2000) Causation, prediction, and search. MIT Press, Cambridge, Mass.
105. Statnikov A, Wang L, Aliferis CF. (2008) A comprehensive comparison of random forests and support vector machines for microarray-based cancer classification. BMC Bioinformatics 9: 319.
106. Statnikov A, etal. (2005) A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis. Bioinformatics 21: 631-643.
107. Statnikov A, Hardin D, Aliferis CF. (2006) Using SVM weight-based methods to identify causally relevant and non-causally relevant variables. Proceedings of the NIPS 2006 Workshop on Causality and Feature Selection.
108. Staunton JE, et al. (2001) Chemosensitivity prediction by transcriptional profiling. Proc Natl Acad Sci USA 98: 10787-10792.
109. Su AI, et al. (2001) Molecular classification of human carcinomas by use of gene expression signatures. Cancer Res 61: 7388-7393.
110. Teufel S, Siddharthan A, Tidhar D. (2006) Automatic classification of citation function. Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing 103-110.
111. Tsamardinos I, Aliferis CF. (2003) Towards principled feature selection: relevancy, filters and wrappers. Proceedings of the Ninth International Workshop on Artificial Intelligence and Statistics (AI & Stats).
112. Tsamardinos I, Aliferis CF, Statnikov A. (2003) Time and sample efficient discovery of Markov blankets and direct causal relations. Proceedings of the Ninth International Conference on Knowledge Discovery and Data Mining (KDD) 673-678.
113. Valentini G, Muselli M, Ruffino F. (2003) Bagged ensembles of support vector machines for gene expression data analysis. IEEE pp. 1844-1849.
114. van’t Veer LJ, et al. (2002) Gene expression profiling predicts clinical outcome of breast cancer. Nature 415: 530-536.
115. Vapnik VN, (1998) Statistical learning theory. Wiley, New York.
116. Wang Y, etal. (2005) Gene-expression profiles to predict distant metastasis oflymph-node-negative primary breast cancer. Lancet 365: 671-679.
117. Weston J, Watkins C. (1999) Support vector machines for multi-class pattern recognition. Proceedings of the Seventh European Symposium On Artificial Neural Networks 4: 6.
118. Wouters L, et al. (2003) Graphical exploration of gene expression data: a comparative study of three multivariate methods. Biometrics 59: 1131-1139.
119. Yeoh EJ, etal. (2002) Classification, subtype discovery, and prediction of outcome in pediatric acute lymphoblastic leukemia by gene expression profiling. Cancer Cell 1: 133-143.
120. Zimmerman LJ, et al. (2009a) Development of Metrics for Assessment of Plasma Quality. 57th ASMS Conference on Mass Spectrometry and Allied Topics.
121. Zimmerman LJ, etal. (2009b) Assessment of Plasma Proteome Stability. Clinical Proteomic Technologies for Cancer 2009 Annual Meeting.