Support Vector Feature Selection for Early Detection of Anastomosis Leakage from Bag-of-Words in Electronic Health Records

IEEE Journal of Biomedical and Health Informatics

Volumn 20, Issue 5, 2016, Pages 1404-1415

  Soguero Ruiz, Cristina ^a   Hindberg, Kristian ^b   Rojo Alvarez, Jose Luis ^a,c   Skrovseth, Stein Olav ^d,e   Godtliebsen, Fred ^b   Mortensen, Kim ^b,d   Revhaug, Arthur ^d   Lindsetmo, Rolv Ole ^b,d   Augestad, Knut Magne ^b,d,f   Jenssen, Robert ^b,d  

^a UNIVERSIDAD REY JUAN CARLOS   (Spain)

^b UNIVERSITY OF TROMSØ   (Norway)

^c UNIVERSIDAD DE LAS FUERZAS ARMADAS ESPE   (Ecuador)

^d UNIVERSITY HOSPITAL OF NORTH NORWAY   (Norway)

^e IBM T J WATSON RESEARCH CENTER   (United States)

^f UNIVERSITY HOSPITALS OF CLEVELAND   (United States)

Author keywords

Anastomosis leakage (AL); bag of words (BoWs); colorectal cancer (CRC); early detection; electronic health record (EHR); feature selection (FS); kernel entropy; support vector machine (SVM)

Indexed keywords

DECISION MAKING; DISEASES; ENTROPY; INFORMATION RETRIEVAL; LEARNING SYSTEMS; PREDICTIVE ANALYTICS; RECORDS MANAGEMENT; SUPPORT VECTOR MACHINES; SURGERY;

ANASTOMOSIS LEAKAGE (AL); BAG-OF-WORDS (BOWS); COLORECTAL CANCERS (CRC); ELECTRONIC HEALTH RECORD; ELECTRONIC HEALTH RECORD (EHRS); MACHINE LEARNING TECHNIQUES; STATISTICAL CRITERION; SUPPORT VECTOR FEATURE SELECTIONS;

FEATURE EXTRACTION;

ALGORITHM; ANASTOMOSIS LEAKAGE; ARTICLE; BAYESIAN LEARNING; BOOTSTRAPPING; COLORECTAL CANCER; CONFIDENCE INTERVAL; DECISION SUPPORT SYSTEM; ELECTRONIC MEDICAL RECORD; ENTROPY; HUMAN; MATHEMATICAL COMPUTING; PERFORMANCE; RECTUM ABDOMINOPERINEAL RESECTION; SUPPORT VECTOR MACHINE; TRAINING; CLUSTER ANALYSIS; COLORECTAL TUMOR; ELECTRONIC HEALTH RECORD; MEDICAL INFORMATICS; PROCEDURES;

ANASTOMOTIC LEAK; CLUSTER ANALYSIS; COLORECTAL NEOPLASMS; ELECTRONIC HEALTH RECORDS; HUMANS; MEDICAL INFORMATICS; SUPPORT VECTOR MACHINE;

EID: 84986608457     PISSN: 21682194     EISSN: 21682208     Source Type: Journal    
DOI: 10.1109/JBHI.2014.2361688     Document Type: Article

References (51)

1. J. Rodrigues Ed., Health Information Systems: Concepts, Methodologies, Tools, and Applications. New York, NY, USA: IGI Global, 2010.
2. S. Garde, P. Knaup, E. J. S. Hovenga, and S. Heard, "Towards semantic interoperability for electronic health records: Domain knowledge governance for openEHR archetypes," Method Inf. Med., vol. 46, no. 3, pp. 332-343, 2007.
3. J. M. Buckley, S. B. Coopey, J. Sharko, F. Polubriaginof, B. Drohan, A. K. Belli, E. M. H. Kim, J. E. Garber, B. L. Smith, M. A. Gadd, M. C. Specht, C. A. Roche, T. M. Gudewicz, and K. S. Hughes, "The feasibility of using natural language processing to extract clinical information from breast pathology reports," J. Pathol. Informat., vol. 3, no. 23, pp. 1-7, 2012.
4. Y. Wang, Z. Yua, Y. Jiangb, Y. Liuc, L. Chena, and Y. Liua, "A framework and its empirical study of automatic diagnosis of traditional chinese medicine utilizing raw free-text clinical records," J. Biomed. Informat., vol. 45, no. 2, pp. 210-223, 2012.
5. A. Wright, A. B. McCoy, S. Henkin, A. Kale, and D. F. Sittig, "Use of a support vector machine for categorizing free-text notes: Assessment of accuracy across two institutions," J. Amer. Med. Inf. Assoc., vol. 20, no. 5, pp. 887-890, 2013.
6. Z. Afzal, M. Engelkes, K. M. Verhamme, H. M. Janssens, M. C. Sturkenboom, J. A. Kors, and M. J. Schuemie, "Automatic generation of casedetection algorithms to identify children with asthma from large electronic health record databases," Pharmacoepidemiol. Drug Safety, vol. 22, no. 8, pp. 826-833, 2013.
7. Z. Wang, A. D. Shah,A. R Tate, S. Denaxas, J. Shawe-Taylor, and H. Hemingway, "Extracting diagnoses and investigation results from unstructured text in electronic health records by semi-supervised machine learning," PLoS One, vol. 7, no. 1, pp. 1-9, 2012.
8. R. Cobb, S. Puri, D. Zhe Wang, T. Baslanti, and A. Bihorac, "Knowledge extraction and outcome prediction using medical notes," presented at the Int. Conf. RoleMach. Learn. Transforming Healthcare, Atlanta, GA, USA, 2013.
9. P. M. Nadkarni, L. Ohno-Machado, and W. W. Chapman, "Natural language processing: An introduction," J. Amer. Med. Inf. Assoc., vol. 18, pp. 544-551, 2011.
10. S. M. Meystre, G. K. Savova, K. C. Kipper-Schule, and J. F. Hurdle, "Extracting information from textual documents in the electronic health record: A review of recent research," Yearbook Med. Informat., vol. 3, pp. 128-144, 2008.
11. I. K. Larsen, Cancer in Norway 2011-Cancer incidence, mortality, survival and prevalence in Norway. Cancer Registry of Norway,Oslo: Cancer Registry of Norway, 2013.
12. H. Kehlet, "Fast-track colorectal surgery," Lancet, vol. 371, no. 9615, pp. 791-793, 2008.
13. H. S. Snijders, D. Henneman, N. L. van Leersum, M. TenBerge,M. Fiocco, T. M. Karsten, K. Havenga, T. Wiggers, J. W. Dekker, R. A. Tollenaar, and M. W. Wouters, "Anastomotic leakage as an outcome measure for quality of colorectal cancer surgery," BMJ Quality Safety, vol. 22, no. 9, pp. 759-767, 2013.
14. N. A. Hirst, J. P. Tiernan, P. A. Millner, and D. G. Jayne, "Systematic review of methods to predict and detect anastomotic leakage in colorectal surgery," Colorectal Dis., vol. 16, pp. 95-109, 2014.
15. A. Karliczek, N. J. Harlaar, C. J. Zeebregts, T. Wiggers, P. C. Baas, and G. M. van Dam, "Surgeons lack predictive accuracy for anastomotic leakage in gastrointestinal surgery," Int. J. Colorectal Dis., vol. 24, no. 5, pp. 569-576, 2009.
16. J. W. Dekker, G. J. Liefers, J. C. de Mol van Otterloo, H. Putter, and R. A. Tollenaar, "Predicting the risk of anastomotic leakage in left-sided colorectal surgery using a colon leakage score," J. Surg. Res., vol. 166, no. 1, pp. e27-e34, 2011.
17. G. Hughes, "On the mean accuracy of statistical pattern recognition," IEEE Trans. Inf. Theory, vol. 14, no. 1, pp. 55-63, Jan. 1968.
18. K. Fukunaga, "Effect of sample size in classifier design," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 8, pp. 873-885, Aug. 1989.
19. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik, "Gene selection for cancer classification using support vector machines," Mach. Learn., vol. 46, no. 1, pp. 389-422, 2002.
20. M. Khalilia, S. Chakraborty, and M. Popescu, "Predicting disease risks from highly imbalanced data using random forest," BMC Med. Informat. Decision Making, vol. 11, no. 51, pp. 1-13, 2011.
21. J. Peacock and P. Peacock, Oxford Handbook of Medical Statistics. Oxford, U. K.: Oxford Univ. Press, 2010.
22. V. Vapnik, Statistical Learning Theory. NewYork,NY, USA:Wiley, 1998.
23. B. Schölkopf and A. J. Smola, Learning With Kernels. Cambridge, MA, USA: MIT Press, 2002.
24. B. Schölkopf, A. J. Smola, R. C. Williamson, and P. L. Bartlett, "New support vector algorithms," Neural Comput., vol. 12, no. 5, pp. 1207-1245, 2000.
25. R. A. Fisher, "The use of multiple measurements in taxonomic problems," Ann. Eugen, vol. 7, pp. 179-188, 1936.
26. T. Mitchell, Machine Learning. Boston, MA, USA: McGraw-Hill, 1997.
27. P. Domingos and M. Pazzani, "On the optimality of the simple Bayesian classifier under zero-one loss," Mach. Learn., vol. 129, pp. 103-130, 1997.
28. N. Friedman, D. Geiger, and M. Goldszmidt, "Bayesian network classifiers," Mach. Learn., vol. 29, pp. 131-163, 1997.
29. H. He and E. A. Garcia, "Learning from imbalanced data," IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1263-1284, Sep. 2009.
30. R. Kohavi and G. H. John, "Wrappers for feature subset selection," Artif. Intell., vol. 97, pp. 273-324, 1997.
31. I. Guyon, S. Gunn, M. Nikravesh, and L. A. Zadeh Eds., Feature Extraction: Foundations and Applications. Heidelberg, Germany: Springer, 2006.
32. P. Pavlidis, J. Cai, J. Wetson, andW. N. Grundy, "Gene functional analysis from heterogeneous data," in Proc. 5th Int. Conf. Comput. Mol. Biol., Montreal, QC, Canada, 2000, pp. 242-248.
33. J. Brank, M. Grobelnik, N. Mili-Frayling, and D. Mladeni, "Feature selection using support vector machines," in Proc. 3rd Int. Conf. Data Mining Methods Databases Eng., Finance, Fields, Bologna, Italy, 2002, pp. 84-89.
34. Y. Yang and J. O. Pedersen, "A comparative study on feature selection in text categorization," in Proc. 14th Int. Conf. Mach. Learn., San Francisco, CA, USA, 1997, pp. 412-320.
35. D. Mladenic and M. Grobelnik, "Feature selection for unbalanced class distribution and Naive Bayes," in Proc. 16th Int. Conf. Mach. Learn., Bled, Slovenia, 1999, pp. 258-267.
36. G. Forman, "An experimental study of feature selection metrics for text categorization," J. Mach. Learn. Res., vol. 3, pp. 1289-1305, 2003.
37. G. C. Cawley and N. L. C Talbot, "Fast exact leave-one-out crossvalidation of sparse least-squares support vector machines," Neural Netw., vol. 17, pp. 1467-1475, 2004.
38. B. Efron, "Bootstrap methods: Another look at the jackknife," Ann. Statist., vol. 7, no. 1, pp. 1-26, 1979.
39. A. Renyi, "Onmeasures of entropy and information," in Proc. 4th Berkeley Symp. Math. Statist. Probability, 1960, pp. 547-561.
40. R. Jenssen, "Kernel entropy component analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 5, pp. 847-860, May 2010.
41. J. Shawe-Taylor and N. Cristianini Eds., Kernel Methods for Pattern Analysis. Cambridge, U. K.: Cambridge Univ. Press, 2004.
42. T. Joachims, "Text categorization with support vector machines: Learning with many relevant features," in Proc. Eur. Conf. Mach. Learn.,Chemnitz, Germany, 1998, vol. 1398, pp. 137-142.
43. H. Drucker, D. Wu, and V. N. Vapnik, "Support vector machines for spam categorization," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1048-1054, Sep. 1999.
44. E. Leopold and J. Kindermann, "Text categorization with support vector machines. How to represent texts in input space?" Mach. Learn., vol. 46, pp. 423-444, 2002.
45. A. B. A. Graf, A. J. Smola, and S. Borer, "Classification in a normalized feature space using support vector machines," IEEE Trans. Neural Netw. Learn Syst., vol. 14, no. 3, pp. 597-605, May 2003.
46. G. Salton and C. Buckley, "Term-weighting approaches in automatic text retrieval," Inf. Process. Manag., vol. 24, no. 5, pp. 513-523, 1988.
47. C. Soguero-Ruiz, F. J. Gimeno-Blanes, I. Mora-Jiménez, M. P. Mart?nez-Ruiz, and J. L. Rojo-Á lvarez, "On the differential benchmarking of promotional efficiency with machine learning modeling (I): Principles and statistical comparison," Expert Syst. Appl., vol. 39, no. 17, pp. 12772-12783, 2012.
48. B. W. Silverman, Density Estimation for Statistics and Data Analysis. London, U. K.: Chapman & Hall CRC, 1986.
49. C. Shivade, P. Raghava, E. Fosler-Lussier, P. J. Embi, N. Elhadad, S. B. Johnson, and A. M. Lai, "A review of approaches to identifying patient phenotype cohorts using electronic health records," J. Amer. Med. Informat. Assoc., vol. 21, no. 2, pp. 221-230, 2014.
50. C. Paxton, A. Niculasci-Mizi, and S. Saria, "Developing predictive models using electronic medical records: Challenges and pitfalls," Amer. Med. Informat. Assoc. Annu. Symp., 2013, no. 2, pp. 1109-1115.
51. UMLS Reference Manual, National Library of Medicine (U. S.), Bethesda, MD, USA, 2009.