Improving the Mann-Whitney statistical test for feature selection: An approach in breast cancer diagnosis on mammography

Artificial Intelligence in Medicine

Volumn 63, Issue 1, 2015, Pages 19-31

  Pérez, Noel Pérez ^a   Guevara López, Miguel A ^a,b   Silva, Augusto ^b   Ramos, Isabel ^c  

^a UNIVERSITY OF PORTO   (Portugal)

^b UNIVERSITY OF AVEIRO   (Portugal)

^c Universidade do Porto   (Portugal)

Author keywords

Breast cancer CADx; Feature selection methods; Machine learning algorithms; Mann Whitney U test; Redundancy analysis; UFilter method

Indexed keywords

ARTIFICIAL INTELLIGENCE; BACKPROPAGATION; BACKPROPAGATION ALGORITHMS; COMPUTER AIDED DIAGNOSIS; COST EFFECTIVENESS; DISCRIMINANT ANALYSIS; DISEASES; FEATURE EXTRACTION; IMAGE RETRIEVAL; LEARNING ALGORITHMS; LEARNING SYSTEMS; NEURAL NETWORKS; REDUNDANCY; STATISTICAL TESTS; TESTING;

BREAST CANCER; FEATURE SELECTION METHODS; MANN-WHITNEY U TEST; REDUNDANCY ANALYSIS; UFILTER METHOD;

CLASSIFICATION (OF INFORMATION);

ARTICLE; ARTIFICIAL NEURAL NETWORK; BREAST CANCER; CANCER DIAGNOSIS; COMPUTER ASSISTED DIAGNOSIS; HUMAN; MACHINE LEARNING; MAMMOGRAPHY; PRIORITY JOURNAL; RANK SUM TEST; REDUNDANCY ANALYSIS; SUPPORT VECTOR MACHINE; ALGORITHM; BAYES THEOREM; BREAST TUMOR; CHI SQUARE DISTRIBUTION; COMPARATIVE STUDY; DISCRIMINANT ANALYSIS; EVALUATION STUDY; FACTUAL DATABASE; FEMALE; PREDICTIVE VALUE; PROCEDURES; RADIOGRAPHY; REPRODUCIBILITY; STATISTICAL MODEL;

ALGORITHMS; BAYES THEOREM; BREAST NEOPLASMS; CHI-SQUARE DISTRIBUTION; DATABASES, FACTUAL; DIAGNOSIS, COMPUTER-ASSISTED; DISCRIMINANT ANALYSIS; FEMALE; HUMANS; LINEAR MODELS; MACHINE LEARNING; MAMMOGRAPHY; MODELS, STATISTICAL; PREDICTIVE VALUE OF TESTS; RADIOGRAPHIC IMAGE INTERPRETATION, COMPUTER-ASSISTED; REPRODUCIBILITY OF RESULTS;

EID: 84923943411     PISSN: 09333657     EISSN: 18732860     Source Type: Journal    
DOI: 10.1016/j.artmed.2014.12.004     Document Type: Article

References (71)

1. Devijver P.A., Kittler J. Pattern recognition: a statistical approach 1982, Prentice/Hall International, London, UK.
2. Guyon I., Elisseeff A. An introduction to feature extraction. Feature extraction 2006, vol. 207:1-25. Springer Berlin/Heidelberg. 10.1007/978-3-540-35488-8_1.
3. Blanco M., Coello J., Iturriaga H., Maspoch S., de la Pezuela C. Near-infrared spectroscopy in the pharmaceutical industry. Analyst 1998, 123:135R-150R. 10.1039/a802531b.
4. Koehn F.E., Carter G.T. The evolving role of natural products in drug discovery. Nat Rev Drug Discov 2005, 4:206-220. 10.1038/nrd1657.
5. Hashemi H., Tax D.M.J., Duin R.P.W., Javaherian A., de Groot P. Gas chimney detection based on improving the performance of combined multilayer perceptron and support vector classifier. Nonlinear Process Geophys 2008, 15:863-871. 10.5194/npg-15-863-2008.
6. Kaifeng Y., Wenkai L., Wenlong D., Shanwen Z., Huanqin X., Yanda L. Hydrocarbon prediction method based on Svm feature selection. Nat Gas Ind 2004, 24:36-38.
7. Chanwoo K., Stern R.M. Feature extraction for robust speech recognition based on maximizing the sharpness of the power distribution and on power flooring. 2010 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP) 2010, 4574-4577. 10.1109/ICASSP.2010.5495570.
8. Pei Y., Essa I., Starner T., Rehg J.M. Discriminative feature selection for hidden Markov models using Segmental Boosting. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2008) 2008, 2001-2004. 10.1109/ICASSP.2008.4518031.
9. Guyon I., Elisseeff A. An introduction to variable and feature selection. J Mach Learn Res 2003, 3:1157-1182.
10. Yu L., Liu H. Efficient feature selection via analysis of relevance and redundancy. J Mach Learn Res 2004, 5:1205-1224.
11. Holmberg M., Gustafsson F., Hornsten E.G., Winquist F., Nilsson L.E., Ljung L., et al. Bacteria classification based on feature extraction from sensor data. Biotechnol Tech 1998, 12:319-324. 10.1023/A:1008862617082.
12. Dutta R., Hines E.L., Gardner J.W., Boilot P. Bacteria classification using Cyranose 320 electronic nose. BioMed Eng Online 2002, 1:4. 10.1186/1475-925x-1-4.
13. López Y., Novoa A., Guevara M., Silva A. Breast cancer diagnosis based on a suitable combination of deformable models and artificial neural networks techniques. Progress in pattern recognition image analysis and applications 2008, vol. 4756/2008:803-811. Springer, Berlin/Heidelberg. 10.1007/978-3-540-76725-1_83.
14. Ghazavi S.N., Liao T.W. Medical data mining by fuzzy modeling with selected features. Artif Intell Med 2008, 43:195-206. 10.1016/j.artmed.2008.04.004.
15. Soltanian-Zadeh H., Rafiee-Rad F., Pourabdollah-Nejad S.D. Comparison of multiwavelet, wavelet, haralick, and shape features for microcalcification classification in mammograms. Pattern Recognit 2004, 37:1973-1986. 10.1016/j.patcog.2003.03.001.
16. Wei J., Sahiner B., Hadjiiski L.M., Chan H.-P., Petrick N., Helvie M.A., et al. Computer-aided detection of breast masses on full field digital mammograms. Med Phys 2005, 32:2827-2838. 10.1118/1.1997327.
17. Lee S.K., Chung P.C., Chang C.I., Lo C.S., Lee T., Hsu G.C., et al. Classification of clustered microcalcifications using a Shape Cognitron neural network. Neural Netw 2003, 16:121-132. 10.1016/S0893-6080(02)00164-8.
18. Saeys Y., Inza I., Larranaga P. A review of feature selection techniques in bioinformatics. Bioinformatics 2007, 23:2507-2517. 10.1093/bioinformatics/btm344.
19. Setiono R., Liu H. CHI2: feature selection and discretization of numeric attributes. IEEE Proceedings of the Seventh International Conference on Tools with Artificial Intelligence 1995, 388-391. 10.1109/TAI.1995.479783.
20. Liu H., Li J., Wong L. A comparative study on feature selection and classification methods using gene expression profiles and proteomic patterns. Genome Inform 2002, 13:51-60.
21. Press W.H., Flannery B.P., Teukolsky S.A., Vetterling W.T. Numerical recipes in C 1988, Cambridge University Press, Cambridge.
22. Jain A.K., Chandrasekaran B. 39 Dimensionality and sample size considerations in pattern recognition practice. Handbook of statistics 1982, vol. 2:835-855. Elsevier. 10.1016/S0169-7161(82)02042-2.
23. Hall M.A., Smith L.A. Feature selection for machine learning: comparing a correlation-based filter approach to the wrapper. Proceedings of the Twelfth International Florida Artificial Intelligence Research Society Conference 1999.
24. Koller D., Sahami M. Toward optimal feature selection 1996, Stanford InfoLab, Technical report 1996-77.
25. Kira K., Rendell L.A. A practical approach to feature selection. ML92 Proceedings of the ninth international workshop on Machine learning 1992, 249-256. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA. D. Sleeman, P. Edwards (Eds.).
26. Prados J., Kalousis A., Sanchez J.C., Allard L., Carrette O., Hilario M. Mining mass spectra for diagnosis and biomarker discovery of cerebral accidents. Proteomics 2004, 4:2320-2332. 10.1002/pmic.200400857.
27. Kirk R.E. Statistics: an introduction 2007, Thomson/Wadsworth, Belmont, CA, USA. fifth ed.
28. Ramos-Pollan R., Guevara-Lopez M.A., Suarez-Ortega C., Diaz-Herrero G., Franco-Valiente J.M., Rubio-Del-Solar M., et al. Discovering mammography-based machine learning classifiers for breast cancer diagnosis. J Med Syst 2012, 36:2259-2269. 10.1007/s10916-011-9693-2.
29. Breast cancer digital repository 2014, http://bcdr.inegi.up.pt/ [accessed 02.01.14].
30. de Oliveira J.E., Machado A.M., Chavez G.C., Lopes A.P., Deserno T.M., Araujo Ade A. MammoSys: a content-based image retrieval system using breast density patterns. Comput Methods Progr Biomed 2010, 99:289-297. 10.1016/j.cmpb.2010.01.005.
31. Heath M., Bowyer K., Kopans D., Moore R., Kegelmeyer W.P. The digital database for screening mammography. Proceedings of the Fifth International Workshop on Digital Mammography 2001, 212-218. Medical Physics Publishing. M.J. Yaffe (Ed.).
32. Committee American College of Radiology (ACR) ACR BIRADS - mammography. ACR breast imaging reporting and data system, breast imaging atlas 2003, American College of Radiology, Reston, VA. A.C.o. Radiology (Ed.).
33. Haralick R.M., Shanmuga K., Dinstein I. Textural features for image classification. IEEE Trans Syst Man Cybern 1973, Smc3:610-621. 10.1109/Tsmc.1973.4309314.
34. López Y., Novoa A., Guevara M., Quintana N., Silva A. Computer aided diagnosis system to detect breast cancer pathological lesions. Progress in pattern recognition, image analysis and applications 2008, vol. 5197:453-460. Springer Berlin/Heidelberg. 10.1007/978-3-540-85920-8_56.
35. Dash M., Liu H. Feature selection for classification. Intell Data Anal 1997, 1:131-156. 10.3233/IDA-1997-1302.
36. Holte R.C. Very simple classification rules perform well on most commonly used datasets. Mach Learn 1993, 11:63-91. 10.1023/A:1022631118932.
37. Malar E., Kandaswamy A., Chakravarthy D., Giri Dharan A. A novel approach for detection and classification of mammographic microcalcifications using wavelet analysis and extreme learning machine. Comput Biol Med 2012, 42:898-905. 10.1016/j.compbiomed.2012.07.001.
38. Verma B., Panchal R. Neural networks for the classification of benign and malignant patters in digital mammograms. Intelligent information technologies: concepts, methodologies, tools, and applications 2008, 947-967. IGI Global, Hershey, NY, USA. 10.4018/978-1-59904-941-0.ch056. V. Sugumaran (Ed.).
39. Bellotti R., De Carlo F., Tangaro S., Gargano G., Maggipinto G., Castellano M., et al. A completely automated CAD system for mass detection in a large mammographic database. Med Phys 2006, 33:3066-3075.
40. Papadopoulos A., Fotiadis D.I., Likas A. Characterization of clustered microcalcifications in digitized mammograms using neural networks and support vector machines. Artif Intell Med 2005, 34:141-150. 10.1016/j.artmed.2004.10.001.
41. Pérez N., Guevara M.A., Silva A., Ramos I., Loureiro J. Improving the performance of machine learning classifiers for Breast Cancer diagnosis based on feature selection. IEEE 2014 Federated Conference on Computer Science and Information Systems (FedCSIS) 2014, 209-217. 10.15439/2014F249. M. Ganzha, L. Maciaszek, M. Paprzycki (Eds.).
42. Pérez N., Guevara M.A., Silva A. Improving breast cancer classification with mammography, supported on an appropriate variable selection analysis. SPIE medical imaging 2013 2013, 867022-1-867022-14. International Society for Optics and Photonics, Lake Buena Vista (Orlando Area), Florida, USA. 10.1117/12.2007912. C.L. Novak, S. Aylward (Eds.).
43. Ping Z., Verma B., Kuldeep K. A neural-genetic algorithm for feature selection and breast abnormality classification in digital mammography. IEEE International Joint Conference on Neural Networks, vol. 3 2004, 2303-2308. 10.1109/IJCNN.2004.1380985.
44. Mavroforakis M.E., Georgiou H.V., Dimitropoulos N., Cavouras D., Theodoridis S. Mammographic masses characterization based on localized texture and dataset fractal analysis using linear, neural and support vector machine classifiers. Artif Intell Med 2006, 37:145-162. 10.1016/j.artmed.2006.03.002.
45. Pérez N., Guevara M.A., Silva A. Evaluation of features selection methods for breast cancer classification. 15th International Conference on Experimental Mechanics (ICEM15) 2012, Porto, Portugal. J. Silva, M. Vaz (Eds.).
46. Fu J.C., Lee S.K., Wong S.T., Yeh J.Y., Wang A.H., Wu H.K. Image segmentation feature selection and pattern classification for mammographic microcalcifications. Comput Med Imaging Graphics 2005, 29:419-429. 10.1016/j.compmedimag.2005.03.002.
47. Shi J., Sahiner B., Chan H.P., Ge J., Hadjiiski L., Helvie M.A., et al. Characterization of mammographic masses based on level set segmentation with new image features and patient information. Med Phys 2008, 35:280-290. 10.1118/1.2820630.
48. Jesneck J.L., Lo J.Y., Baker J.A. Breast mass lesions: computer-aided diagnosis models with mammographic and sonographic descriptors. Radiology 2007, 244:390-398. 10.1148/radiol.2442060712.
49. Gupta S., Chyn P.F., Markey M.K. Breast cancer CADx based on BI-RAds descriptors from two mammographic views. Med Phys 2006, 33:1810-1817.
50. Catarious D.M., Baydush A.H., Floyd C.E. Incorporation of an iterative, linear segmentation routine into a mammographic mass CAD system. Med Phys 2004, 31:1512-1520.
51. Moura D., Guevara López M. An evaluation of image descriptors combined with clinical data for breast cancer diagnosis. Int J Comput Assist Radiol Surg 2013, 8:561-574. 10.1007/s11548-013-0838-2.
52. Salama G.I., Abdelhalim M., Zeid M.A.-e. Breast cancer diagnosis on three different datasets using multi-classifiers. Breast Cancer (WDBC) 2012, 32:2.
53. Christobel A. An empirical comparison of data mining classification methods. Int J Comput Inf Syst 2011, 3(2):24-28.
54. Kim M., Ryu J. Optimized fuzzy classification using genetic algorithm. Fuzzy systems and knowledge discovery 2005, vol. 3613:392-401. Springer Berlin Heidelberg. 10.1007/11539506_51.
55. Abonyi J., Szeifert F. Supervised fuzzy clustering for the identification of fuzzy classifiers. Pattern Recognit Lett 2003, 24:2195-2207. 10.1016/S0167-8655(03)00047-3.
56. Xu W., Xia S., Xie H. Application of CMAC-based networks on medical image classification. Advances in neural networks - ISNN 2004 2004, vol. 3173:953-958. Springer Berlin Heidelberg. 10.1007/978-3-540-28647-9_157.
57. Song H., Lee S., Kim D., Park G. New methodology of computer aided diagnostic system on breast cancer. Advances in neural networks - ISNN 2005 2005, vol. 3498:780-789. Springer Berlin Heidelberg. 10.1007/11427469_124.
58. Hall M., Frank E., Holmes G., Pfahringer B., Reutemann P., Witten I.H. The WEKA data mining software: an update. ACM SIGKDD Explor Newslett 2009, 11:10-18. 10.1145/1656274.1656278.
59. García López F., García Torres M., Melián Batista B., Moreno Pérez J.A., Moreno-Vega J.M. Solving feature subset selection problem by a Parallel Scatter Search. Eur J Oper Res 2006, 169:477-489. 10.1016/j.ejor.2004.08.010.
60. Hwang J.-N. Introduction to neural networks for signal processing. Handbook of neural network signal processing 2001, 408. CRC Press, Boca Raton, Florida, USA. Y.H. Hu, J.-N. Hwang (Eds.).
61. Duda R.O., Hart P.E., Stork D.G. Pattern classification 2000, Wiley-Interscience, New York, NY, USA. 2nd ed.
62. Wang S., Summers R.M. Machine learning and radiology. Med Image Anal 2012, 16:933-951. 10.1016/j.media.2012.02.005.
63. Estimating data parameters applied statistics using SPSS, STATISTICA, MATLAB and R 2007, 81-109. Springer Berlin/Heidelberg. 10.1007/978-3-540-71972-4_3. J.P. Marques de Sá (Ed.).
64. Hastie T., Tibshirani R., Friedman J., Franklin J. The elements of statistical learning: data mining, inference and prediction. Math Intell 2005, 27:83-85.
65. Mann H.B., Whitney D.R. On a test of whether one of two random variables is stochastically larger than the other. Ann Math Stat 1947, 18:50-60. 10.1214/aoms/1177730491.
66. Demsar J. Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 2006, 7:1-30.
67. Gibbons J., Chakraborti S. Nonparametric statistical inference. International encyclopedia of statistical science 2011, 977-979. Springer Berlin Heidelberg. 10.1007/978-3-642-04898-2_420. M. Lovric (Ed.).
68. John G.H., Kohavi R., Pfleger K. Irrelevant features and the subset selection problem. Machine Learning, Proceedings of the Eleventh International Conference 1994, 121-129. Morgan Kaufmann, Rutgers University, New Brunswick, NJ, USA. W.W. Cohen, H. Hirsh (Eds.).
69. Hollander M., Wolfe D. Nonparametric statistical methods 2013, John Wiley & Sons, Hoboken, New Jersey, USA. 3rd ed.
70. AbuBaker A., Qahwaji R., Ipson S. Texture-based feature extraction for the microcalcification from digital mammogram images. IEEE International Conference on Signal Processing and Communications (ICSPC 2007) 2007, 896-899. 10.1109/ICSPC.2007.4728464.
71. Mohanty A., Senapati M., Lenka S. An improved data mining technique for classification and detection of breast cancer from mammograms. Neural Comput Appl 2013, 22:303-310. 10.1007/s00521-012-0834-4.