Improving classifications for cardiac autonomic neuropathy using multi-level ensemble classifiers and feature selection based on random forest

Conferences in Research and Practice in Information Technology Series

Volumn 134, Issue , 2012, Pages 93-101

  Kelarev, A V ^a,b   Stranieri, A ^a   Yearwood, J L ^a   Abawajy, J ^b   Jelinek, H F ^c  

^a UNIVERSITY OF BALLARAT   (Australia)

^b DEAKIN UNIVERSITY   (Australia)

^c CHARLES STURT UNIVERSITY   (Australia)

Author keywords

Cardiac autonomic neuropathy; Ensembles of ensembles; Feature selection; Meta classifiers; Multi level ensembles; Random Forest

Indexed keywords

DATA MINING; DATABASE SYSTEMS; DECISION TREES; FEATURE EXTRACTION; HEART;

CARDIAC AUTONOMIC NEUROPATHY; ENSEMBLES OF ENSEMBLES; META-CLASSIFIERS; MULTILEVELS; RANDOM FORESTS;

CLASSIFICATION (OF INFORMATION);

EID: 84962808640     PISSN: 14451336     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (55)

1. Al-Oqaily, A., Kennedy, P., Catchpoole, D. & Simoff, S. (2008), Comparison of visualization methods of genome-wide SNP profiles in childhood acute lymphoblastic leukaemia, in J. Roddick, J. Li, P. Christen & P. Kennedy, eds, 'Data Mining and Analytics 2008, Proceedings of the Seventh Australasian Data Mining Conference, AusDM 2008', Vol. 87 of CRPIT, ACS, Glenelg, South Australia, pp. 111-121.
2. Bauer, E. & Kohavi, R. (1999), 'An empirical comparison of voting classification algorithms: Bagging, boosting, and variants', Machine Learning 36, 105-139.
3. Breiman, L. (1996), 'Bagging predictors', Machine Learning 24, 123-140.
4. Breiman, L. (2001), 'Random Forests', Machine Learning 45, 5-32.
5. Christen, P. (2007), A two-step classification approach to unsupervised record linkage, in P. Christen, P. Kennedy, J. Li, I. Kolyshkina & G. Williams, eds, 'Sixth Australasian Data Mining Conference (AusDM 2007)', Vol. 70 of CRPIT, ACS, Gold Coast, Australia.
6. Cornforth, D. & Jelinek, H. (2007), 'Automated classification reveals morphological factors associated with dementia', Applied Soft Computing 8, 182-190.
7. Ewing, D., Campbell, J. & Clarke, B. (1980), 'The natural history of diabetic autonomic neuropathy', Q. J. Med. 49, 95-100.
8. Ewing, D., Martyn, C., Young, R. & Clarke, B. (1985), 'The value of cardiovascular autonomic function tests: 10 years experience in diabetes', Diabetes Care 8, 491-498.
9. Fang, Z., Prins, J. & Marwick, T. (2004), 'Diabetic cardiomyopathy: evidence, mechanisms, and therapeutic implications', Endocr. Rev. 25, 543-567.
10. Fern, X. & Brodley, C. (2004), Solving cluster ensemble problems by bipartite graph partitioning, in '21st International Conference on Machine Learning, ICML'04', Vol. 69, ACM, New York, NY, USA, pp. 36-43.
11. Freund, Y. & Schapire, R. (1996), Experiments with a new boosting algorithm, in 'Proc. 13th Internat. Conf. Machine Learning', pp. 148-156.
12. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P. & Witten, I. (2009), 'The WEKA data mining software: an update', SIGKDD Explorations 11, 10-18.
13. Han, L., Embrechts, M., Szymanski, B., Sternickel, K. & Ross, A. (2006), Random forests feature selection with K-PLS: detecting ischemia from magnetocardiograms, in 'Proc. European Symposium on Artificial Neural Networks, ESANN', Vol. 14, pp. 221-226.
14. Hastie, T. & Tibshirani, R. (1998), Classification by pairwise coupling, in 'Advances in Neural Information Processing Systems'.
15. Huda, S., Jelinek, H., Ray, B., Stranieri, A. & Yearwood, J. (2010), Exploring novel features and decision rules to identify cardiovascular autonomic neuropathy using a hybrid of wrapper-filter based feature selection, in 'Sixth International Conference on Intelligent Sensors, Sensor Networks and Information Processing, ISSNIP 2010', pp. 297-302.
16. Huehn, J. & Huellermeier, E. (2009), 'FURIA: An algorithm for unordered fuzzy rule induction', Data Mining and Knowledge Discovery 19, 293-319.
17. Islam, R. & Abawajy, J. (2012), 'A multi-tier phishing detection and filtering approach', Journal of Network and Computer Applications p. to apper soon.
18. Jelinek, H., Khandoker, A., Palaniswami, M. & Mc-Donald, S. (2010), 'Heart rate variability and QT dispersion in a cohort of diabetes patients', Computing in Cardiology 37, 613-616.
19. Jelinek, H., Rocha, A., Carvalho, T., Goldenstein, S. & Wainer, J. (2011), Machine learning and pattern classification in identification of indigenous retinal pathology, in 'Proceedings IEEE Conference Eng. Med. Biol. Soc.', pp. 5951-5954.
20. Jiangning, S., Tan, H., Wang, M., Webb, G. & Akutsu, T. (2012), 'TANGLE: Two-level support vector regression approach for protein backbone torsion angle prediction from primary sequences', PLoS ONE 7, e30361.
21. Kang, B., Kelarev, A., Sale, A. & Williams, R. (2006), A new model for classifying DNA code inspired by neural networks and FSA, in 'Advances in Knowledge Acquisition and Management', Vol. 4303 of Lecture Notes in Computer Science, pp. 187-198.
22. Keerthi, S., Shevade, S., Bhattacharyya, C. & Murthy, K. (2001), 'Improvements to Platt's SMO algorithm for SVM classifier design', Neural Computation 13(3), 637-649.
23. Kelarev, A., Dazeley, R., Stranieri, A., Yearwood, J. & Jelinek, H. (2012), Detection of CAN by ensemble classifiers based on Ripple Down Rules, in 'Pacific Rim Knowledge Acquisition Workshop, PKAW2012', Vol. 7457 of Lecture Notes in Artificial Intelligence, pp. 147-159.
24. Kelarev, A., Kang, B. & Steane, D. (2006), Clustering algorithms for ITS sequence data with alignment metrics, in 'AI 2006: Advances in Artificial Intelligence, 19th Australian Joint Conference on Artificial Intelligence', Vol. 4304 of Lecture Notes in Artificial Intelligence, pp. 1027-1031.
25. Kelarev, A., Stranieri, A., Yearwood, J. & Jelinek, H. (2012), Empirical study of decision trees and ensemble classifiers for monitoring of diabetes patients in pervasive healthcare, in 'Network-Based Information Systems, NBiS-2012', pp. 441-446.
26. Kennedy, P., Simoff, S., Catchpoole, D., Skillicorn, D., Ubaudi, F. & Al-Oqaily, A. (2008), Integrative visual data mining of biomedical data: Investigating cases in chronic fatigue syndrome and acute lymphoblastic leukaemia, in 'Visual Data Mining', Vol. 4404/2008 of Lecture Notes in Computer Science, pp. 367-388.
27. Khandoker, A., Jelinek, H. & Palaniswami, M. (2009), 'Identifying diabetic patients with cardiac autonomic neuropathy by heart rate complexity analysis', BioMedical Engineering OnLine 8, http://www.biomedical-engineeringonline.com/content/8/1/3.
28. Kohavi, R. (1995), The power of decision tables, in '8th European Conference on Machine Learning', pp. 174-189.
29. Kohavi, R. (1996), Scaling up the accuracy of Naive-Bayes classifiers: A Decision-Tree hybrid, in 'Second International Conference on Knoledge Discovery and Data Mining', pp. 202-207.
30. Li, J., Fu, A. & Fahey, P. (2009), 'Efficient discovery of risk patterns in medical data', Artificial Intelligence in Medicine 45, 77-89.
31. Liang, G. & Zhang, C. (2011), Empirical study of bagging predictors on medical data, in P. Vamplew, A. Stranieri, K.-L. Ong, P. Christen & P. J. Kennedy, eds, 'Australasian Data Mining Conference, AusDM 2011', Vol. 121 of CRPIT, ACS, Ballarat, Australia, pp. 31-40.
32. Madjarov, G., Gjorgjevikj, D. & Delev, T. (2011), Efficient two stage voting architecture for pairwise multi-label classification, in J. Li, ed., 'AI 2010: Advances in Artificial Intelligence', Vol. 6464 of Lecture Notes in Artificial Intelligence, pp. 164-173.
33. Melville, P. & Mooney, R. (2005), 'Creating diversity in ensembles using artificial data', Information Fusion 6, 99-111.
34. Platt, J. (1998), Fast training of support vector machines using sequential minimal optimization, in 'Advances in Kernel Methods-Support Vector Learning'.
35. Quinlan, R. (1993), C4.5: Programs for Machine Learning, Morgan Kaufmann, San Mateo, CA.
36. Seewald, A. & Fuernkranz, J. (2001), An evaluation of grading classifiers advances in intelligent data analysis, in 'Advances in Intelligent Data Analysis', Vol. 2189/2001 of Lecture Notes in Computer Science, pp. 115-124.
37. Shouman, M., Turner, T. & Stocker, R. (2011), Using decision tree for diagnosing heart disease patients, in P. Vamplew, A. Stranieri, K.-L. Ong, P. Christen & P. Kennedy, eds, 'Australasian Data Mining Conference, AusDM 11', Vol. 121 of CRPIT, ACS, Ballarat, Australia, pp. 23-30.
38. Sinha, A., Tayebi, H., Krishnaswamy, S., Waluyo, A. & Gaber, M. (2011), Resource-aware ECG analysis on mobile devices, in 'Proceedings of the 2011 ACM Symposium on Applied Computing, SAC11', pp. 1012-1013.
39. Sun, B., Zhu, Z., Li, J. & Linghu, B. (2011), 'Combined feature selection and cancer prognosis using support vector machine regression', IEEE/ACM Transactions on Computational Biology Bioinformatics 8, 1671-1677.
40. Tayebi, H., Krishnaswamy, S., Waluyo, A., Sinha, A. & Gaber, M. (2011), RA-SAX: Resource-aware symbolic aggregate approximation for mobile ECG analysis, in 'Proceedings of the 12th IEEE International Conference on Mobile Data Management, MDM11', Vol. 1, pp. 289-290.
41. Ting, K., Wells, J., Tan, S., Teng, S. & Webb, G. (2009), FaSS: Ensembles for stable learners, in 'MCS 2009: 8th International Workshop on Multiple Classifier Systems,', Vol. 5519 of Lecture Notes in Compuer Science, pp. 364-374.
42. Ting, K., Wells, J., Tan, S., Teng, S. & Webb, G. (2011), 'Feature-subspace aggregating: Ensembles for stable and unstable learners', Machine Learning 82(3), 375-397.
43. Ting, K. & Witten, I. (1997), Stacking bagged and dagged models, in 'Fourteenth international Conference on Machine Learning', pp. 367-375.
44. Van, A., Gay, V., Kennedy, P., Barin, E. & Leijdekkers, P. (2011), Understanding risk factors in cardiac rehabilitation patients with random forests and decision trees, in P. Vamplew, A. Stranieri, K.-L. Ong, P. Christen & P. Kennedy, eds, 'Australasian Data Mining Conference, AusDM 2011', Vol. 121 of CRPIT, ACS, Ballarat, Australia, pp. 11-22.
45. Webb, G. (2000), 'Multiboosting: A technique for combining boosting and wagging', Machine Learning 40, 159-196.
46. Webb, G. (2008), Multi-strategy ensemble learning, ensembles of bayesian classifiers, and the problem of false discoveries, in J. Roddick, J. Li, P. Christen & P. Kennedy, eds, 'Data Mining and Analytics 2008, Proceedings of the Seventh Australasian Data Mining Conference, AusDM 2008', Vol. 87 of CRPIT, ACS, Glenelg, South Australia, p. 15.
47. Webb, G. & Zheng, Z. (2004), 'Multistrategy ensemble learning: Reducing error by combining ensemble learning techniques', IEEE Transactions on Knowledge and Data Engineering 16, 980-991.
48. Wickramasinghe, K., Alahakoon, D., Schattner, P. & Georgeff, M. (2011), Self-organizing maps for translating health care knowledge: A case study in diabetes management, in D. Wang & M. Reynolds, eds, 'AI 2011: Advances in Artificial Intelligence', Vol. 7106 of Lecture Notes in Artificial Intelligence, pp. 162-171.
49. Williams, G. (2009), 'Rattle: a data mining GUI for R', The R Journal 1, 45-55.
50. Williams, G. (2011), Data Mining with Rattle and R: The Art of Excavating Data for Knowledge Discovery (Use R!), Springer, New York, Dordrecht, Heidelberg, London.
51. Wolpert, D. (1992), 'Stacked generalization', Neural Networks 5, 241-259.
52. Wolpert, D. (1996), 'The lack of a priori distinctions between learning algorithms', Neural Computation 8, 1341-1390.
53. Yang, Y., Korb, K., Ting, K.-M. & Webb, G. (2005), Ensemble selection for superparent-onedependence estimators, in 'AI 2005: Advances in Artificial Intelligence, 18th Australiasian Joint Conference on Artificial Intelligence', Vol. 3809 of Lecture Notes in Artificial Intelligence, pp. 102-111.
54. Yearwood, J., Kang, B. & Kelarev, A. (2008), Experimental investigation of classification algorithms for ITS dataset, in 'Pacific Rim Knowledge Acquisition Workshop, PKAW 2008', Hanoi, Vietnam, 15-16 December 2008, pp. 262-272.
55. Yearwood, J., Webb, D., Ma, L., Vamplew, P., Ofoghi, B. & Kelarev, A. (2009), Applying clustering and ensemble clustering approaches to phishing profiling, in P. Kennedy, K. Ong & P. Christen, eds, 'Data Mining and Analytics 2009, Proc. 8th Australasian Data Mining Conference, AusDM 2009', Vol. 101 of CRPIT, ACS, Melbourne, Australia, pp. 25-34.