Ensemble Deep Learning for Biomedical Time Series Classification

Computational Intelligence and Neuroscience

Volumn 2016, Issue , 2016, Pages

  Jin, Lin Peng ^a,b   Dong, Jun ^a  

^a SUZHOU INSTITUTE OF NANO TECH AND NANO BIONICS   (China)

^b UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE BOOSTING; TIME SERIES;

CARDIO-VASCULAR DISEASE; ELECTROCARDIOGRAM RECORDINGS; ENSEMBLE LEARNING; ENSEMBLE METHODS; GENERALIZATION ABILITY; IMPLICIT TRAINING; THEORY AND PRACTICE; TIME SERIES CLASSIFICATIONS;

DEEP NEURAL NETWORKS;

ALGORITHM; ANIMAL; ARTIFICIAL NEURAL NETWORK; CARDIOVASCULAR DISEASES; CLASSIFICATION; ELECTROCARDIOGRAPHY; HUMAN; LEARNING; MEDICAL RESEARCH; PHYSIOLOGY; PREDICTIVE VALUE; TIME FACTOR;

ALGORITHMS; ANIMALS; BIOMEDICAL RESEARCH; CARDIOVASCULAR DISEASES; ELECTROCARDIOGRAPHY; HUMANS; LEARNING; NEURAL NETWORKS (COMPUTER); PREDICTIVE VALUE OF TESTS; TIME FACTORS;

EID: 84990841514     PISSN: 16875265     EISSN: 16875273     Source Type: Journal    
DOI: 10.1155/2016/6212684     Document Type: Article

References (59)

1. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks, " Science, vol. 313, no. 5786, pp. 504-507, 2006.
2. Y. Bengio, "Learning deep architectures for AI, " Foundations and Trends in Machine Learning, vol. 2, no. 1, pp. 1-27, 2009.
3. Z. H. Zhou, "Ensemble Learning, " in Encyclopedia of Biometrics, pp. 270-273, Springer, Berlin, Germany, 2009.
4. L. K. Hansen and P. Salamon, "Neural network ensembles, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 12, no. 10, pp. 993-1001, 1990.
5. R. E. Schapire, "The strength of weak learnability, " Machine Learning, vol. 5, no. 2, pp. 197-227, 1990.
6. L. P. Jin and J. Dong, "Deep learning research on clinical electrocardiogram analysis, " Science China Information Sciences, vol. 45, no. 3, pp. 398-416, 2015.
7. L. Breiman, "Bagging predictors, "Machine Learning, vol. 24, no. 2, pp. 123-140, 1996.
8. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting, " Journal of Computer and System Sciences, vol. 55, no. 1, part 2, pp. 119-139, 1997.
9. H. Drucker, C. Cortes, L. D. Jackel, Y. LeCun, and V. Vapnik, "Boosting and other ensemble methods, " Neural Computation, vol. 6, no. 6, pp. 1289-1301, 1994.
10. R. E. Schapire, "A brief introduction to boosting, " in Proceedings of the 16th International Joint Conference onArtificial Intelligence (IJCAI '99), pp. 1401-1406, Stockholm, Sweden, August 1999.
11. B. Parmanto, P. W. Munro, and H. R. Doyle, "Reducing variance of committee prediction with resampling techniques, " Connection Science, vol. 8, no. 3-4, pp. 405-426, 1996.
12. E. Bauer and R. Kohavi, "An empirical comparison of voting classification algorithms: bagging, boosting, and variants, " Machine Learning, vol. 36, no. 1, pp. 105-139, 1999.
13. L. Breiman, "Prediction games and arcing classifiers, " Neural Computation, vol. 11, no. 7, pp. 1493-1517, 1999.
14. T. K. Ho, "The random subspace method for constructing decision forests, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 8, pp. 832-844, 1998.
15. K. Tumer and N. C. Oza, "Input decimated ensembles, " Pattern Analysis & Applications, vol. 6, no. 1, pp. 65-77, 2003.
16. J. J. Rodríguez, L. I. Kuncheva, and C. J. Alonso, "Rotation forest: a new classifier ensemble method, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 10, pp. 1619-1630, 2006.
17. E. Pekalska, M. Skurichina, and R. P. W. Duin, "Combining fisher linear discriminants for dissimilarity representations, " in Multiple Classifier Systems, vol. 1857 of Lecture Notes in Computer Science, pp. 117-126, Springer, Berlin, Germany, 2000.
18. L. I. Kuncheva, "Using diversity measures for generating errorcorrecting output codes in classifier ensembles, " Pattern Recognition Letters, vol. 26, no. 1, pp. 83-90, 2005.
19. R. Anand, K. Mehrotra, C. K. Mohan, and S. Ranka, "Efficient classification for multiclass problems using modular neural networks, " IEEE Transactions on Neural Networks, vol. 6, no. 1, pp. 117-124, 1995.
20. T. Hastie and R. Tibshirani, "Classification by pairwise coupling, " The Annals of Statistics, vol. 26, no. 2, pp. 451-471, 1998.
21. L. Breiman, "Randomizing outputs to increase prediction accuracy, " Machine Learning, vol. 40, no. 3, pp. 229-242, 2000.
22. G. Martínez-Muñoz, A. Sánchez-Martínez, D. Hernández-Lobato, and A. Suárez, "Class-switching neural network ensembles, " Neurocomputing, vol. 71, no. 13-15, pp. 2521-2528, 2008.
23. J. F. Kolen and J. B. Pollack, "Back propagation is sensitiveto initial conditions, " in Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS '91), pp. 860-867, San Francisco, Calif, USA, 1991.
24. K. M. Ali and M. J. Pazzani, "Error reduction through learning multiple descriptions, "Machine Learning, vol. 24, no. 3, pp. 173-202, 1996.
25. L. Breiman, "Random forests, " Machine Learning, vol. 45, no. 1, pp. 5-32, 2001.
26. L. Lamand C. Y. Suen, "Application ofmajority voting to pattern recognition: an analysis of its behavior and performance, " IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans, vol. 27, no. 5, pp. 553-568, 1997.
27. G. Fumera and F. Roli, "A theoretical and experimental analysis of linear combiners for multiple classifier systems, " IEEE Transactions on Pattern Analysis andMachine Intelligence, vol. 27, no. 6, pp. 942-956, 2005.
28. G. Rogova, "Combining the results of several neural network classifiers, " Neural Networks, vol. 7, no. 5, pp. 777-781, 1994.
29. D. H. Wolpert, "Stacked generalization, " Neural Networks, vol. 5, no. 2, pp. 241-259, 1992.
30. R. P. W. Duin and D. M. J. Tax, "Experiments with classifier combining rules, " in Multiple Classifier Systems, vol. 1857 of Lecture Notes in Computer Science, pp. 16-29, Springer, 2000.
31. L. Deng and J. C. Platt, "Ensemble deep learning for speech recognition, " in Proceedings of the 15th Annual Conference of the International Speech Communication Association (INTERSPEECH '14), pp. 1915-1919, Singapore, September 2014.
32. J. J. Xie, B. Xu, and Z. Chuang, "Horizontal and vertical ensemble with deep representation for classification, " in Proceedings of the International Conference on Machine LearningWorkshop on Representation Learning (ICML '13), Atlanta, Ga, USA, 2013.
33. C.-X. Zhang, J.-S. Zhang, N.-N. Ji, and G. Guo, "Learning ensemble classifiers via restricted Boltzmann machines, " Pattern Recognition Letters, vol. 36, no. 1, pp. 161-170, 2014.
34. X. H. Qiu, L. Zhang, Y. Ren et al., "Ensemble deep learning for regression and time series forecasting, " in Proceedings of the IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL '14), Orlando, Fla, USA, 2014.
35. X. H. Zhang, D. Povey, and S. Khudanpur, "A diversitypenalizing ensemble training method for deep learning, " in Proceedings of the 16th Annual Conference of International Speech Communication Association, Dresden, Germany, 2015.
36. W. Huang, H. Hong, K. G. Bian, X. Zhou, G. Song, and K. Xie, "Improving deep neural network ensembles using reconstruction error, " in Proceedings of the International Joint Conference on Neural Networks (IJCNN '15), pp. 1-7, Killarney, Ireland, July 2015.
37. L. Romaszko, "A deep learning approach with an ensemblebased neural network classifier for black box ICML 2013 contest, " in Proceedings of the IEEE 12th International Conference on Data Mining Workshops, pp. 865-868, Brussels, Belgium, 2012.
38. I. Hwang, H. Park, and J. Chang, "Ensemble of deep neural networks using acoustic environment classification for statistical model-based voice activity detection, " Computer Speech & Language, vol. 38, pp. 1-12, 2016.
39. X. Zhou, L. Xie, P. Zhang, and Y. Zhang, "An ensemble of deep neural networks for object tracking, " in Proceedings of the IEEE International Conference on Image Processing (ICIP '14), pp. 843-847, IEEE, Paris, France, October 2014.
40. M. Barghash, "An effective and novel neural network ensemble for shift pattern detection in control charts, " Computational Intelligence and Neuroscience, vol. 2015, Article ID 939248, 9 pages, 2015.
41. A. J. C. Sharkey, "On combining artificial neural nets, " Connection Science, vol. 8, no. 3-4, pp. 299-314, 1996.
42. Y. LeCun, L. Bottou, Y. Bengio et al., "Gradient-based learning applied to document recognition, " in Proceedings of the IEEE, pp. 2278-2324, New York, NY, USA, November 1998.
43. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets, " Neural Computation, vol. 18, no. 7, pp. 1527-1554, 2006.
44. Y. Bengio, P. Lamblin, D. Popovici et al., "Greedy layer-wise training of deep networks, " in Proceedings of the Advances in Neural Information Processing Systems (NIPS '06), pp. 153-160, Vancouver, Canada.
45. R. F. Zhang, C. P. Li, and D. Y. Jia, "A new multi-channels sequence recognition framework using deep convolutional neural network, " Procedia Computer Science, vol. 53, pp. 383-390, 2015.
46. Y. Zheng, Q. Liu, E. Chen, Y. Ge, and J. L. Zhao, "Time series classification using multi-channels deep convolutional neural networks, " inWeb-Age InformationManagement, F. Li, G. Li, S.-W. Hwang, B. Yao, and Z. Zhang, Eds., vol. 8485 of Lecture Notes in Computer Science, pp. 298-310, 2014.
47. J. Dong, J. W. Zhang, H. H. Zhu, L. P. Wang, X. Liu, and Z. J. Li, "Wearable ECG monitors and its remote diagnosis service platform, " IEEE Intelligent Systems, vol. 27, no. 6, pp. 36-43, 2012.
48. H. H. Zhu, Research on ECG Recognition Critical Methods and Development on Remote Multi Body Characteristic Signal Monitoring System, University of Chinese Academy of Sciences, Beijing, China, 2013.
49. L. P. Wang, Study on Approach of ECG Classification with Domain Knowledge, East China Normal University, Shanghai, China, 2013.
50. J.-W. Zhang, X. Liu, and J. Dong, "CCDD: an enhanced standard ecg database with its management and annotation tools, " International Journal on Artificial Intelligence Tools, vol. 21, no. 5, Article ID 1240020, 26 pages, 2012.
51. T. P. Vogl, J. K. Mangis, A. K. Rigler, W. T. Zink, and D. L. Alkon, "Accelerating the convergence of the back-propagation method, " Biological Cybernetics, vol. 59, no. 4-5, pp. 257-263, 1988.
52. Theano documentation [EB/OL], http://deeplearning. net/ software/theano/.
53. T. Evgeniou, M. Pontil, and A. Elisseeff, "Leave one out error, stability, and generalization of voting combinations of classifiers, " Machine Learning, vol. 55, no. 1, pp. 71-97, 2004.
54. C. Ye, B. V. K. Vijaya Kumar, and M. T. Coimbra, "Heartbeat classification using morphological and dynamic features of ECGsignals, " IEEE Transactions on Biomedical Engineering, vol. 59, no. 10, pp. 2930-2941, 2012.
55. N. V. Thakor, J. G. Webster, and W. J. Tompkins, "Estimation of QRS complex power spectra for design of a QRS filter, " IEEE Transactions on Biomedical Engineering, vol. 31, no. 11, pp. 702-706, 1984.
56. X. H. Zhou, N. A. Obuchowski, and D. K. McClish, Statistical Methods in DiagnosticMedicine, JohnWiley & Sons, New York, NY, USA, 2nd edition, 2011.
57. M. Wu and J. Ye, "A small sphere and large margin approach for novelty detection using training data with outliers, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 11, pp. 2088-2092, 2009.
58. X. Liu, Atlas of Classical Electrocardiograms, Shanghai Science and Technology Press, Shanghai, China, 1st edition, 2011.
59. J. Demsar, "Statistical comparisons of classifiers over multiple data sets, " Journal of Machine LearningResearch, vol. 7, pp. 1-30, 2006.