Toward a General-Purpose Heterogeneous Ensemble for Pattern Classification

Computational Intelligence and Neuroscience

Volumn 2015, Issue , 2015, Pages

  Nanni, Loris ^a   Brahnam, Sheryl ^b   Ghidoni, Stefano ^a   Lumini, Alessandra ^c  

^a UNIVERSITY OF PADOVA   (Italy)

^b MISSOURI STATE UNIVERSITY   (United States)

^c UNIVERSITY OF BOLOGNA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE BOOSTING; DATA MINING; SUPPORT VECTOR MACHINES; VECTORS;

CLASSIFICATION APPROACH; GAUSSIAN PROCESSES; HETEROGENEOUS ENSEMBLES; KERNEL SELECTION; MULTIPLE DATA SETS; PARAMETER-TUNING; RANDOM SUBSPACES; STATE OF THE ART;

CLASSIFICATION (OF INFORMATION);

ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; HUMAN; INFORMATION PROCESSING; LEARNING; NORMAL DISTRIBUTION; RECEIVER OPERATING CHARACTERISTIC;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DATASETS AS TOPIC; HUMANS; LEARNING; NORMAL DISTRIBUTION; PATTERN RECOGNITION, AUTOMATED; ROC CURVE;

EID: 84941255122     PISSN: 16875265     EISSN: 16875273     Source Type: Journal    
DOI: 10.1155/2015/909123     Document Type: Article

References (42)

1. L. I. Kuncheva and C. J. Whitaker, "Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy, " Machine Learning, vol. 51, no. 2, pp. 181-207, 2003.
2. J. Kittler, M. Hatef, R. P.W. Duin, and J. Matas, "On combining classifiers, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 3, pp. 226-239, 1998.
3. L. Breiman, "Arcing classifiers, " The Annals of Statistics, vol. 26, no. 3, pp. 801-849, 1998.
4. G. Bologna and R. D. Appel, "A comparison study on protein fold recognition, " in Proceedings of the 9th International Conference on Neural Information Processing (ICONIP '02), vol. 5, pp. 2492-2496, IEEE, Singapore, November 2002.
5. G. Martínez-Muñoz and A. Suárez, "Switching class labels to generate classification ensembles, " Pattern Recognition, vol. 38, no. 10, pp. 1483-1494, 2005.
6. P. Melville and R. J. Mooney, "Creating diversity in ensembles using artificial data, " Information Fusion, vol. 6, no. 1, pp. 99-111, 2005.
7. T. K. Ho, "The random subspace method for constructing decision forests, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 8, pp. 832-844, 1998.
8. K. Tumer and N. C. Oza, "Input decimated ensembles, " Pattern Analysis and Applications, vol. 6, no. 1, pp. 65-77, 2003.
9. L. Nanni and A. Lumini, "Ensemble generation and feature selection for the identification of students with learning disabilities, " Expert Systems with Applications, vol. 36, no. 2, pp. 3896-3900, 2009.
10. L. Breiman, "Random forests, " Machine Learning, vol. 45, no. 1, pp. 5-32, 2001.
11. S. Kotsiantis andV. Tampakas, "Combining heterogeneous classifiers: a recent overview, " Journal of Convergence Information Technology, vol. 6, no. 10, pp. 164-172, 2011.
12. L. Nanni, S. Brahnam, and A. Lumini, "Double committee adaboost, " Journal of King Saud University-Science, vol. 25, no. 1, pp. 29-37, 2013.
13. L. Nanni, A. Lumini, and S. Brahnam, "An empirical study of different approaches for protein classification, " The Scientific World Journal, vol. 2014, Article ID 236717, 17 pages, 2014.
14. X. Tan and B. Triggs, "Enhanced local texture feature sets for face recognition under difficult lighting conditions, " in Analysis and Modelling of Faces and Gestures, vol. 4778 of Lecture Notes in Computer Science, pp. 168-182, Springer, 2007.
15. V. Ojansivu and J. Heikkila, "Blur insensitive texture classification using local phase quantization, " in Proceedings of the 3rd International Conference on Image and Signal Processing (ICISP '08), pp. 236-243, 2008.
16. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods, Cambridge University Press, Cambridge, UK, 2000.
17. C. E. Rasmussen and C. K. Williams, Gaussian Processes for Machine Learning, Adaptive Computation and Machine Learning, The MIT Press, 2006.
18. Y. Freund and R. E. Schapire, "Ashort introduction to boosting, " Journal of Japanese Society for Artificial Intelligence, vol. 14, no. 5, pp. 771-780, 1999.
19. C.-X. Zhang and J.-S. Zhang, "RotBoost: a technique for combining Rotation Forest and AdaBoost, " Pattern Recognition Letters, vol. 29, no. 10, pp. 1524-1536, 2008.
20. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets, " Neural Computation, vol. 18, no. 7, pp. 1527-1554, 2006.
21. R. Socher, B. Huval, B. Bhat, C. D. Manning, and A. Y. Ng, "Convolutional-recursive deep learning for 3D object classification, " in Advances in Neural Information Processing Systems 25, F. Pereira, C. J. C. Burges, L. Bottou, and K. Q.Weinberger, Eds., pp. 1-9, 2012.
22. Y. Sun, X. Wang, and X. Tang, "Hybrid deep learning for face verification, " in Proceedings of the IEEE International Conference on Computer Vision (ICCV '13), pp. 1489-1496, IEEE, Sydney, Australia, December 2013.
23. K. Hornik, M. Stinchcombe, and H.White, "Multilayer feedforward networks are universal approximators, " Neural Networks, vol. 2, no. 5, pp. 359-366, 1989.
24. T. Ojala, M. Pietikäinen, and T. Mäenpää, "Multiresolution gray-scale and rotation invariant texture classificationwith local binary patterns, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 971-987, 2002.
25. X.He, D. Cai, S. Yan, andH.-J.Zhang, "Neighborhood preserving embedding, " in Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV '05), Beijing, China, October 2005.
26. J. Jantzen, G. Dounias, and B. Bjerregaard, "Pap-smear benchmark data for pattern classification, " in Proceedings of the European Symposium on Nature Inspired Smart Information Systems (NiSIS '05), pp. 1-9, Albufeira, Portugal, 2005.
27. G. Kylberg, M. Uppström, K.-O. Hedlund, G. Borgefors, and I.-M. Sintorn, "Segmentation of virus particle candidates in transmission electron microscopy images, " Journal of Microscopy, vol. 245, no. 2, pp. 140-147, 2012.
28. M. V. Boland and R. F. Murphy, "A neural network classifier capable of recognizing the patterns of all major subcellular structures in fluorescence microscope images of HeLa cells, " Bioinformatics, vol. 17, no. 12, pp. 1213-1223, 2002.
29. F. Yuan, "Video-based smoke detection with histogram sequence of LBP and LBPV pyramids, " Fire Safety Journal, vol. 46, no. 3, pp. 132-139, 2011.
30. A. Cruz-Roa, J. C. Caicedo, and F.A.González, "Visual pattern mining in histology image collections using bag of features, " Artificial Intelligence inMedicine, vol. 52, no. 2, pp. 91-106, 2011.
31. G. B. Junior, A. C. de Paiva, A. C. Silva, and A. C.M. deOliveira, "Classification of breast tissues usingMoran's index and Geary's coefficient as texture signatures and SVM, " Computers in Biology and Medicine, vol. 39, no. 12, pp. 1063-1072, 2009.
32. L. Nanni, J.-Y. Shi, S. Brahnam, and A. Lumini, "Protein classification using texture descriptors extracted from the protein backbone image, " Journal ofTheoretical Biology, vol. 264, no. 3, pp. 1024-1032, 2010.
33. N. A. Hamilton, R. S. Pantelic, K. Hanson, and R. D. Teasdale, "Fast automated cell phenotype image classification, " BMC Bioinformatics, vol. 8, article 110, 2007.
34. D. Borghesani, C. Grana, and R. Cucchiara, "Miniature illustrations retrieval and innovative interaction for digital illuminated manuscripts, "Multimedia Systems, vol. 20, no. 1, pp.65-79, 2014.
35. F. S. Khan, S. Beigpour, J. van de Weijer, and M. Felsberg, "Painting-91: a large scale database for computational painting categorization, " Machine Vision and Applications, vol. 25, no. 6, pp. 1385-1397, 2014.
36. D. Casanova, J. J. de Mesquita, and O. M. Bruno, "Plant leaf identification using gabor wavelets, " International Journal of Imaging Systems and Technology, vol. 19, no. 3, pp. 236-243, 2009.
37. A. Frank and A. Asuncion, UCI Machine Learning Repository, 2010.
38. T. Fawcett, ROC Graphs: Notes and Practical Considerations for Researchers, HP Laboratories, Palo Alto, Calif, USA, 2004.
39. J. Demšar, "Statistical comparisons of classifiers over multiple data sets, " Journal of Machine LearningResearch, vol. 7, pp. 1-30, 2006.
40. D. H. Wolpert and W. G. Macready, "Coevolutionary free lunches, " IEEE Transactions on Evolutionary Computation, vol. 9, no. 6, pp. 721-735, 2005.
41. G.-B. Huang, X. Ding, and H. Zhou, "Optimization method based extreme learning machine for classification, " Neurocomputing, vol. 74, no. 1-3, pp. 155-163, 2010.
42. R. B. Palm, Prediction as a candidate for learning deep hierarchical models of data [M.S. thesis], DTU Informatics, Technical Univeristy of Denmark, Kongens Lyngby, Denmark, 2012.