A framework for selection and fusion of pattern classifiers in multimedia recognition

Pattern Recognition Letters

Volumn 39, Issue 1, 2014, Pages 52-64

  Faria, Fabio A ^a   Dos Santos, Jefersson A ^a   Rocha, Anderson ^a   Torres, Ricardo Da S ^a  

^a UNIVERSITY OF CAMPINAS   (Brazil)

Author keywords

Diversity measures; Ensemble of classifiers; Meta learning

Indexed keywords

CLASSIFICATION RESULTS; CURSE OF DIMENSIONALITY; DIVERSITY MEASURE; ENSEMBLE OF CLASSIFIERS; META-LEARNING APPROACH; METALEARNING; REDUCED TRAINING SETS; VISUAL CLASSIFICATION;

MOBILE DEVICES; PARALLEL ARCHITECTURES;

LEARNING SYSTEMS;

EID: 84893743223     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2013.07.014     Document Type: Article

References (71)

1. Antonie, M.-L., Zaïane, O.R., Coman, A. 2001. Application of data mining techniques for medical image classification. In: Workshop on Multimedia Data Mining at ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), pp. 94-101.
2. J.A. Benediktsson, J.R. Sveinsson, O.K. Ersoy, and P.H. Swain Parallel consensual neural networks IEEE Trans. Neural Networks 8 1 1997 54 64 (Pubitemid 127767780)
3. C.M. Bishop Pattern Recognition and Machine Learning (Information Science and Statistics) first ed. 2006 Springer Verlag New York, Inc., Secaucus, NJ, USA
4. Boser, B.E., Guyon, I.M., Vapnik, V.N. 1992. A training algorithm for optimal margin classifiers. In: Workshop on Computational Learning Theory, pp. 144-152.
5. L. Breiman Bagging predictors Mach. Learn. 24 2 1996 123 140 (Pubitemid 126724382)
6. L. Breiman Random forests Mach. Learn. 45 1 2001 5 32 (Pubitemid 32933532)
7. Brennan, R.L., Prediger, D.J. 1981. Coefficient kappa: some uses, misuses, and alternatives. Educ. Psychol. Meas. 41 (3), 687-699.
8. Brooks, D. 2013. The philosophy of data. In: The New York Times, A23, February, 5th.
9. C.-C. Chang, and C.-J. Lin LIBSVM: a library for support vector machines ACM Trans. Intell. Syst. Technol. 2 3 2011 27:1 27:27
10. N. Cristianini, and J. Shawe-Taylor An Introduction to Support Vector Machines and Other Kernel-based Learning Methods 2000 Cambridge University Press
11. J. Deng, A.C. Berg, K. Li, and L. Fei-Fei What does classifying more than 10,000 image categories tell us European Conf. on Computer Vision Springer-Verlag 2010 Berlin, Heidelberg 71-84
12. dos Santos, J.A., Penatti, O.A.B., Torres, R. da S., 2010. Evaluating the potential of texture and color descriptors for remote sensing image retrieval and classification. In: Int. Conf. on Computer Vision Theory and Applications, pp. 203-208.
13. dos Santos, J.A., Faria, F.A., Torres, R. da S., Rocha, A., Gosselin, P.-H., Philipp-Foliguet, S., Falcao, A. 2012. Descriptor correlation analysis for remote sensing image multi-scale classification. In: 21st International Conference on, Pattern Recognition (ICPR), 2012 pp. 3078-3081.
14. J.A. dos Santos, P.-H. Gosselin, S. Philipp-Foliguet, R. da S. Torres, and A.X. Falcão Interactive multiscale classification of high-resolution remote sensing images, selected topics in applied earth observations and remote sensing IEEE J. PP 99 2013 1 15
15. Duin, R.P.W., Pekalska, E. 2005. Open issues in pattern recognition. In: Int. Conf. on Computer Recognition Systems (CORE), vol. 30, pp. 27-42.
16. S. Džeroski, and B. Ženko Is combining classifiers with stacking better than selecting the best one Mach. Learn. 54 3 2004 255 273
17. Faria, F.A., Calumby, R.T., Torres, R. da S., 2011. RECOD at ImageCLEF 2011: Medical modality classification using genetic programming. In: CLEF (Notebook Papers/Labs/Workshop) pp. 1-8.
18. Faria, F.A., dos Santos, J.A., Torres, R. da S., Rocha, A., Falcão, A.X. 2012a. Automatic fusion of region-based classifiers for coffee crop recognition. In: IEEE Geoscience and Remote Sensing Symposium, pp. 2221-2224.
19. Faria, F.A., dos Santos, J.A., Rocha, A., Torres, R. da S., 2012b. Automatic Classifier Fusion for Produce Recognition. In: Conf. on Graphics, Patterns and Images, pp. 252-259.
20. Fei-fei, L., Fergus, R., Perona, P. 2004. Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. In: IEEE Int. Conf. on Computer Vision and Pattern Recognition Workshop, 178.
21. Fernando, B., Fromont, E., Muselet, D., Sebban, M. 2012. Discriminative feature fusion for image classification. In: IEEE Int. Conf. on Computer Vision and Pattern Recognition, pp. 3434 -3441.
22. Freund, Y., Schapire, R.E. 1996. Experiments with a new boosting algorithm. In: Int. Conf. on Machine Learning, pp. 148-156.
23. J. Friedman, T. Hastie, and R. Tibshirani The Elements of Statistical Learning first ed. 2001 Springer
24. Gehler, P., Nowozin, S. 2009. On feature combination for multiclass object classification. In: Intl. Conf. on Computer Vision, pp. 221 -228.
25. L. Guigues, J. Cocquerez, and H. Le Men Scale-sets image analysis Int. J. Comput. Vision 68 3 2006 289 317 (Pubitemid 43787395)
26. I. Hampshire, J.B., and A. Waibel The Meta-Pi network: building distributed knowledge representations for robust multisource pattern recognition IEEE Trans. Pattern Anal. Mach. Intell. 14 7 1992 751 769
27. Harchaoui, Z., Douze, M., Paulin, M., Dudik, M., Malick, J. 2012. Large-scale image classification with trace-norm regularization. In: IEEE Intl. Conf. on Computer Vision and Pattern Recognition, 3386 -3393, 2012.
28. T.K. Ho, J. Hull, and S. Srihari Decision combination in multiple classifier systems IEEE Trans. Pattern Anal. Mach. Intell. 16 1 1994 66 75
29. J.-H. Hong, J.-K. Min, U.-K. Cho, and S.-B. Cho Fingerprint classification using one-vs-all support vector machines dynamically ordered with naive Bayes classifiers Pattern Recogn. 41 2 2008 662 671 (Pubitemid 47503256)
30. Hou, J., Zhang, B.-P., Qi, N.-M., Yang, Y. Evaluating feature combination in object classification. In: Int. Conf. on Advances in Visual Computing - Volume Part II, pp. 597-606.
31. Huang, C., Liu, Q. 2007. An orientation independent texture descriptor for image retrieval. In: Int. Conf. on Computational Science, pp. 772-776.
32. Huang, J., Kumar, R., Mitra, V., Zhu, W., Zabih, R. 1997. Image indexing using color correlograms. In: IEEE Int. Conf. on Computer Vision and Pattern Recognition, pp. 762-768.
33. Jurek, A., Bi, Y., Wu, S., Nugent, C. 2011. Classification by cluster analysis: a new meta-learning based approach. In: Int. Conf. on Multiple Classifier Systems, pp. 259-268.
34. M.G. Kendall A new measure of rank correlation Biometrika 30 1/2 1938 81 93
35. D.-Kim, S., Baek, Y.-M., Kim, W.-Y. 2013. Reducing overfitting of AdaBoost by clustering-based pruning of hard examples. In: Proceedings of the 7th International Conference on Ubiquitous Information Management and Communication, 90.
36. B. Ko, J. Gim, and J. Nam Cell image classification based on ensemble features and random forest Electron. Lett. 47 11 2011 638 639
37. Kuncheva, L.I., Whitaker, C.J. 2003. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Mach. Learn. 51 (2), 181-207.
38. Lin, Y., Lv, F., Zhu, S., Yang, M., Cour, T., Yu, K., Cao, L., Huang, T. 2011. Large-scale image classification: Fast feature extraction and SVM trainingA. In: IEEE Intl. Conf. on Computer Vision and Pattern Recognition, pp. 1689 -1696.
39. Ma Z., Redmond, R., 1995. Tau coefficients for accuracy assessment of classification of remote sensing data. Photogram. Eng. Remote Sens. 61 (4), 439-453.
40. F. Mahmoudi, J. Shanbehzadeh, A. Eftekhari-Moghadam, and H. Soltanian-Zadeh Image retrieval based on shape similarity by edge orientation autocorrelogram Pattern Recogn. 36 8 2003 1725 1736 (Pubitemid 36557870)
41. Mansano, V., Matsuoka, J.A., Afonso, L.C.S., Papa, J.P., Faria, F., Torres, R. da S., 2012. Improving image classification through descriptor combination. In: Conf. on Graphics, Patterns and Images, pp. 324 -329.
42. Morais, E., Goldenstein, S., Ferreira, A. Rocha, A. 2012. Automatic tracking of indoor soccer players using videos from multiple cameras. In: Conf. on Graphics, Patterns and Images, pp. 174 -181.
43. Nakamura, E.F., Loureiro, A.A.F., Frery, A.C. 2007. Information fusion for wireless sensor networks: Methods, models, and classifications, ACM Comput. Surv. 39 (3).
44. N.C. Oza, and K. Tumer Classifier ensembles: select real-world applications Inf. Fusion 9 1 2008 4 20 (Pubitemid 47589064)
45. A. Passerini, M. Pontil, and P. Frasconi New results on error correcting output codes of kernel machines IEEE Trans. Neural Networks 15 1 2004 45 54
46. Pass, G., Zabih, R., Miller, J. 1996. Comparing images using color coherence vectors. In: ACM Multimedia, pp. 65-73.
47. Pedronette, D.C.G., Torres, R. da S., 2011. Exploiting contextual spaces for image re-ranking and rank aggregation. In: ACM Int. Conf. on Multimedia Retrieval, pp. 13:1-13:8.
48. Pedronette, D.C.G., Torres, R. da S., 2011. Image re-ranking and rank aggregation based on similarity of ranked lists. In: Int. Conf. on Computer analysis of images and patterns - Volume Part I, pp. 369-376.
49. O.A.B. Penatti, E. Valle, and R. da S. Torres Comparative study of global color and texture descriptors for web image retrieval J. Visual Commun. Image Represent. 23 2 2012 359 380
50. M.P. Perrone, and L.N. Cooper When Networks Disagree: Ensemble Methods for Hybrid Neural Networks 1993 Chapman and Hall
51. C.C.O. Ramos, A.N. Souza, G. Chiachia, A.X. Falcão, and J.P. Papa A novel algorithm for feature selection using Harmony search and its application for non-technical losses detection Comput. Electric. Eng. 37 6 2011 886 894
52. A. Rocha, D.C. Hauagge, J. Wainer, and S. Goldenstein Automatic fruit and vegetable classification from images Elsevier Comput. Electron. Agric. 70 1 2010 96 104
53. A. Rocha, J.P. Papa, and L.A.A. Meira How far do we get using machine learning black-boxes Int. J. Pattern Recogn. Artif. Intell. 26 2 2012 1261001-1 1261001-23
54. L. Rokach Ensemble-based classifiers J. Artif. Intell. Rev. 33 1-2 2010 1 39
55. A.A. Ross, K. Nandakumar, and A.K. Jain Handbook of Multibiometrics (Int. Series on Biometrics) 2006 Springer-Verlag New York, Inc., Secaucus, NJ, USA 0387222960
56. Schapire, R.E. 1999. A Brief Introduction to Boosting. In: Int. Joint Conf. on Artificial Intelligence, pp. 1401-1406.
57. N. Segata, and E. Blanzieri Fast and scalable local kernel machines J. Mach. Learn. Res. 99 2010 1883 1926
58. Shipp, C.A., Kuncheva, L.I. 2009. An investigation into how AdaBoost affects classifier diversity, IPMU, pp. 203-208 .
59. Stehling, R., Nascimento, M., Falcão, A.X. 2002. A compact and efficient image retrieval approach based on border/interior pixel classification. In: Int. Conf. on Information and Knowledge Management, pp. 102-109.
60. Y. Sun, S. Todorovic, and J. Li Reducing the overfitting of AdaBoost by controlling its data distribution skewness Int. J. Pattern Recogn. Artif. Intell. 20 07 2006 1093 1116 (Pubitemid 46031113)
61. Sun, B., Luo, J., Shu, S., Yu, N. 2010. Introduce randomness into AdaBoost for robust performance on noisy data. In: Fuzzy Systems and Knowledge Discovery (FSKD), 2010 Seventh International Conference on, vol. 4, pp. 1858-1861.
62. C.T.N. Suzuki, J.F. Gomes, A.X. Falcão, J.P. Papa, and S.H. Shimizu Automatic segmentation and classification of human intestinal parasites from microscopy images IEEE Trans. Biomed. Eng. 60 3 2012 803 812
63. M. Swain, and D. Ballard Color indexing Int. J. Comput. Vision 7 1 1991 11 32 (Pubitemid 23621975)
64. B. Tao, and B. Dickinson Texture recognition and image retrieval using gradient indexing J. Visual Commun. Image Represent. 11 3 2000 327 342
65. M. Unser Sum and difference histograms for texture classification IEEE Trans. Pattern Anal. Mach. Intell. 8 1 1986 118 125 (Pubitemid 16575727)
66. Viola, P., Jones, M. 2001. Rapid object detection using a boosted cascade of simple features. In: IEEE Int. Conf. on Computer Vision and Pattern Recognition, pp. I-511-I-518.
67. Weber, R., Schek, H.-J., Blott, S. 1998. A quantitative analysis and performance study for similarity-search methods in high-dimensional spaces. In: Proceedings of the international conference on very large data bases, pp. 194-205.
68. X. Xia, and L.O. Gorman Innovations in fingerprint capture devices Pattern Recogn. 36 2 2003 361 369 (Pubitemid 35212833)
69. Xiao, J., Hays, J., Ehinger, K., Oliva, A., Torralba, A. 2010. SUN database: Large-scale scene recognition from abbey to zoo. In: IEEE Intl. Conf. on Computer Vision and Pattern Recognition, pp. 3485 -3492.
70. J. Zegarra, N. Leite, and R. da S. Torres Wavelet-based feature extraction for fingerprint image retrieval J. Comput. Appl. Math. 227 2 2008 294 307
71. W. Zhou, G. Huang, A. Troy, and M.L. Cadenasso Object-based land cover classification of shaded areas in high spatial resolution imagery of urban areas: a comparison study Remote Sens. Environ. 113 2009 1769 1777