Error-correcting output codes based ensemble feature extraction

Pattern Recognition

Volumn 46, Issue 4, 2013, Pages 1091-1100

  Zhong, Guoqiang ^a   Liu, Cheng Lin ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

Ensemble learning; Error correcting output codes (ECOC); Feature extraction; Meta learner

Indexed keywords

BINARY CLASSIFIERS; CODEWORD; COMPUTATIONALLY EFFICIENT; DATA SETS; DECODING STRATEGY; ENSEMBLE LEARNING; ERROR CORRECTING OUTPUT CODE; FEATURE EXTRACTION METHODS; META-CLASSIFIERS; META-LEARNER; MULTI-CLASS; NONLINEAR FEATURES; REPRESENTATION SPACE; UCI MACHINE LEARNING REPOSITORY;

DECODING; FEATURE EXTRACTION; VECTOR QUANTIZATION;

LEARNING SYSTEMS;

EID: 84871345229     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.10.015     Document Type: Article

References (53)

1. I. Jolliffe Principal Component Analysis 1986 Springer-Verlag New York
2. R.A. Fisher The use of multiple measurements in taxonomic problems Annals of Eugenics 7 1936 179 188
3. J.B. Tenenbaum, V.d. Silva, and J.C. Langford A global geometric framework for nonlinear dimensionality reduction Science 290 5500 2000 2319 2323
4. S.T. Roweis, and L.K. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 5500 2000 2323 2326
5. M. Belkin, and P. Niyogi Laplacian eigenmaps for dimensionality reduction and data representation Neural Computation 15 6 2003 1373 1396
6. Z. Zhang, and H. Zha Principal manifolds and nonlinear dimensionality reduction via tangent space alignment SIAM Journal on Scientific Computing 26 1 2004 313 338
7. K.Q. Weinberger, and L.K. Saul Unsupervised learning of image manifolds by semidefinite programming International Journal of Computer Vision 70 1 2006 77 90
8. T. Lin, and H. Zha Riemannian manifold learning IEEE Transactions on Pattern Analysis and Machine Intelligence 30 5 2008 796 809
9. G. Zhong, W.-J. Li, D.-Y. Yeung, X. Hou, C.-L. Liu, Gaussian process latent random field, in: AAAI, 2010, pp. 679-684.
10. Y. Bengio, J.-F. Paiement, P. Vincent, O. Delalleau, N.L. Roux, M. Ouimet, Out-of-sample extensions for LLE, Isomap, MDS, eigenmaps, and spectral clustering, in: NIPS, 2003.
11. T.G. Dietterich, Ensemble methods in machine learning, in: Multiple Classifier Systems, 2000, pp. 1-15.
12. L. Breiman Bagging Predictors Machine Learning 24 2 1996 123 140
13. R.E. Schapire The strength of weak learnability Machine Learning 5 1990 197 227
14. T.G. Dietterich, and G. Bakiri Solving multiclass learning problems via error-correcting output codes Journal of Artificial Intelligence Research (JAIR) 2 1995 263 286
15. D.H. Wolpert Stacked generalization Neural Networks 5 1992 214 259
16. L. Lam, and C.Y. Suen Optimal combinations of pattern classifiers Pattern Recognition Letters 16 9 1995 945 954
17. Y. Freund, R.E. Schapire, Experiments with a new boosting algorithm, in: ICML, 1996, pp. 148-156.
18. T. Windeatt, G. Ardeshir, Boosted ECOC ensembles for face recognition, in: ICVIE, 2003, pp. 165-168.
19. H. Altincay, and M. Demirekler An information theoretic framework for weight estimation in the combination of probabilistic classifiers for speaker identification Speech Communication 30 2000 255 272
20. G.J. Briem, J.A. Benediktsson, and J.R. Sveinsson Multiple classifiers applied to multisource remote sensing data IEEE Transactions on Geoscience and Remote Sensing 40 10 2002 2291 2299
21. L. Wu, S.L. Oviatt, and P.R. Cohen From members to teams to committee robust approach to gestural and multimodal recognition IEEE Transactions on Neural Networks 13 4 2002 972 982
22. N. Nilsson Learning Machines 1965 McGraw-Hill
23. T. Hastie, and R. Tibshirani Classification by pairwise coupling Annals of Statistics 26 2 1998 451 471
24. J. Zhou, H. Peng, and C.Y. Suen Data-driven decomposition for multi-class classification Pattern Recognition 40 1 2008 67 76
25. O. Pujol, P. Radeva, and J. Vitrià Discriminant ECOC a heuristic method for application dependent design of error correcting output codes IEEE Transactions on Pattern Analysis and Machine Intelligence 28 6 2006 1007 1012
26. S. Escalera, O. Pujol, ECOC-ONE: a novel coding and decoding strategy, in: ICPR, 2006, pp. 578-581.
27. E.L. Allwein, R.E. Schapire, and Y. Singer Reducing multiclass to binary a unifying approach for margin classifiers Journal of Machine Learning Research 1 2000 113 141
28. A. Passerini, M. Pontil, and P. Frasconi New results on error correcting output codes of kernel machines IEEE Transactions on Neural Networks 2004 45 54
29. O. Dekel, Y. Singer, Multiclass learning by probabilistic embeddings, in: NIPS, 2002, pp. 945-952.
30. S. Escalera, O. Pujol, and P. Radeva On the decoding process in ternary error-correcting output codes IEEE Transactions on Pattern Analysis and Machine Intelligence 32 1 2010 120 134
31. A. Gersho, and R.M. Gray Vector Quantization and Signal Compression 1991 Kluwer Academic Publishers Norwell, MA
32. A. Sato, K. Yamada, Generalized learning vector quantization, in: NIPS, 1995, pp. 423-429.
33. B. Schölkopf, A.J. Smola, and K.-R. Müller Nonlinear component analysis as a kernel eigenvalue problem Neural Computation 10 5 1998 1299 1319
34. G. Baudat, and F. Anouar Generalized discriminant analysis using a kernel approach Neural Computation 12 10 2000 2385 2404
35. V. Vapnik The Nature of Statistical Learning Theory 1995 Springer
36. Y. Freund, and R.E. Schapire A decision-theoretic generalization of on-line learning and an application to boosting Journal of Computer and System Sciences 55 1 1997 119 139
37. W. Utschick, and W. Weichselberger Stochastic organization of output codes in multiclass learning problems Neural Computation 13 5 2001 1065 1102
38. K. Crammer, and Y. Singer On the learnability and design of output codes for multiclass problems Machine Learning 47 2-3 2002 201 233
39. S. Escalera, O. Pujol, and P. Radeva Re-coding ECOCs without re-training Pattern Recognition Letters 31 7 2010 555 562
40. P. Savický, J. Fürnkranz, Combining pairwise classifiers with stacking, in: IDA, 2003, pp. 219-229.
41. O. Lezoray, and H. Cardot Comparing combination rules of pairwise neural networks classifiers Neural Processing Letters 27 1 2008 43 56
42. Y. Shiraishi, and K. Fukumizu Statistical approaches to combining binary classifiers for multi-class classification Neurocomputing 74 5 2011 680 688
43. L. Rueda, B.J. Oommen, and C. Henríquez Multi-class pairwise linear dimensionality reduction using heteroscedastic schemes Pattern Recognition 43 7 2010 2456 2465
44. J.C. Platt, Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods, in: Advances in Large Margin Classifiers, MIT Press, 1999, pp. 61-74.
45. H.-T. Lin, C.-J. Lin, and R.C. Weng A note on platt's probabilistic outputs for support vector machines Machine Learning 68 3 2007 267 276
46. C.-L. Liu Classifier combination based on confidence transformation Pattern Recognition 38 1 2005 11 28
47. S. Escalera, O. Pujol, and P. Radeva Error-correcting output codes library Journal of Machine Learning Research 11 2010 661 664
48. F. Wilcoxon Individual comparisons by ranking methods Biometrics 1 1945 80 83
49. M. Friedman The use of ranks to avoid the assumption of normality implicit in the analysis of variance Journal of the American Statistical Association 32 1937 675 701
50. P.B. Nemenyi, Distribution-Free Multiple Comparisons, Ph.D. Thesis, Princeton University, 1963.
51. J. Demšar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30
52. R.M. Rifkin, and A. Klautau In defense of one-vs-all classification Journal of Machine Learning Research 5 2004 101 141
53. S. Shalev-Shwartz, Y. Singer, N. Srebro, Pegasos: primal estimated sub-gradient solver for SVM, in: ICML, 2007, pp. 807-814.