A novel multi-view learning developed from single-view patterns

Pattern Recognition

Volumn 44, Issue 10-11, 2011, Pages 2395-2413

  Wang, Zhe ^a,b   Chen, Songcan ^b   Gao, Daqi ^a  

^a EAST CHINA UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS   (China)

Author keywords

Classifier design; Ensemble learning; HoKashyap classifier; Multi view learning; Pattern recognition; Rademacher complexity; Regularization learning

Indexed keywords

CLASSIFIER DESIGN; ENSEMBLE LEARNING; HOKASHYAP CLASSIFIER; MULTI-VIEW LEARNING; RADEMACHER COMPLEXITY; REGULARIZATION LEARNING;

PATTERN RECOGNITION;

EID: 79958786327     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2011.04.002     Document Type: Article

References (49)

1. V. Koltchinskii Rademacher penalties and structural risk minimization IEEE Transactions on Information Theory 47 5 2001 1902 1914 (Pubitemid 32644704)
2. V. Vapnik, and A. Chervonenkis On the uniform convergence of relative frequencies of events to their probabilities Theory of Probability and its Applications 2 1971 264 280
3. P. Bartlett, and S. Mendelson Rademacher and Gaussian complexities: risk bounds and structural results Journal of Machine Learning Research 3 2002 463 482
4. R. Duin, and E. Pekalska Object representation, sample size and data complexity M. Basu, T.K. Ho, Data Complexity in Pattern Recognition 2006 Springer London 25 47
5. A. Blum, and T. Mitchell Combining labeled and unlabeled data with co-training Proceedings of the Conference on Computational Learning Theory 1998
6. K. Nigam, and R. Ghani Analyzing the effectiveness and applicability of co-training Proceedings of Information and Knowledge Management 2000
7. I. Muslea, C. Kloblock, and S. Minton Activesemi-supervised learning = robust multi-view learning ICML 2002
8. W.C. Lin, F.Y. Liao, C.K. Tsao, and T. Lingutla A hierarchical multiple-view approach to three-dimensional object recognition IEEE Transactions on Neural Networks 2 1 1991 84 92
9. L. Breiman Bagging predictors Machine Learning 24 1996 123 140 (Pubitemid 126724382)
10. R. Brylla, R. Gutierrez-Osunab, and F. Queka Attribute Bagging: improving accuracy of classifier ensembles by using random feature subsets Pattern Recognition 36 2003 1291 1302
11. G. Valentini, and F. Masulli Ensembles of learning machines M. Marinaro, R. Tagliaferri, WIRN VIETRI, Lecture Notes in Computer Science, vol. 2486 2002 3 20
12. A.K. Seewald Towards a theoretical framework for ensemble classification Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence (IJCAI-03) 2003 Morgan Kaufmann 1443 1444
13. T. Windeatt Accuracy/diversity and ensemble MLP classifier design IEEE Transactions on Neural Networks 17 5 2006 1194 1211 (Pubitemid 46445178)
14. B. Igelnik, Y.-H. Pao, S.R. LeClair, and C.Y. Shen The ensemble approach to neural-network learning and generalization IEEE Transactions on Neural Networks 10 1 1999 19 30
15. E. Ho, and R.L. Kashyap An algorithm for linear inequalities and its applications IEEE Transactions on Electronics Computers 14 1965 683 688
16. J. Leski Ho-Kashyap classifier with generalization control Pattern Recognition Letters 24 14 2003 2281 2290
17. S. Chen, Z. Wang, and Y. Tian Matrix-pattern-oriented HoKashyap classifier with regularization learning Pattern Recognition 40 5 2007 1533 1543 (Pubitemid 46123380)
18. V. Vapnik Statistical Learning Theory 1998 John Wiley New York
19. Z. Wang, and S. Chen New least squares support vector machines based on matrix patterns Neural Processing Letters 26 2007 41 56 (Pubitemid 47185510)
20. D.J. Newman, S. Hettich, C.L. Blake, C.J. Merz, UCI repository of machine learning databases. Available from: 〈 http://www.ics.uci.edu/~mlearn/ MLRepository.html 〉, 1998.
21. R.O. Duda, P.E. Hart, and D.G. Stock Pattern Classification second ed. 2001 John Wiley and Sons, Inc. New York
22. Z. Wang, and S. Chen Matrix-pattern-oriented least squares support vector classifier with AdaBoost Pattern Recognition Letters 29 6 2008 745 753
23. Q.S. Xu, and Y.Z. Liang Monte Carlo cross validation Chemometrics and Intelligent Laboratory Systems 56 2001 1 11
24. M. Hubert, and S. Engelen Fast cross-validation of high-breakdown resampling methods for PCA Computational Statistics & Data Analysis 51 10 2007 5013 5024 (Pubitemid 46635896)
25. X. Geng, D.-C. Zhan, and Z.-H. Zhou Supervised nonlinear dimensionality reduction for visualization and classification IEEE Transactions on Systems, Man and Cybernetics, Part B 35 6 2005 1098 1107 (Pubitemid 41800411)
26. T.M. Mitchell Machine Learning 1997 McGraw-Hill Boston
27. D. Beymer, and T. Poggio Image representations for visual learning Science 272 1996 1905 1909 (Pubitemid 26234494)
28. L.F. Chen, H.Y.M. Liao, M.T. Ko, J.C. Lin, and G.J. Yu A new LDA-based face recognition system which can solve the small sample size problem Pattern Recognition 33 2000 1713 1726
29. S. Haykin, Neural Networks, A Comprehensive Foundation, second ed., Prentice-Hall, Upper Saddle River, 1999.
30. S. Chen, Y. Zhu, D. Zhang, and J. Yang Feature extraction approaches based on matrix pattern: MatPCA and MatFLDA Pattern Recognition Letters 26 2005 1157 1167 (Pubitemid 40556483)
31. Z. Wang, S. Chen, H. Xue, and Z.S. Pan A novel regularization learning for single-view patterns: multi-view discriminative regularization Neural Processing Letters 31 2010 159 175
32. Z. Wang, S. Chen, J. Liu, and D. Zhang Pattern representation in feature extraction and classifier design: matrix versus vector IEEE Transactions on Neural Networks 19 5 2008 758 769 (Pubitemid 351728813)
33. A. Graham Kronecker Products and Matrix Calculus: with Applications 1981 Halsted Press, John Wiley and Sons NY
34. P. Zhang, and J. Peng SVM vs regularized least squares classification Proceedings of the 17th International Conference on Pattern Recognition 2004
35. J. Basak, and R. Kothari Classification paradigm for distributed vertically partitioned data Neural Computation 16 7 2004 1525 1544 (Pubitemid 38740019)
36. T. Evgeniou, M. Pontil, and T. Poggio Regularization networks and support vector machines Advances in Computational Mathematics 13 1 2000 1 50
37. K.R. Muller, S. Mika, G. Ratsch, K. Tsuda, and B. Scholkopf An introduction to kernel-based learning algorithms IEEE Transactions on Neural Networks 12 2 2001 181 202
38. J. Shawe-Taylor, and N. Cristianini Kernel Methods for Pattern Analysis 2004 Cambridge University
39. L.I. Kuncheva Combining Pattern Classifiers 2004 J. Wiley & Sons
40. R.E. Schapire The boosting approach to machine learning: an overview D.D. Denison, M.H. Hansen, C. Holmes, B. Mallick, B. Yu, Nonlinear Estimation and Classification 2003 Springer
41. V. de Sa Learning classification with unlabeled data Proceedings of Neural Information Processing Systems 1994
42. U. Brefeld, T. Gartner, T. Scheffer, S. Wrobel, Efficient co-regularised least squares regression, in: Proceedings of the 23rd International Conference on Machine Learning (ICML'06), Pittsburgh, PA, 2006.
43. Z.H. Zhou, When semi-supervised learning meets ensemble learning, in: Proceedings of the 8th International Workshop on Multiple Classifier Systems (MCS'09), Lecture Notes in Computer Science, vol. 5519, Reykjavik, Iceland, 2009, pp. 529538.
44. W. Wang, Z.-H. Zhou, Analyzing co-training style algorithms, in: Proceedings of the 18th European Conference on Machine Learning (ECML'07), Warsaw, Poland, 2007, pp. 454465.
45. G. Brown, J.L. Wyatt, and P. Tino Managing diversity in regression ensembles Journal of Machine Learning Research 6 2005 1621 1650
46. D. Hardoon, J.D.R. Farquhar, H. Meng, J. Shawe-Taylor, and S. Szedmak Two view learning: SVM-2K, theory and practice Advances in Neural Information Processing Systems (NIPS'06) 2006
47. Z. Wang, and S. Chen Multi-view kernel machine on single-view data Neurocomputing 72 2009 2444 2449
48. J.X. Dong, A. Krzyzak, and C.Y. Suen Fast SVM training algorithm with decomposition on very large data sets IEEE Transactions on Pattern Analysis and Machine Intelligence 27 4 2005 603 618 (Pubitemid 40556114)
49. H.T. Chen, T.L. Liu, and C.S. Fuh Learning effective image metrics from few pairwise examples Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV'05) 2005