Diversity regularized machine

IJCAI International Joint Conference on Artificial Intelligence

Volumn , Issue , 2011, Pages 1603-1608

  Yu, Yang ^a   Li, Yu Feng ^a   Zhou, Zhi Hua ^a  

^a NANJING UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

DIVERSITY CONTROL; ENSEMBLE METHODS; GENERALIZATION ABILITY; HYPOTHESIS SPACE; LEARNING APPROACH; STATISTICAL LEARNING; SUPPORT VECTOR MACHINE (SVMS); SVM ENSEMBLES;

ARTIFICIAL INTELLIGENCE; MATHEMATICAL PROGRAMMING;

SUPPORT VECTOR MACHINES;

EID: 84865079075     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.5591/978-1-57735-516-8/IJCAI11-269     Document Type: Conference Paper

References (25)

1. M. Anthony and P.L. Bartlett. Neural Network Learning: Theoretical Foundations. Cambridge University Press, Cambridge, UK, 1999.
2. P.L. Bartelett. The sample complexity of pattern classification with neural networks: The size of the weights is more important than the size of the network. IEEE Transactions on Information Theory, 44(2):525-536, 1998.
3. S.P. Boyd and L. Vandenberghe. Convex Optimization. Cambridge University Press, New York, NY, 2004.
4. L.E. Breiman. Bagging predictors. Machine Learning, 24(2):123-140, 1996.
5. L.E. Breiman. Randomizing outputs to increase prediction accuracy. Machine Learning, 40(3):229-242, 2000.
6. L.E. Breiman. Random forests. Machine Learning, 45(1):5-32, 2001.
7. G. Brown, J.Wyatt, R. Harris, and X. Yao. Diversity creation methods: A survey and categorisation. Information Fusion, 6(1):5-20, 2005.
8. G. Brown. An information theoretic perspective on multiple classifier systems. In Proceedings of the 8th International Workshop Multiple Classifier Systems (MCS'09), pages 344-353, Reykjavik, Iceland, 2009.
9. C.C. Chang and C.J. Lin. LIBSVM: A library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm, 2001.
10. T.G. Dietterich. An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization. Machine Learning, 40(2):139-157, 2000.
11. T.G. Dietterich. Ensemble learning. In M.A. Arbib, editor, The Handbook of Brain Theory and Neural Networks, 2nd edition. MIT Press, Cambridge, MA, 2002.
12. Y. Freund and R.E. Schapire. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55(1):119-139, 1997. (Pubitemid 127433398)
13. G. Giacinto and F. Roli. Design of effective neural network ensembles for image classification purposes. Image and Vision Computing, 19(9-10):699-707, 2001. (Pubitemid 32746163)
14. T.K. Ho. The random subspace method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(8):832-844, 1998. (Pubitemid 128741345)
15. A. Krogh and J. Vedelsby. Neural network ensembles, cross validation, and active learning. In G. Tesauro, D.S. Touretzky, and T.K. Leen, editors, Advances in Neural Information Processing Systems 7 (NIPS'94), pages 231-238. MIT Press, 1995.
16. L.I. Kuncheva, C.J. Whitaker, C. Shipp, and R. Duin. Limits on the majority vote accuracy in classifier fusion. Pattern Analysis and Applications, 6(1):22-31, 2003. (Pubitemid 36719921)
17. Z. Luo and P. Tseng. On the convergence of the coordinate descent method for convex differentiable minimization. Journal of Optimization Theory and Applications, 72(1):7-35, 1992.
18. B. Schölkopf, A.J. Smola, R.C. Williamson, and P.L. Bartlett. New support vector algorithms. Neural Computation, 12(5):1207-1245, 2000.
19. Alex J. Smola, John Shawe-Taylor, B. Schölkopf, and R. C. Williamson. The entropy regularization information criterion. In S.A. Solla, T.K. Leen, and K.-R. Müller, editors, Advances in Neural Information Processing Systems 12 (NIPS'99), pages 342-348. The MIT Press, 2000.
20. P. Ueda and R. Nakano. Generalization error of ensemble estimators. In Proceedings of International Conference on Neural Networks (ICNN'96), pages 90-95, Washington, DC, 1996.
21. L. Valiant. A theory of the learnable. Communication of the ACM, 27(11):1134-1142, 1984.
22. V. Vapnik. The Nature of Statistical Learning Theory. Springer-Verlag, New York, NY, 1995.
23. T. Zhang. Covering number bounds of certain regularized linear function classes. Journal of Machine Learning Research, 2:527-550, 2002. (Pubitemid 135712571)
24. Z.-H. Zhou and N. Li. Multi-information ensemble diversity. In Proceedings of the 9th International Workshop on Multiple Classifier Systems (MCS'10), pages 134-144, Cairo, Egypt, 2010.
25. Z.-H. Zhou and Y. Yu. Ensembling local learners through multi-modal perturbation. IEEE Transaction on System, Man, And Cybernetics - Part B: Cybernetics, 35(4):725-735, 2005.