Measuring diversity in regression emsembles

Proceedings of the 4th Indian International Conference on Artificial Intelligence, IICAI 2009

Volumn , Issue , 2009, Pages 2220-2236

  Dutta, Haimonti ^a  

^a Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AVERAGE QUADRATIC ERROR; CORRELATION COEFFICIENT; DISSIMILARITY MEASURES; ENSEMBLE LEARNING; MACHINE LEARNING COMMUNITIES; MUTUAL INFORMATIONS; QUADRATIC ERRORS; RANDOM FORESTS;

ARTIFICIAL INTELLIGENCE; DECISION TREES;

REGRESSION ANALYSIS;

EID: 80053894086     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. R.E. Banfield, L.O. Hall, K.W. Bowyer, and P.W. Kegelmeyer. A new ensemble di-versity measure applied to thinning ensembles. In Proceedings of the International Workshop on Multiple Classifier Systems, pages 306-316, 2003.
2. L. Breiman. Stacked regression. Technical Report TR-367, University of Califor-nia, Berkeley, 1993.
3. Leo Breiman. Bagging predictors. In Machine Learning, pages 123-140, 1996.
4. L. Breiman. Randomizing outputs to increase prediction accuracy. Machine Learn-ing, 40:229-242, 2000.
5. Leo Breiman. Random forests. Mack Learn.. 45(1):5-32, 2001.
6. Gavin Brown, Jeremy L. Wyatt, and Peter Tifio. Managing diversity in regression ensembles. J. Mack Learn. Res., 6:1621-1650. 2005.
7. K. J. Cherkauer. Human expert-level performance on a scientific image analysis task by a system using combined artifical neural networks. In P. Chan, editor. Work-ing notes oftheAAAI Workshop on Integrating Multiple Learned Models, pages 15 -21, Menlo Park. 1996. AAAI Press.
8. Stefan W. Christensen. Ensemble construction via designed output distortion. Lec-ture Notes in Computer Science, 2709:286-295, 2003. Proc. 4th Int. Workshop Multiple Classifier Systems, Guildford. Surrey, UK, June 11-13 2003.
9. Rich Caruana, Art Munson, and Alexandru Niculescu-Mizil. Getting the most out of ensemble selection. In ICDM '06: Proceedings of the Sixth International Con-ference on Data Mining, pages 828-833, Washington. DC. USA, 2006. IEEE Com-puter Society.
10. Rich Caruana, Alexandru Niculescu-Mizil, Geoff Crew, and Alex Ksikes. Ensem-ble selection from libraries of models. In In Proc. 21st International Conference on Machine Learning, pages 137-144, 2004.
11. T. G. Dietterich and G. Bakiri. Solving multiclass learning problems via error- correcting output codes. In Journal of Artificial Intelligence Research, volume 2, pages 263-286, 1995.
12. H. Drucker and C. Cortes. Boosting decision trees. In Advances in Neural Infor-mation Processing Systems, volume 8. pages 479-485. 1996.
13. http://www.cs.toronto.edu/dclve/data/dataseLs.html. Website.
14. T. G. Dietlerich. Ensemble learning. The Handbook of Brain Theory and Neural Networks. Second Edition, 2002.
15. Giorgio Giacinto, Fabio Roli. and Giorgio Fumera. Design of effective multiple classifier systems by clustering of classifiers. In Proc. ofICPR2000, 15th Int. Con-ference on Pattern Recognition, pages 3-8. 2000.
16. T. K. Ho. The random subspace method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20:832-844. 1998.
17. A. Krogh and J. Vedelsby. Neural network ensembles, cross validation, and active learning. In Advances in Neural Information Processing Systems. pages 231-238. MIT Press. 1995.
18. L.I. Kuncheva and C.J. Whitaker. Ten measures of diversity in classifier ensem-bles: limits for two classifiers. Intelligent Sensor Processing (Ref. No. 2001/050J. A DERA/IEE Workshop on. pages 1(V 1-1010. Feb. 2001.
19. Ludmila I. Kuncheva and Christopher J. Whitaker. Measures of diversity in clas-sifier ensembles and their relationship with the ensemble accuracy. Mach. Learn., 51(2): 181-207. 2003.
20. Yong Liu and Xin Yao. Fnsemble learning via negative correlation. Neural Net-works. 12:1399-1404. 1999.
21. N. J. Nilsson. Learning Machines: Foundations of Trainable Pattern-Classifying Systems. McGraw Hill. NY. 1965.
22. D. Opitz and J. Shavlik. A genetic algorithm approach for creating neural network ensembles. In Springer Verlag. editor. Combining Artificial Neural Networks, pages 79-99, 1999.
23. Nikunj C. Oza and Kagan Turner. Key real-world applications of classifier en-sembles. Information Fusion. Special Issue on Applications of Ensemble Methods, 9(1):4-20, 2008.
24. Fu Qiang, Hu Shang-xu. and Zhao Sheng-ying. Clustering-based selective neural network ensemble. In Journal ofZhejiang University• - Science A. volume 6, pages 387-392. 2005.
25. Kevin W. Bowyer, Robert F. Banfield, Lawrence O. Hall and W. Philip Kegelmeyer. Ensemble diversity measures and their application to thinning. Diversity in Multiple Classifier Systems, 1(6):49-62, 2005.
26. Romesh Ranawana and Vasile Palade. Multi-classifier systems: Review and a roadmap for developers. Int. J. Hybrid Intel! Syst., 3(1):35-61, 2006.
27. R. F. Schapirc. Theoretical views of boosting. In Computational Learning Theory: Fourth European Conference, pages 1-10, 1999.
28. A. J. C Sharkey and N. F Sharkey. Combining diverse neural nets. The Knowledge Engineering Review, 12:231-247. 1997.
29. F. K. Tang, P. N. Suganthan. and X. Yao. An analysis of diversity measures. Mach Learn., 65(1):247-271. 2006.
30. D. Wolpert. Stacked generalization. Neural Nenvorks. 5:241 - 259. 1992.
31. Xin Yao and Yong Liu. Evolving neural network ensembles by minimization of mutual information. Int. J. Hybrid Intell. Syst., 1(1-2): 12-21, 2004.