Optimization of ensemble based decision using PSO

WCE 2010 - World Congress on Engineering 2010

Volumn 1, Issue , 2010, Pages 671-676

  Kausar, Asma ^a   Ishtiaq, M ^a   Jaffar, M Arfan ^a   Mirza, Anwar M ^a  

^a NATIONAL UNIVERSITY OF COMPUTER AND EMERGING SCIENCES   (Pakistan)

Author keywords

Classification; Classifier fusion; Decision profile; Ensemble; k fold; PSO; WMV

Indexed keywords

CLASSIFIER FUSION; DECISION PROFILE; ENSEMBLE; K-FOLD; PSO; WMV;

BEHAVIORAL RESEARCH;

PARTICLE SWARM OPTIMIZATION (PSO);

EID: 79959816326     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (43)

1. Devi Parikh and Robi Poliker, "An Ensemble-Based Incremental Learning Approach to Data Fusion," IEEE Transactions on Systems, Man and Cybernetics, Vol. 37, No. 2, April 2007.
2. J. Zhang, S.K. Zhou, L. McMillan, D. Comaniciu: Joint Real-Time Object Detection and Pose Estimation Using Probabilistic Boosting Network, IEEE Conf. Computer Vision and Pattern Recognition (CVPR'07), Minneapolis, MN, 2007.
3. G. Fumera and F. Roli, "Performance analysis and comparison of linear combiners for classifier fusion," presented at the 16th Int. Conf. Pattern Recognition, 2002.
4. J. Kittler, M. Hatef, R. P. W. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 226-239, Mar. 1998.
5. -, "A theoretical study on expert fusion strategies," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, pp. 281-286, Feb. 2002.
6. Proc. 3rd Int. Workshop Multiple Classifier Systems, vol. 2364, Lecture Notes In Computer Science, F. Roli and J. Kittler, Eds., Cagliari, Italy, 2002.
7. G. S. Sebestyen. Decision-Making Process in Pattern Recognition. The Macmillan Company, N.Y., 1962.
8. B.V. Dasarathy and B.V. Sheela, "Composite classifier system design: Concepts and methodology," Proceedings of the IEEE, vol. 67, no. 5, pp. 708-713, 1979.
9. L. A. Rastrigin and R. H. Erenstein. Method of Collective Recognition. Energoizdat, Moscow, 1981.
10. K. Woods, W. P. Kegelmeyer, and K. Bowyer. Combination of multiple classifiers using local accuracy estimates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19:405-410, 1997. (Pubitemid 127762896)
11. Y. L. Barabash. Collective Statistical Decisions in Recognition. Radio i Sviaz', Moscow, 1983.
12. L.K. Hansen and P. Salamon, "Neural network ensembles," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 12, no. 10, pp. 993-1001, 1990.
13. R.E. Schapire, "The strength of weak learnability," Machine Learning, vol. 5, no. 2, pp. 197-227, 1990.
14. R.A. Jacobs, M.I. Jordan, S.J. Nowlan, and G.E. Hinton, "Adaptive mixtures of local experts," Neural Computation, vol. 3, pp. 79-87, 1991.
15. D.H. Wolpert, "Stacked generalization," Neural Networks, vol. 5, no. 2, pp. 241-259, 1992.
16. L. Xu, A. Krzyzak, and C.Y. Suen, "Methods of combining multiple classifiers and their applications to handwriting recognition," IEEE Transactions on Systems, Man and Cybernetics, vol. 22, no. 3, pp. 418-435, 1992.
17. T.K. Ho, J.J. Hull, and S.N. Srihari, "Decision combination in multiple classifier systems," IEEE Trans. on Pattern Analy. Machine Intel., vol. 16, no. 1, pp. 66-75, 1994.
18. G. Rogova, "Combining the results of several neural network classifiers," Neural Networks, vol. 7, no. 5, pp. 777-781, 1994.
19. K. Woods, W.P.J. Kegelmeyer, and K. Bowyer, "Combination of multiple classifiers using local accuracy estimates," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 4, pp. 405-410, 1997.
20. S.B. Cho and J.H. Kim, "Combining multiple neural networks by fuzzy integral for robust classification," IEEE Transactions on Systems, Man and Cybernetics, vol. 25, no. 2, pp. 380-384, 1995.
21. L.I. Kuncheva, J.C. Bezdek, and R Duin, "Decision templates for multiple classifier fusion: An experimental comparison," Pattern Recognition, vol. 34, no. 2, pp. 299-314, 2001.
22. H. Drucker, C. Cortes, L.D. Jackel, Y. LeCun, and V. Vapnik, "Boosting and other ensemble methods," Neural Computation, vol. 6, no. 6, pp. 1289-1301, 1994.
23. R. Battiti and A.M. Colla, "Democracy in neural nets: Voting schemes for classification," Neural Networks, vol. 7, no. 4, pp. 691-707, 1994.
24. L.I. Kuncheva, "Classifier ensembles for changing environments," 5th Int. Workshop on Multiple Classifier Systems, Lecture Notes in Computer Science, F. Roli, J. Kittler, and T. Windeatt, Eds., vol. 3077, pp. 1-15, 2004.
25. L. Breiman, "Bagging predictors," Machine Learning, vol. 24, no. 2, pp. 123-140, 1996.
26. F.M. Alkoot and J. Kittler, "Experimental evaluation of expert fusion strategies," Pattern Recognition Letters, vol. 20, no. 11-13, pp. 1361-1369, Nov. 1999.
27. L. Breiman, "Random Forests," Machine Learning, vol. 45, no. 1, pp. 5-32, Oct. 2001.
28. L. Breiman, "Pasting small votes for classifcation in large databases and on-line," Machine Learning, vol. 36, pp. 85-103, 1999.
29. Y. Freund and R.E. Schapire, "Decision-theoretic generalization of on-line learning and an application to boosting," Journal of Computer and System Sciences, vol. 55, no. 1, pp. 119-139, 1997.
30. Learn++.NC
31. F.M. Alkoot and J. Kittler, "Experimental evaluation of expert fusion strategies," Pattern Recognition Letters, vol. 20, no. 11-13, pp. 1361-1369, Nov. 1999.
32. J. Kittler, M. Hatef, R.P.W. Duin, and J. Mates, "On combining classifiers," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 20, no. 3, pp. 226-239, 1998.
33. M. Muhlbaier, A. Topalis, and R. Polikar, "Ensemble confidence estimates posterior probability," 6th Int. Workshop on Multiple Classifier Sys., in Lecture Notes in Comp. Science, N. Oza, R. Polikar, J. Kittler, and F. Roli, Eds., vol. 3541, pp. 326-335, 2005.
34. L.I. Kuncheva, "A theoretical study on six classifier fusion strategies," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 2, pp. 281-286, 2002.
35. Y. Lu, "Knowledge integration in a multiple classifier system," Applied Intelligence, vol. 6, no. 2, pp. 75-86, 1996.
36. L.I. Kuncheva, "Using measures of similarity and inclusion for multiple classifier fusion by decision templates," Fuzzy Sets and Systems, vol. 122, no. 3, pp. 401-407, 2001.
37. G. Fumera and F. Roli, "A Theoretical and Experimental Analysis of Linear Combiners for Multiple Classifier Systems," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 6, pp. 942-956, 2005.
38. Various Authors, "Proceedings of International Workshop on Multiple Classifier Systems (2000-2005)," F. Roli, J. Kittler, T. Windeatt, N. C. Oza, and R. Polikar, Eds. Berlin, Germany: Springer, 2005.
39. R. A. Jacobs. Methods for combining experts' probability assessments. Neural Computation, 7:867-888, 1995.
40. C. Diamantini and A. Spalvieri. Quantizing for minimum average misclassification risk. IEEE Transactions on Neural Networks, 9(1):174-182, 1998. (Pubitemid 128743623)
41. Kennedy, J. and Eberhart, R., "Particle Swarm Optimization," Proceedings of the IEEE International Conference on Neural Networks, Perth, Australia 1995, pp. 1942-1945.
42. Kennedy, J. and Eberhart, R., Swarm Intelligence, Academic Press, 1st ed., San Diego, CA, 2001.
43. Venter, G. and Sobieski, J., "Particle Swarm Optimization," AIAA 2002-1235, 43rd AIAA/ASME/ASCE/ AHS/ASC Structures, Structural Dynamics, and Materials Conference, Denver, CO., April 2002.