Local classifier weighting by quadratic programming

IEEE Transactions on Neural Networks

Volumn 19, Issue 10, 2008, Pages 1832-1838

  Cevikalp, Hakan ^a   Polikar, Robi ^b  

^a ESKISEHIR OSMANGAZI UNIVERSITY   (Turkey)

^b Rowan University   (United States)

Author keywords

Classification; Classifier fusion; Combining multiple classifiers; Ensemble learning; Local classification accuracy; Neural networks; Quadratic programming

Indexed keywords

DECISION MAKING; LEARNING SYSTEMS; NETWORK PROTOCOLS; NEURAL NETWORKS; NONLINEAR PROGRAMMING; OBJECT RECOGNITION; PROBLEM SOLVING; QUADRATIC PROGRAMMING; SENSOR NETWORKS;

CLASSIFICATION; CLASSIFIER FUSION; COMBINING MULTIPLE CLASSIFIERS; ENSEMBLE LEARNING; LOCAL CLASSIFICATION ACCURACY;

CLASSIFIERS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; MATHEMATICAL COMPUTING; METHODOLOGY; SYSTEM ANALYSIS; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; MODELS, THEORETICAL; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; PROGRAMMING, LINEAR;

EID: 54349120991     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2008.2005301     Document Type: Article

References (24)

1. J. Kittler, R. P. W. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 3, pp. 226-239, Mar. 1998.
2. R. Polikar, A. Topalis, D. Parikh, D. Green, J. Frymiare, and C. M. Clark, "An ensemble based data fusion approach for early diagnosis of Alzheimer's disease," Inf. Fusion, vol. 9, pp. 83-95, 2008.
3. R. Polikar, "Ensemble based systems in decision making," IEEE Circuits Syst. Mag., vol. 6, no. 3, pp. 21-45, 2006.
4. G. Fumera and F. Roli, "A theoretical and experimental analysis of linear combiners for multiple classifier systems," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 6, pp. 942-956, Jun. 2005.
5. L. I. Kuncheva, "Decision templates for multiple classifier fusion: And experimental comparison," Pattern Recognit., vol. 34, pp. 299-314, 2001.
6. L. I. Kuncheva, "Switching between selection and fusion in combining classifiers: An experiment," IEEE Trans. Syst. Man Cybern. B, Cybern., vol. 32, no. 2, pp. 146-156, Apr. 2002.
7. Y. Freund and R. E. Schapire, "A decision theoretic generalization of on-line learning and application to boosting," J. Comput. Syst. Sci. vol. 55, pp. 119-139, 1997.
8. D. M. J. Tax, M. van Breukelen, R. W. Duin, and J. Kittler, "Combining multiple classifiers by averaging or multiplying," Pattern Recognit. vol. 33, pp. 1475-1485, 2000.
9. T. K. Ho, J. J. Hull, and S. N. Srihari, "Decision combination in multiple classifier systems," IEEE Trans. Pattern Anal. Mach. Intell., vol. 16, no. 1, pp. 66-75, Jan. 1994.
10. R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton, "Adaptive mixtures of local experts," Neural Comput., vol. 3, pp. 79-87, 1991.
11. K. Woods, W. P. Kegelmeyer, and K. Bowyer, "Combination of multiple, classifiers using local accuracy estimates," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 4, pp. 405-410, Apr. 1997.
12. N. Ueda, "Optimal linear combination of neural networks for improving classification performance," IEEE Trans. Pattern Anal. Mach. Intell. vol. 22, no. 2, pp. 207-215, Feb. 2000.
13. L. I. Kuncheva, "A theoretical study on six classifier fusion strategies," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 2, pp. 281-286, Feb. 2002.
14. J. Grim, J. Kittler, P. Pudil, and P. Somol, "Multiple classifier fusion in probabilistic neural networks," Pattern Anal. Appl., vol. 5, pp. 221-233, 2002.
15. G. Rogova, "Combining the results of several network classifiers," Neural Netw., vol. 7, pp. 777-781, 1994.
16. Y. Lu, "Knowledge integration in a multiple classifier system," Appl. Intell., vol. 6, pp. 75-86, 1996.
17. K. Tumer and J. Ghosh, "Analysis of decision boundaries in linearly combined neural classifiers," Pattern Recognit., vol. 29, pp. 341-348, 1996.
18. Y. Freund and R. E. Schapire, "Experiments with a new boosting algorithm," in Proc. Int. Conf. Mach. Learn., 1996, pp. 148-156
19. V. Tresp and M. Taniguchi, "Combining estimators using non-constant weighting functions," in Advances in Neural Information Processing Systems, G. Tesauro, D. Touretzky, and T. Leen, Eds. Cambridge, MA: MIT Press, 1995, vol. 7, pp. 419-426.
20. L. Breiman, "Stacked regressions," Mach. Learn. vol. 24, no. 1, pp. 49-64, 1996.
21. J. H. Friedman, J. L. Bentley, and R. A. Finkel, "An algorithm for finding best matches in logarithmic expected time," ACM Trans. Math. Software, vol. 3, pp. 209-226, 1977.
22. P. Indyk, "Nearest neighbors in high-dimensional spaces," in Handbook of Discrete and Computational Geometry, Chapter 39, J. E. Goodman and J. O'Rourke, Eds., 2rd ed. Boca Raton, FL: CRC Press, 2004.
23. B. Scholkopf, K. K. Sung, C. J. C. Burges, F. Girosi, P. Niyogi, T. Poggio, and V. Vapink, "Comparison support vector machines with Gaussian kernels to radial basis function classifiers," IEEE Trans. Signal Process., vol. 45, no. 11, pp. 2758-2765, Nov. 1997.
24. C. W. Hsu and C. J. Lin, "A comparison of methods for multiclass support vector machines," IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 415-425, Mar. 2002.