An empirical study of a linear regression combiner on multi-class data sets

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5519 LNCS, Issue , 2009, Pages 478-487

  Zhang, Chun Xia ^a,b   Duin, Robert P W ^b  

^a XI'AN JIAOTONG UNIVERSITY   (China)

^b Delft University of Technology ^*  (Netherlands)

Author keywords

Decision template (DT); Ensemble classifier; Fisher linear discriminant (FLD); Multi response linear regression (MLR); Trainable combiner

Indexed keywords

DECISION TEMPLATE (DT); ENSEMBLE CLASSIFIER; FISHER LINEAR DISCRIMINANT (FLD); MULTI-RESPONSE LINEAR REGRESSION (MLR); TRAINABLE COMBINER;

DISCRIMINANT ANALYSIS; FACE RECOGNITION; LEARNING SYSTEMS; LINEAR REGRESSION; SAMPLING;

CLASSIFIERS;

EID: 70349305434     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-02326-2_48     Document Type: Conference Paper

References (18)

1. Kuncheva, L.I., Bezdek, J.C., Duin, R.P.W.: Decision templates for multiple classifier fusion: an experimental comparison. Pattern Recog. 34(2), 299-314 (2001)
2. Todorovski, L., D?zeroski, S.: Combining classifiers with meta decision trees. Mach. Learn. 50(3), 223-249 (2003)
3. Breiman, L.: Bagging predictors. Mach. Learn. 24(2), 123-140 (1996)
4. Freund, Y., Schapire, R.E.: Experiments with a new boosting algorithm. In: 13th International Conference on Machine Learning, pp. 148-156. Morgan Kaufmann Press, San Francisco (1996)
5. Breiman, L.: Randomizing outputs to increase prediction accuracy. Mach. Learn. 40(3), 229-242 (2000)
6. Ting, K.M., Witten, I.H.: Stacking bagged and dagged models. In: 14th International Conference on Machine Learning, pp. 367-375. Morgan Kaufmann Press, San Francisco (1997)
7. Ting, K.M., Witten, I.H.: Issues in stacked generalization. J. Artif. Intell. Res. 10, 271-289 (1999)
8. Merz, C.J.: Using corresponding analysis to combine classifiers. Mach. Learn. 36(1/2), 33-58 (1999)
9. Seewald, A.K.: How to make stacking better and faster while also taking care of an unknown weakness. In: 19th International Conference on Machine learning, pp. 554-561. Morgan Kaufmann Press, San Francisco (2002)
10. Džeroski, S., ?Zenko, B.: Is combining classifiers with stacking better than selecting the best ones? Mach. Learn. 54(3), 255-273 (2004)
11. Raudys, S.: Trainable fusion rules: I. Large sample size case. Neural Networks 19(10), 1506-1516 (2006)
12. Raudys, S.: Trainable fusion rules: II. Small sample-size effects. Neural Networks 19(10), 1517-1527 (2006)
13. Paclík, P., Landgrebe, T.C.W., Tax, D.M.J., Duin, R.P.W.: On deriving the secondstage training set for trainable combiners. In: Oza, N.C., Polikar, R., Kittler, J., Roli, F. (eds.) MCS 2005. LNCS, vol. 3541, pp. 136-146. Springer, Heidelberg (2005)
14. Liu, M., Yuan, B.Z., Chen, J.F., Miao, Z.j.: Does linear combination outperform the k-NN rule? In: 8th International Conference on Signal Processing, vol. 3. IEEE Press, Beijing (2006)
15. Lawson, C.J., Hanson, R.J.: Solving Least Squares Problems. SIAM Publications, Philadephia (1995)
16. Wolpert, D.H.: Stacked generalization. Neural Networks 5(2), 241-259 (1992)
17. UCI machine larning respository, http://www.ics.uci.edu/̃mlearn/ MLRespository.html
18. Lai, C.: Supervised classification and spatial dependency analysis in human cancer using high throughput data. Ph.D Thesis, Delft University of Technology (2008)