Feature selection algorithms for the generation of multiple classifier systems and their application to handwritten word recognition

Pattern Recognition Letters

Volumn 25, Issue 11, 2004, Pages 1323-1336

  Günter, Simon ^a   Bunke, Horst ^a  

^a UNIVERSITY OF BERN   (Switzerland)

Author keywords

Classifier combination; Ensemble creation method; Feature selection; Handwritten word recognition; Hidden Markov Model (HMM)

Indexed keywords

FEATURE EXTRACTION; MARKOV PROCESSES; MATHEMATICAL MODELS; PATTERN RECOGNITION; WORD PROCESSING;

CLASSIFIER COMBINATION; ENSEMBLE CREATION METHODS; FEATURE SELECTION; HANDWRITTEN WORD RECOGNITION; HIDDEN MARKOV MODEL (HMM);

ALGORITHMS;

EID: 23844545305     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2004.05.002     Document Type: Article

References (39)

1. Alkoot, F., Kittler, J., 2000. Feature selection for an ensemble of classifiers. in: Proc. 4th World Multiconf. Systemat, Cybernet. Informat., vol. VII, Orlando, Florida, 2000.
2. Bauer, E., Kohavi, R., 1999. An empirical comparison of voting classification algorithms: Bagging, boosting, and variants. Mach. Learning J. 36, 105-139.
3. Breiman, L., 1996. Bagging predictors. Mach. Learning (2), 123-140.
4. Devijver, P.A., Kittler, J., 1982. Pattern Recognition: A Statistical Approach. Prentice-Hall.
5. Dietterich, T.G., 2000. Ensemble methods in machine learning. in: (Kittler and Roli, 2000). pp. 1-15.
6. Freund, Y., 1995. Boosting a weak learning algorithm by majority. Informat. Computat. 121 (2), 256-285.
7. Freund, Y., Schapire, R., 1997. A descision-theoretic generalisation of on-line learning and an application to boosting. J. Comput. Syst. Sci. 55 (1), 119-139.
8. Fu, K., 1982. Syntactic Pattern Recognition and Applications. Prentice Hall.
9. Günter, S., Bunke, H., 2002. Creation of classifier ensembles for handwritten word recognition using feature selection algorithms. in: Proc. 8th Internat. Conf. Frontiers in Handwriting Recognition. 2002, pp. 183-188.
10. Ho, T.K., 1998. The random subspace method for constructing decision forests. IEEE Trans. Pattern Anal. Mach. Intell. 20 (8), 832-844.
11. Huang, Y., Suen, C., 1993. Combination of multiple classifiers with measurement values. in: Proc. of 2nd Int. Conf. Document Anal. Recognition. 1993, pp. 598-601.
12. Hull, D., 1993. Using statistical testing in the evaluation of retrieval experiments. in: Research and Development in Information Retrieval. 1993, pp. 329-338.
13. Impedovo, S., Wang, P., Bunke, H. (Eds.), 1997. Automatic Bankcheck Processing. World Scientific Publ. Co, Singapore.
14. Jain, A., Zongker, D., 1997. Feature selection: Evaluation, application, and small sample performance. IEEE Trans. Pattern Anal. Mach. Intell. 19 (2), 153-158.
15. Jain, A., Duin, R., Mao, J., 2000. Statistical pattern recognition: A review. IEEE Trans. Pattern Anal. Mach. Intell. 22, 4-37.
16. Jolliffe, LT., 1986. Principal Component Analysis. Springer-Verlag, New York.
17. Kaltenmeier, A., Caesar, T., Gloger, J., Mandler, E., 1993. Sophisticated topology of hidden Markov models for cursive script recognition. in: Proc. 2nd Internat. Conf. Document Anal. Recognition. Tsukuba Science City, Japan, 1993, pp. 139-142.
18. Kim, G., Govindaraju, V., Srihari, S., 1999. Architecture for handwritten text recognition systems. In: Lee, S.-W. (Ed.), Advances in Handwriting Recognition. World Scientific Publ. Co, pp. 163-172.
19. Kittler, J., Roli, F. (Eds.), 2000. 1st Int. Workshop on Multiple Classifier Systems. Springer, Cagliari, Italy, 2000.
20. Kittler, J., Pudil, P., Somol, P., 2001. Advances in statistical feature selection. in: Singh, S., Murshed, N., Kropatsch, W. (Eds.), Advances in Pattern Recognition-ICAPR. 2001, pp. 425-434.
21. Lee, L., Gomes, N., 1997. Disconnected handwritten numeral image recognition. in: Proc. 4th Internat. Conf. Document Anal. Recognition, vol. 2. 1997, pp. 467-470.
22. Lee, D, Srihari, S., 1993. Handprinted digit recognition: A comparison of algorithms. in: Proc. 3rd Int. Workshop on Frontiers in Handwriting Recognition. 1993, pp. 153-162.
23. Marti, U., Bunke, H., 2001. Using a statistical language model to improve the performance of an HMM-based cursive handwriting recognition system. Internat. J. Pattern Recognition Artificial Intelligence 15, 65-90.
24. Marti, U., Bunke, H., 2002. The IAM-database: An English sentence database for off-line handwriting recognition. Internat. J. Document Anal. Recognition 5, 39-46.
25. Maruyama, K., Nakano, Y., 2000. Recognition method for cursive Japanese word written in latin characters, in: Proc. 7th Internat. Workshop on Frontiers in Handwritten Recognition. 2000, pp. 133-142.
26. Narendra, M.P., Fukunaga, K., 1977. A branch and bound algorithm for feature subset selection. IEEE Trans. Comput. 26 (9), 917-922.
27. Opitz, D., Maclin, R., 1999. Popular ensemble methods: A survey. Journal of Artificial Intelligence Research 11, 169-198.
28. Oza, N., Turner, K., 2001. Input decimated ensembles: Decorrelation through dimensinality reduction. In: Kittler, J., Roli, F. (Eds.), 2nd Int. Workshop on Multiple Classifier Systems. Springer, Cambridge, UK, pp. 238-247.
29. Pudil, P., Novovic̃ovà, J., Kittler, J., 1994. Floating search methods in feature selection. Pattern Recognition Lett. 15 (11), 1119-1125.
30. Rabiner, L., 1989. A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77 (2), 257-285.
31. Schapire, R., 1990. The strength of weak learner. Mach. Learning 5 (2), 197-227.
32. Schapire, R., 2002. The boosting approach to machine learning. An overview. in: Proc. MSRI Workshop on Nonlinear Estimation and Classification. 2002, pp. 149-172.
33. Simon, J.-C, 1992. Off-line cursive word recognition. Proc. IEEE 80 (7), 1150-1161.
34. Somol, P., Pudil, P., 2000. Oscillating search algorithms for feature selection. in: Proc. 5th Internat. Conf. Pattern Recognition. 2000, pp. 406-409.
35. Suen, C., Lam, L., 2000. Multiple classifier combination methodologies for different output level. in: (Kittler and Roli, 2000). 2000, pp. 52-66.
36. Suen, C., Nadal, C., Legault, R., Mai, T., Lam, L., 1992. Computer recognition of unconstrained handwritten numerals. Proc. IEEE 80 (7), 1162-1180.
37. Xu, L., Krzyzak, A., Suen, C., 1992. Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Trans. Systems Man Cybernet. 22 (3), 418-435.
38. Young, S.J., Jansen, J., Odell, J.J., Ollason, D., Woodland, P.C., 1995. The HTK. Hidden Markov Model Toolkit Book, Entropic Cambridge Research Laboratory. Available from 〈http://htk.eng.cam.ac.uk/〉 1995.
39. Zimmermann, M., Bunke, H., 2002. Automatic segmentation of the IAM off-line database for handwritten English text. in: Proc. 16th Internat. Conf. Pattern Recognition. Quebec, Canada, 2002, pp. 369-374.