A new HMM-based ensemble generation method for numeral recognition

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4472 LNCS, Issue , 2007, Pages 52-61

  Ko, Albert Hung Ren ^a   Sabourin, Robert ^a   De Souza Britto Jr , Alceu ^b  

^a ÉCOLE DE TECHNOLOGIE SUPÉRIEURE   (Canada)

^b PONTIFICAL CATHOLIC UNIVERSITY OF PARANÁ   (Brazil)

Author keywords

Clustering validity index; Codebook size; Ensemble of classifiers; Hidden Markov models; Pattern recognition

Indexed keywords

CLASSIFICATION (OF INFORMATION); CODES (SYMBOLS); HIDDEN MARKOV MODELS; OPTIMIZATION; VECTOR QUANTIZATION;

CLUSTERING VALIDITY INDEX; CODEBOOK SIZE; ENSEMBLE OF CLASSIFIERS; PERFORMANCE DEGRADATION;

PATTERN RECOGNITION;

EID: 37249033137     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-72523-7_6     Document Type: Conference Paper

References (38)

1. Arica N. and Vural E.T.Y. (2000), "A shape descriptor based on circular Hidden Markov Model," In 15th Intl. Conf. on Pattern Recognition (ICPROO)
2. Bandyopadhyay S. and Maulik U. (2001), "Non-parametric Genetic Clustering: Comparison of Validity Indices," IEEE Transactions on Systems, Man and Cybernetics Part-C, vol. 31, no. 1, pp. 120-125
3. Bengio Y. (1999), "Markovian Models for Sequential Data", Neural Computing Surveys, vol. 2, pp. 129-162
4. Britto Jr. A (2001), "A Two-Stage HMM-Based Method for Recognizing Handwritten Numeral Strings," Ph.D. Thesis, Pontifical Catholic University of Paraná
5. Britto A.S., Sabourin R., Bortolozzi F. and Suen C.Y. (2003), "Recognition of Handwritten Numeral Strings Using a Two-Stage Hmm-Based Method", International Journal on Document Analysis and Recognition (IJDAR 5), no. 2-3, pp. 102-117
6. Dietterich T. G. (2002), "Machine Learning for Sequential Data: A Review.", In Structural, Syntactic, and Statistical Pattern Recognition, Lecture Notes in Computer Science, vol. 2396, pp. 15-30, Springer-Verlag
7. Eppstein D. (1998), "Fast hierarchical clustering and other applications of dynamic closest pairs", In Proceedings of the Ninth ACM-SIAM Symposium on Discrete Algorithms, pp. 619-628
8. Guenter S. and Bunke H. (2005), "Off-line cursive handwriting recognition using multiple classifier systems - on the influence of vocabulary, ensemble, and training set size," Optics and Lasers in Engineering, vol. 43, pp. 437-454
9. Guenter S. and Bunke H. (2004), "Ensembles of classifiers derived from multiple prototypes and their application to handwriting recognition," International Workshop on Multiple Classifier Systems (MCS 2004), pp. 314-323
10. Guenter S. and Bunke H. (2003), "Off-line Cursive Handwriting Recognition - On the Influence of Training Set and Vocabulary Size in Multiple Classifier Systems," Proceedings of the 11th Conference of the International Graphonomics Society
11. Guenter S. and Bunke H. (2002), "A new combination scheme for HMM-based classifiers and its application to handwriting recognition," Proc. 16th Int. Conference on Pattern Recognition, Vol. II, 332 - 337
12. Guenter S. and Bunke H. (2002), "Generating classifier ensembles from multiple prototypes and its application to handwriting recognition," Proceedings of the 3rd International Workshop on Multiple Classifier Systems, pp. 179 - 188
13. Guenter S. and Bunke H. (2002), "Creation of classifier ensembles for handwritten word recognition using feature selection algorithms," Proc. 8th Int. Workshop on Frontiers in Handwriting Recognition, pp. 183 - 188
14. Guenter S. and Bunke H. (2003), "Ensembles of Classifiers for Handwritten Word Recognition," International Journal of Document Analysis and Recognition, Volume 5, Number 4, 224 - 232
15. Guenter S. and Bunke H. (2003), "New Boosting Algorithms for Classification Problems with Large Number of Classes Applied to a Handwritten Word Recognition Task," Proceedings of the 4th International Workshop on Multiple Classifier Systems, pp. 326 - 335
16. Guenter S. and Bunke H. (2003), "Fast Feature Selection in an HMM-based Multiple Classifier System for Handwriting Recognition," Pattern Recognition, Proceedings of the 25th DAGM Symposium, pp. 289-296
17. Guenter S. and Bunke H. (2004), "Optimization of weights in a multiple classifier handwritten word recognition system using a genetic algorithm," Electronic Letters of Computer Vision and Image Analysis, vol. 3, no. 1, pp. 25 - 44
18. Halkidi M., Batistakis Y and Vazirgiannis M. (2001), "On Clustering Validation Techniques," Journal of Intelligent Information Systems, vol. 17, no. 2-3
19. Halkidi M., Batistakis Y. and Vazirgiannis M. (2002), "Clustering Validity Checking Methods: Part II," SIGMOD Record, vol. 31, no. 3, pp. 19-27
20. Huang X., Acero A. and Hon H. (2001), "Spoken Language Processing - a guide to theory, algorithm, and system development," Prentice Hall PTR
21. Johnson E. and Kargupta H. (1999), "Collective, hierarchical clustering from distributed, heterogeneous data", In Large-Scale Parallel KDD Systems, pp. 221-244
22. Kittler J., Hatef M., Duin R. P. W. and Matas J. (1998), "On Combining Classifiers," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 3, pp. 226-239
23. Ko, A., Sabourin, R., Britto Jr, A., "Combining Diversity and Classification Accuracy for Ensemble Selection in Random Subspaces", IEEE World Congress on Computational Intelligence (WCCI 2006) - International Joint Conference on Neural Networks (IJCNN 2006), 2006.
24. Ko, A., Sabourin, R., Britto Jr, A., "Evolving Ensemble of Classifiers in Random Subspace", Genetic and Evolutionary Computation Conference (GECCO 2006), 2006.
25. Kuncheva L. I., Skurichina M., and Duin R. P. W. (2002), "An Experimental Study on Diversity for Bagging and Boosting with Linear Classifiers," International Journal of Information Fusion, vol. 3, no. 2, pp. 245-258
26. Maulik U. and Bandyopadhyay S. (2002), "Performance Evaluation of Some Clustering Algorithms and Validity Indices," IEEE Trans. Pattern Anal. Mach Intell, vol. 24, no. 12, pp. 1650-1654
27. Pakhira M.K., Bandyopadhyay S. and Maulik U. (2004), "Validity index for crisp and fuzzy clusters," Pattern Recognition, vol. 37, No. 3, pp. 487-501
28. Pekalska E., Skurichina M. and Duin R. P. W. (2004), "Combining Dissimilarity-Based OneClass Classifiers," International Workshop on Multiple Classifier Systems (MCS 2004), pp. 122-133
29. Rabiner L. R. (1989), "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," Proceedings of the IEEE, 77(2):257 - 286
30. Rabiner L. R. and Juang B. H. ( 1993), "Fundamentals of Speech Recognition," Prentice-Hall
31. Ruta D. and Gabrys B. (2005), "Classifier Selection for Majority Voting," International Journal of Information Fusion, pp. 63-81
32. Seo J. and Shneiderman B. (2002), "Interactively Exploring Hierarchical Clustering Results," IEEE Computer, vol. 35, no. 7, pp. 80-86
33. Shipp C. A. and Kuncheva L.I. (2002), "Relationships between combination methods and measures of diversity in combining classifiers," International Journal of Information Fusion, vol.3, no. 2, pp. 135-148
34. Smyth P., Heckerman D., and Jordan M. I. (1997), "Probabilistic independence networks for hidden Markov probability models", Neural Computation, vol. 9, pp. 227-269
35. Wang X. (1994), "Durationally constrained training of HMM without explicit state durational", Proceedings of the Institute of Phonetic Sciences 18, pp. 111-130
36. Xie X.L. and Beni G. (1991), "A validity measure for fuzzy clustering",IEEE Transactions of Pattern Analysis and Machine Intelligence, pp. 841-847
37. Xu L., Krzyzak A., and Suen C. Y. (1992), "Methods of combining multiple classifiers and their applications to handwriting recognition," IEEE Transactions on Systems, Man and Cybernetics, vol. 22, no. 3, pp. 418-435
38. Xu L., Krzyzak A., and Suen C. Y. (1992), "Methods of combining multiple classifiers and their applications to handwriting recognition," IEEE Transactions on Systems, Man and Cybernetics, vol. 22, no. 3, pp. 418-435