On the structure of hidden Markov models

Pattern Recognition Letters

Volumn 25, Issue 8, 2004, Pages 923-931

  Abou Moustafa, K T ^a,b   Cheriet, M ^b   Suen, C Y ^a  

^a Dept of Electrical and Computer Engineering   (Canada)

^b ÉCOLE DE TECHNOLOGIE SUPÉRIEURE   (Canada)

Author keywords

Credits diffusion; Graphical models; HMM structure; K Means clustering; Ocham's razor

Indexed keywords

DIFFUSION; GRAPHIC METHODS; MATHEMATICAL MODELS; TOPOLOGY;

GRAPHICAL MODELS; HIDDEN MARKOV MODELS;

MARKOV PROCESSES;

IMAGE CLASSIFICATION;

EID: 2442590570     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2004.02.005     Document Type: Article

References (34)

1. Augusting E. Baret O. Knerr S. Price D. Hidden Markov model based word recognition and its application to legal amount recognition on Frensh bank cheques Comput. Vision Image Understand. 70 3 1998 404-419
2. Bahlman, C., Burkhardt, H., Ludwigs, A., 2001. Measuring HMM similarity with the Bayes probability of error and its application. In: Proc. 6th ICDAR, Seattle, Washington, USA. pp. 406-411
3. Baker J.K. The Dragon system--an overview IEEE Trans. Acoust., Speech Signal Process 23 11 1975 23-29
4. Balasubramanian V. Equivalence and reduction of hidden Markov models MIT Artificial Intell. Lab. Tech. Report 1370 1993
5. Baum L.E. Petrie T. Statistical inference for probabilistic functions of finite state Markov chains Ann. Math. Statist. 37 1966 1554-1563
6. Bengio Y. Frasconi P. Diffusion of credits in Markovain model Neural Informat. Process. System 7 1995 1251-1254
7. Bengio Y. Markovian models for sequential data Neural Comput. Surveys 41 1 1999 129-162
8. Bezdek J.C. Pal N.R. Some new indexes of cluster validity IEEE Trans. Systems Man Cybernet. Part B 28 3 1998 301-315
9. Bicego M. Dovier A. Murino V. Designing the minimal structure hidden Markov model by bisimulation Figueiredo M. Zerubia J. Jain A.K. Energy Minimization Methods in Computer Vision and Pattern Recognition 2001 75-90 Springer
10. Bicego M. Murino V. Figueiredo M. A sequential pruning strategy for the selection of the number of states in hidden Markov models Pattern Recognition Lett. 24 2003 1395-1407
11. Biem, A., 2003. A model selection criterion for classification: Application to HMM topology optimization. In: Proc. 17th ICDAR, Edinburgh, UK. pp. 104-108
12. Bladi P. Brunak S. Bioinformatics, the Machine Learning Approach 1998 MIT Press
13. Brants, T., 1996. Estimating Markov model structures. In: Proc. ICLSP Philadelphia, PA
14. Cai J. Liu Z.-Q. Hidden Markov models with spectral features for 2D shape recognition IEEE Trans. PAMI 23 12 2001 703-713
15. Cornell, S., 1996. A comparison of hidden Markov model features for the recognition of cursive handwriting. Department of Computer Science, Michigan State University, Master Thesis, 1996
16. De Britto, A.S., Sabourin, R., Bortolozzi, F., Suen, C.Y., 2001. An enhanced HMM topology in an LBA framework for the recognition of handwritten numeral strings. In: Internat. Conf. on Advances in Pattern Recognition. pp. 105-114
17. Dong, J., 2003. Speed and accuracy: Large-scale machine learning algorithms and their applications, CENPARMI, Department of Computer Science, Concordia University, Montreal, Canada, Ph.D. Thesis, 2003
18. Duda R.O. Hart P.E. Stork D.G. Pattern Classification second ed. 2001 Willey-Interscience
19. El-Yacoubi A. Gilloux M. Sabourin R. Suen C.Y. An HMM based approach for off-line unconstrained handwritten word modeling and recognition IEEE Trans. PAMI 21 8 1999 752-760
20. Gray R. Vector quantization IEEE Trans. ASSP 1984 4-29
21. Heckerman, D., 1996. A tutorial on learning with graphical models, MSR-TR-9506, Microsoft Research
22. Karplus K. Sjolander K. Barrett C. Cline M. Haussler D. Hughey R. Holm L. Sander C. Predicting protein structure using hidden Markov models Proteins: Struct., Funct. Genet. 1 1 1997 134-139
23. Kim I. Chien S. Analysis of 3D hand trajectory gestures using stroke-based composite hidden Markov models Appl. Intell. 15 2001 131-143
24. LeCun Y. The MNIST Database of Handwritten Digits 1998 http://yann.lecun.com/exdb/mnist
25. Lee J. Kim J. Kim J.-H. Data-driven design of HMM topology for on-line handwritten recognition Pattern Recognition 15 1 2001 107-121
26. Lien, J., 1998. Automatic recognition of facial expressions using hidden Markov models and estimation of expression intensity. CMU, School of Computer Science, Pittsburg, Ph.D. Thesis, 1998
27. Liu C.-L. Nakashima K. Sako H. Fujisawa H. Handwritten digit recognition: Benchmarking of state-of-the-art techniques Pattern Recognition 36 2003 2271-2285
28. Lyngso, R., Pedersen, C., Nielsen, H., 1999. Metrics and similarity measures for hidden Markov models. In: Proc. Internat. Conf. on Intelligent Systems for Molecular Biology. pp. 178-186
29. Murphy K.P. A Introduction to Graphical Models 2001 http://www.ai.mit.edu/murphyk/papers.html
30. Rabiner L.R. A tutorial on hidden Markov models and selected application in speech recognition Proc. IEEE 77 2 1989 257-286
31. Senta E. Nonnegative matrices and Markov chains 1986 Springer New York
32. Simard, P., Steinkraus, D., Platt, J.C., 2003. Best practices for convolutional neural networks applied to visual document analysis. In: Proc. 17th ICDAR, Edinburgh, UK. pp. 962-965
33. Stolcke A. Omuhundro S. Hidden Markov model induction by Bayesian model merging Hanson S. Cowan J. Giles C. Advances in Neural Information Processing 5 1992 11-18 Morgan Kaufmann
34. Theodoridis S. Koutroumbas K. Pattern Recognition 1999 Academic Press