Classification of Time-Series data using a generative/discriminative hybrid

Proceedings - International Workshop on Frontiers in Handwriting Recognition, IWFHR

Volumn , Issue , 2004, Pages 51-56

  Abou Moustafa, K T ^a,b   Cheriet, M ^b   Suen, C Y ^a  

^a Dept of Electrical and Computer Engineering   (Canada)

^b ÉCOLE DE TECHNOLOGIE SUPÉRIEURE   (Canada)

Author keywords

Discriminative Models; Generative Models; HMMs; SVMs

Indexed keywords

DISCRIMINATIVE MODELS; GENERATIVE MODELS; SUPPORT VECTOR MACHINES; TIME SERIES DATA;

DATA REDUCTION; DATABASE SYSTEMS; LEARNING SYSTEMS; MARKOV PROCESSES; MATHEMATICAL MODELS; NEURAL NETWORKS; TIME SERIES ANALYSIS; VECTORS;

PATTERN RECOGNITION;

EID: 18044398546     PISSN: 15505235     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IWFHR.2004.26     Document Type: Conference Paper

References (32)

1. K-F. Lee, "Automatic Speech Recognition: The Development of the SPHINX System", Kluwer Academic Press, 1999.
2. A. El-Yacoubi, M. Gilloux, R. Sabourin and C. Y. Suen, "An HMM Based Approach for Off-line Unconstrained Handwritten Word Modeling and Recognition," IEEE Trans. PAMI, Vol. 21, No. 8, pp. 752-760, 1999.
3. L. R. Rabiner, "A Tutorial on Hidden Markov Models and Selected Application in Speech Recognition," Proc. of IEEE, Vol. 77, No, 2, pp. 257-286, 1989.
4. K. T. Abou-Moustafa, M. Cheriet and C. Y. Suen, "On The Structure of Hidden Markov Models," Pattern Recognition Letters, Vol. 25, pp. 829-973, June 2004.
5. N. Cristianin and J. Shawe-Taylor, "An Introduction to Support Vector Machines and Other Kernel-based Learning Methods," Cambridge Univ. Press, 2000.
6. L. Quan and S. Bengio, "Hybrid Generative-Discriminative Models for Speech and Speaker Recognition," IDIAP Tech. Report, Mar. 2002.
7. K. T. Abou-Moustafa, M. Cheriet and C. Y. Suen, "A Generative-Discriminative Hybrid for Sequential Data Classification," IEEE ICASSP 2004, pp. V 805 - V 808.
8. L. Bahl, P. Brown, P. de Souza and R. Mercer, "Maximum Mutual Information Estimation of Hidden Markov Model Parameters for Speech Recognition," Proc. of ICASSP, Tokyo, pp. 49-52, 1986.
9. J-L. Gauvain and C-H. Lee, "MAP Estimation of Continuous Density HMM: Theory and Applications," Proc. of DARPA Speech & Nat. Lang. Processing, Feb. 1992.
10. Y. Singer and M. Warmuth, "Training Algorithms for Hidden Markov Models Using Entropy Based Distance Functions," Proc. of Advances in Neural Information Processing Systems 9, pp. 641-647, 1996.
11. A. Biem, "Minimum Classification Error Training for Online Handwritten Word Recognition," Proc. of 8th IWFHR, Niagra-on-the-lake, pp. 61-65, 2002.
12. L. Saul and M. Rahim, "Maximum Likelihood and Minimum Classification Error Rate Factor Analysis for Automatic Speech Recognition," IEEE Trans. Speech and Audio Processing, Vol. 8, No. 12, pp. 115-125, 2000.
13. A. Stolcke and S. Omuhundro, "Hidden Markov Model Induction by Bayesian Model Merging," Advances in Neural Information Processing 5, Morgan Kaufmann, S. Hanson, J. Cowan and C. Giles, editors, pp. 11-18, 1992.
14. T. Brants, "Estimating Markov Model Structures," Proceedings of the Fourth Conference on Spoken Language Processing (ICSLP), Philadelphia, PA, 1996.
15. M. Bicego, A. Dovier and V. Murino, "Designing the Minimal Structure Hidden Markov Model by Bisimulation," in Energy Minimization Methods in Computer Vision and Pattern Recognition, Springer, M. Figueiredo, J. Zerubia and A. K. Jain, editors, pp. 75-90, 2001.
16. M. Bicego, V. Murino and M. Figueiredo, "A Sequential Pruning Strategy for the Selection of the Number of States in Hidden Markov Models, Pattern Recognition Letters, Vol. 24, pp. 1395-1407, 2003.
17. A. Biem, "A Model Selection Criterion for Classification: Application to HMM Topology Optimization," Proc. 17th ICDAR, Edinburgh, U.K. pp. 104-108, 2003.
18. A. J. Viterbi, "Error Bounds for Convolutional Codes and an Asymptotically Optimal Decoding Algorithm," IEEE. Trans. Information Theory, Vol. 13, No. 4, pp. 179-190, 1983.
19. Y. Rubenstein and T. Hastie, "Discriminative vs Informative Learning," Proc. of Knowledge Discovery and Data Mining, 1997.
20. T. Jaakkola and D. Haussler, "Exploiting Generative Models in Discriminative Classifiers, Proc. of Advances in Neural Information Processing (NIPS) 11, 1998.
21. A. Ng and M. Jordan, "On Generative vs. Discriminative Classifiers: A Comparison of Logistic Regression and Naive Bayes," Proc. of Advances in Neural Information Processing 15, 2002.
22. G. Bouchard, "The Trade-off Between Generative and Discriminative Classifiers," Proc. of Advances in Neural Information Processing (NIPS) 16, 2003.
23. V. N. Vapnik, "Statistical Learning Theory," John Wiley & Sons, 1998.
24. A. Dempster, N. Laird and D. Rubin, "Maximum-likelihood from Incomplete Data Via the EM Algorithm," J. Royal Stat. Soc. Ser. B., Vol. 39, pp. 1-38, 1977.
25. Y. LeCun, "The MNIST Database of Handwritten Digits," http://yann.lecun.com/exdb/mnist.
26. C-L. Liu, K. Nakashima, H. Sako and H. Fujisawa, "Handwritten Digit Recognition: Benchmarking of State-of-the-art Techniques," Pattern Recognition, Vol. 36, pp. 2271-2285, 2003.
27. S. de Britto, R. Sabourin, F. Bortolozzi and C. Y. Suen, "Complementary Features Combined in an HMM-based System to Recognize Handwritten Digits," Proc. of 12th Intl. Conf. on Image Analysis and Processing, pp. 670-675, 2003.
28. T. Joachims, "Making Large-Scale SVM Learning Practical," Advances in Kernel Methods and Support Vector Learning, MIT Press, B. Scholkopf, C. Burges and A. Smola, editors, 1999.
29. L-N. Teow and K-F. Loe, "Robust Vision-based and Classification Schemes for Off-line Handwritten Digit Recognition," Pattern Recognition, Vol. 35, No. 11, pp. 2355-2364, 2002.
30. P. Simard, D. Steinkraus and J. C. Platt, "Best Practices for Convolutional Neural Networks Applied to Visual Document Analysis," Proc. of 17th ICDAR, Edinburgh, U.K, pp. 965-962, 2003.
31. J. Dong, "Speed and Accuracy: Large-scale Machine Learning Algorithms and Their Applications," CENPARMI, Department of Computer Science, Concordia University, Montreal, Canada, 2003.
32. N. Cristianini, C. Campbell and J. Shawe-Taylor, "Dynamically Adapting Kernels in Support Vector Machines," Neural Information Processing Systems, pp. 204-210, 1998.