Minimum classification error learning for sequential data in the wavelet domain

Pattern Recognition

Volumn 43, Issue 12, 2010, Pages 3998-4010

  Tomassi, D ^a,c   Milone, D H ^a   Forzani, L ^b,c  

^a Facultad de Humanidades y Ciencias   (Argentina)

^b UNIVERSIDAD NACIONAL DEL LITORAL   (Argentina)

^c Instituto de Matemtica Aplicada Del Litoral CONICET   (Argentina)

Author keywords

Discriminative training; Hidden Markov models; Hidden Markov trees; Minimum classification error; Wavelet transform

Indexed keywords

CLASSIFICATION TASKS; DISCRIMINATIVE TRAINING; DYNAMIC PATTERN RECOGNITION; DYNAMIC PATTERNS; HIDDEN MARKOV TREE; LEARNING STRATEGY; LOCAL DYNAMICS; MARKOV MODEL; MINIMUM CLASSIFICATION ERROR; MULTI-RESOLUTIONS; NUMERICAL EXPERIMENTS; PHONEME RECOGNITION; RECOGNITION RATES; SEQUENTIAL DATA; STRUCTURED DATA; VARIABLE LENGTH; WAVELET DOMAIN; WAVELET FEATURES;

MAXIMUM LIKELIHOOD ESTIMATION; PARAMETER ESTIMATION; SIGNAL PROCESSING; SPEECH RECOGNITION; WAVELET ANALYSIS; WAVELET TRANSFORMS;

HIDDEN MARKOV MODELS;

EID: 77957016895     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2010.07.010     Document Type: Article

References (43)

1. M. Crouse, R. Nowak, and R. Baraniuk Wavelet-based statistical signal processing using hidden Markov models IEEE Transactions on Signal Processing 46 1998 886 902
2. M. Duarte, M. Wakin, R. Baraniuk, Wavelet-domain compressive signal reconstruction using a hidden Markov tree model, in: IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2008, 2008, pp. 51375140. doi: 10.1109/ICASSP.2008.4518815.
3. S. Graja, and J.-M. Boucher Hidden Markov tree model applied to ECG delineation IEEE Transactions on Instrumentation and Measurement 54 6 2005 2163 2168 10.1109/TIM.2005.858568 (Pubitemid 41824671)
4. C. Tantibundhit, J. Boston, C. Li, J. Durrant, S. Shaiman, K. Kovacyk, and A. El-Jaroudi New signal decomposition method based speech enhancement Signal Processing 87 11 2007 2607 2628 10.1016/j.sigpro.2007.04.014
5. S. Lefkimmiatis, G. Papandreou, P. Maragos, Photon-limited image denoising by inference on multiscale models, in: Proceedings of the IEEE International Conference on Image Processing, ICIP-08, San Diego, CA, 2008, pp. 23322335. doi: 10.1109/ICIP.2008.4712259.
6. F. Li, X. Jia, D. Fraser, Universal HMT based super resolution for remote sensing images, in: 15th IEEE International Conference on Image Processing, ICIP 2008, 2008, pp. 333336. doi: 10.1109/ICIP.2008.4711759.
7. G. Papandreou, P. Maragos, A. Kokaram, Image inpainting with a wavelet domain hidden Markov tree model, in: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP-2008, Las Vegas, Nevada, 2008, pp. 773776. doi: 10.1109/ICASSP.2008.4517724.
8. Y. Tian, J. Wang, J. Zhang, Y. Ma, A contextual hidden Markov tree model image denoising using a new nonuniform quincunx directional filter banks, in: Third International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIHMSP 2007, vol. 1, 2007, pp. 151154. doi: 10.1109/IIH-MSP.2007.1.
9. E. Mor, and M. Aladjem Boundary refinements for wavelet-domain multiscale texture segmentation Image and Vision Computing 23 13 2005 1150 1158 10.1016/j.imavis.2005.07.011 (Pubitemid 41562996)
10. V.R. Rallabandi, and V.S. Rallabandi Rotation-invariant texture retrieval using wavelet-based hidden Markov trees Signal Processing 88 10 2008 2593 2598 10.1016/j.sigpro.2008.04.019
11. R. Ferrari, H. Zhang, and C. Kube Real-time detection of steam in video images Pattern Recognition 40 3 2007 1148 1159 10.1016/j.patcog.2006.07.007
12. Y. Zhang, Y. Zhang, Z. He, X. Tang, Multiscale fusion of wavelet-domain hidden Markov tree through graph cut, Image and Vision Computing 27 (9) (2009) 14021410. doi: 10.1016/j.imavis.2008.12.005.
13. Z. He, X. You, and Y.Y. Tang Writer identification of Chinese handwriting documents using hidden Markov tree model Pattern Recognition 41 4 2008 1295 1307 10.1016/j.patcog.2007.08.017 (Pubitemid 350212968)
14. D.H. Milone, L.E.D. Persia, M.E. Torres, Denoising and recognition using hidden Markov models with observation distributions modeled by hidden Markov trees, Pattern Recognition 43 (4) (2010) 15771589. doi: 10.1016/j.patcog.2009. 11.010.
15. L. Baum, T. Petric, G. Soules, and N. Weiss A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains Annals Mathematical Statistics 41 1970 164 171
16. D. Milone, L.D. Persia, D. Tomassi, Signal denoising with hidden Markov models using hidden Markov trees as observation densities, in: Proceedings of the IEEE MLSP08 Workshop, 2008, pp. 374379.
17. X. He, L. Deng, and W. Chou Discriminative learning in sequential pattern recognition: a unifying review for optimization-based speech recognition IEEE Signal Processing Magazine 25 2008 14 36
18. L. Bahl, P. Brown, P.D. Souza, R. Mercer, Maximum mutual information estimation of HMM parameters for speech recognition, in: Proceedings of the International Conference on Audio, Speech, and Signal Processing, ICASSP86, 1986, pp. 4952.
19. B.-H. Juang, W. Chou, and C.-H. Lee Minimum classification error rate methods for speech recognition IEEE Transactions on Speech and Audio Processing 5 1997 257 265
20. D. Povey, Discriminative training for large vocabulary speech recognition, Ph.D. Thesis, Cambridge University, Cambridge, UK, 2004.
21. S. Katagiri, B.-H. Juang, and C. Lee Pattern recognition using a family of design algorithms based upon the generalized probabilistic descent method Proceedings of the IEEE 86 1998 2345 2373
22. M. Afify, X. Li, and H. Jiang Statistical analysis of minimum classification error learning for gaussian and hidden Markov model classifiers IEEE Transactions on Audio, Speech, and Language Processing 15 2007 2405 2417
23. E. McDermott, and S. Katagiri A derivation of minimum classification error from the theoretical classification risk using Parzen estimation Computers, Speech and Language 18 2004 102 122
24. X. He, and L. Deng A new look at discriminative training for hidden Markov models Pattern Recognition Letters 28 2007 1285 1294
25. V. Zue, S. Sneff, and J. Glass Speech database development: TIMIT and beyond Speech Communication 9 1990 351 356
26. A. Willsky Multiresolution Markov models for signal and image processing Proceedings of the IEEE 90 8 2002 1396 1458
27. G. Fan, and X.-G. Xia Improved hidden Markov models in the wavelet-domain IEEE Transactions on Signal Processing 49 1 2001 115 120
28. D.-Y. Po, and M. Do Directional multiscale modeling of images using the contourlet transform IEEE Transactions on Image Processing 15 2 2006 651 664
29. I. Selesnick, R. Baraniuk, and N. Kingsbury The dual-tree complex wavelet transform IEEE Signal Processing Magazine 22 6 2005 123 151
30. J. Durand, P. Goncalves, and Y. Gudon Computational methods for hidden Markov tree modelsan application to wavelet trees IEEE Transactions on Signal Processing 52 2004 2551 2560
31. D. Percival, and A. Walden Wavelet Methods for Time Series Analysis 2000 Cambridge University Press New York
32. Y. Bengio Markovian models for sequential data Neural Computing Surveys 2 1999 129 162
33. S. Bengio, H. Bourlard, K. Weber, An EM algorithm for HMMs with emission distributions represented by HMMs, Technical Report IDIAP-RR 11, Institut Dalle Molle d'Intelligence Artificielle Perceptive, Martigny, Switzerland, 2000.
34. N. Dasgupta, P. Runkle, L. Couchman, and L. Carin Dual hidden Markov model for characterizing wavelet coefficients from multi-aspect scattering data Signal Processing 81 6 2001 1303 1316
35. E. McDermott, T. Hazen, J.L. Roux, A. Nakamura, and S. Katagiri Discriminative training for large-vocabulary speech recognition using minimum classification error IEEE Transactions on Audio, Speech, and Language Processing 15 2007 203 223
36. P. Woodland, and D. Povey Large scale discriminative training of hidden Markov models for speech recognition Computer, Speech and Language 16 2002 25 47
37. H. Jiang, Discriminative training of HMMs for automatic speech recognition: a survey, Computer, Speech and Language 24 (4) (2010) 589608. doi: 10.1016/j.csl.2009.08.002.
38. R. Duda, P. Hart, and D. Stork Pattern Classification second ed. 2000 Wiley
39. W. Chou Minimum classification error rate (MCE) approach in pattern recognition W. Chou, B. Juang, Pattern Recognition in Speech and Language Processing 2003 CRC Press 1 49
40. W. Chou, B.-H. Huang, C.-H. Lee, Segmental GPD training for HMM based speech recognition, in: Proceedings of the International Conference on Audio, Speech, and Signal Processing, ICASSP92, vol. 1, 1992, pp. 473476.
41. D.H. Milone, L.E.D. Persia, An EM algorithm to learn sequences in the wavelet domain, in: Lecture Notes in Computer Science, vol. 4827, 2007, pp. 518528.
42. L. Rabiner, and B. Juang Fundamentals of Speech Recognition 1993 Prentice-Hall New Jersey
43. S. Mallat A Wavelet Tour of Signal Processing second ed. 1999 Academic Press