EM-style optimization of hidden conditional random fields for grapheme-to-phoneme conversion

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2011, Pages 4920-4923

  Heigold, Georg ^a   Hahn, Stefan ^a   Lehnen, Patrick ^a   Ney, Hermann ^a  

^a RWTH AACHEN UNIVERSITY   (Germany)

Author keywords

EM style optimization; grapheme to phoneme conversion; hidden conditional random fields

Indexed keywords

CONDITIONAL RANDOM FIELD; CONVERGENCE BEHAVIORS; EM-STYLE OPTIMIZATION; GRADIENT-BASED OPTIMIZATION; GRAPHEME-TO-PHONEME CONVERSION; HIDDEN CONDITIONAL RANDOM FIELDS; HIDDEN VARIABLE; ITERATIVE OPTIMIZATION ALGORITHMS; LOGLINEAR MODEL; STEP SIZE;

ALGORITHMS; CONTENT BASED RETRIEVAL; CONVERGENCE OF NUMERICAL METHODS; IMAGE SEGMENTATION; ITERATIVE METHODS; OPTIMIZATION; REGRESSION ANALYSIS; SIGNAL PROCESSING; SPEECH COMMUNICATION;

HIDDEN MARKOV MODELS;

EID: 80051618443     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2011.5947459     Document Type: Conference Paper

References (15)

1. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," in ICML, San Francisco, CA, USA, June - July 2001.
2. A. Gunawardana, M. Mahajan, A. Acero, and J.C. Platt, "Hidden conditional random fields for phone classification," in Interspeech, Lisbon, Portugal, Sept. 2005.
3. J. Nocedal and S.J. Wright, Numerical Optimization, Springer, 1999.
4. M. Riedmiller and H. Braun, "A direct adaptive method for faster backpropagation learning: The Rprop algorithm," in ICNN, San Francisco, CA, USA, 1993.
5. A.P. Dempster, N.M. Laird, and D.B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," Journal of the Royal Statistical Society, vol. 39, no. B, 1977.
6. J. Darroch and D. Ratcliff, "Generalized iterative scaling for log-linear models," Annals of Mathematical Statistics, vol. 43, 1972.
7. S.A. Della Pietra, V.J. Della Pietra, and J. Lafferty, "Inducing features of random fields," PAMI, vol. 19, no. 4, 1997.
8. G. Heigold, T. Deselaers, R. Schlüter, and H. Ney, "GIS-like estimation of log-linear models with hidden variables," in ICASSP, Las Vegas, NV, USA, Apr. 2008.
9. S. Riezler, Probabilistic Constraint Logic Programming, Ph.D. thesis, Universität Tübingen, Germany, 1998.
10. S. Riezler, J. Kuhn, D. Prescher, and M. Johnson, "Lexicalized stochastic modeling of constraint-based grammars using log-linear measures and EM training," in ACL, Hong Kong, Oct. 2000.
11. C.M. Bishop, Pattern Recognition and Machine Learning, Springer, 2006.
12. S. Wang, D. Schuurmans, and Y. Zhao, "The latent maximum entropy principle," in ISIT, Lausanne, Switzerland, June - July 2002.
13. M. Bisani and H. Ney, "Joint-sequence models for grapheme-to-phoneme conversion," Speech Communication, vol. 50, no. 5, pp. 434-451, 2008.
14. L. Ramshaw and M. Marcus, "Text chunking using transformation-based learning," in Proc. of the 3rd Workshop on Very Large Corpora, Cambridge, MA, USA, June 1995.
15. G. Heigold, A Log-Linear Discriminative Modeling Framework for Speech Recognition, Ph.D. thesis, RWTH Aachen University, Aachen, Germany, June 2010.