A GIS-like training algorithm for log-linear models with hidden variables

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2008, Pages 4045-4048

  Heigold, Georg ^a   Deselaers, Thomas ^a   Schlüter, Ralf ^a   Ney, Hermann ^a  

^a RWTH AACHEN UNIVERSITY   (Germany)

Author keywords

GIS; Maximum entropy; Optical character recognition; Parameter estimation; Speech recognition

Indexed keywords

ACOUSTICS; BOOLEAN FUNCTIONS; CHARACTER RECOGNITION; FEATURE EXTRACTION; INTEGRATED OPTICS; MATHEMATICAL MODELS; OPTICAL CHARACTER RECOGNITION; REGRESSION ANALYSIS; SIGNAL PROCESSING; SPEECH; SPEECH RECOGNITION; STEREOPHONIC BROADCASTING;

GIS; HIDDEN VARIABLES; MAXIMUM ENTROPY; PARAMETER ESTIMATION;

INSULATING MATERIALS;

EID: 51449099268     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2008.4518542     Document Type: Conference Paper

References (14)

1. J. Darroch and D. Ratcliff, "Generalized iterative scaling for log-linear models," Ann. Math. Statist., vol. 43, 1972.
2. A. Gunawardana, M. Mahajan, A. Acero, and J. C. Platt, "Hidden conditional random fields for phone classification," in Proc. of the Int. Conf. on Spoken Language Processing (ICSLP), Lisbon, Portugal, Sept. 2005.
3. A.D. Anastasiadis, G.D. Magoulas, and M.N. Vrahatis, "New globally convergent training scheme based on the resilient propagation algorithm," Neurocomputing, vol. 64, 2005.
4. A.P Dempster, N.M. Laird, and D.B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," Journal of the Royal Statistical Society, vol. 39, no. B, 1977.
5. L. Armijo, "Minimization of functions having Lipschitz continuous first derivatives," Pacific Journal of Mathematics, vol. 16, no. 1-3, 1966.
6. L. Saul and D. Lee, "Multiplicative updates for classification by mixture models," in Advances in Neural and Information Processing Systems, T.G. Dietterich, S. Becker, and Z. Ghahra-mani, Ed. MIT Press, 2002.
7. PS. Gopalakrishnan, D. Kanevsky, A. Nadas, and D. Na-hamoo, "An inequality for rational functions with applications to some statistical estimation problems," IEEE Trans. on Information Theory, vol. 37, no. 1, 1991.
8. A. Gunawardana, "Maximum mutual information estimation of acoustic HMM emission densities," CLSP Research Note No. 40, Johns Hopkins University, Baltimore, MD, 2001.
9. D. Kanevsky, "Extended Baum Welch transformations for general functions," in Proc. of the Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), Montreal, Canada, 2004.
10. T. Jebara, Discriminative, generative, and imitative learning, Ph.D. thesis, Massachusetts Institute of Technology, 2002.
11. M. Afify, "Extended Baum-Welch reestimation of Gaussian mixture models based on reverse Jensen inequality," in Proc. of the Int. Conf. on Spoken Language Processing (ICSLP), Lisbon, Portugal, 2005.
12. G. Heigold, R. Schlüter, and H. Ney, "On the equivalence of Gaussian HMM and Gaussian HMM-like hidden conditional random fields," in Proc. of the Int. Conf. on Spoken Language Processing (ICSLP), Antwerp, Belgium, Aug. 2007.
13. D. Povey, Discriminative Training for Large Vocabulary Speech Recognition, Ph.D. thesis, Cambridge, England, 2004.
14. D. Keysers, T. Deselaers, Ch. Gollan, and H. Ney, "Deformation models for image recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 8, 2007.