Minimum rank error language modeling

IEEE Transactions on Audio, Speech and Language Processing

Volumn 17, Issue 2, 2009, Pages 267-276

  Chien, Jen Tzung ^a   Wu, Meng Sung ^a  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

Author keywords

Average precision; Discriminative training; Information retrieval; Language model; Rank error loss function

Indexed keywords

AVERAGE PRECISION; BAYES RISK; BAYESIAN RETRIEVAL; DISCRIMINATIVE TRAINING; LANGUAGE MODEL; LANGUAGE MODELING; LOSS FUNCTIONS; MINIMUM CLASSIFICATION ERROR; MINIMUM RANK; RANK ERROR LOSS FUNCTION; RANK LISTS; RELEVANT DOCUMENTS; RETRIEVAL MODELS; SPEECH RECOGNITION PERFORMANCE; STATISTICAL LANGUAGE MODELING; TREC COLLECTION; WORD ERROR RATE;

COMPUTATIONAL LINGUISTICS; INFORMATION RETRIEVAL; INFORMATION SERVICES; MAXIMUM LIKELIHOOD; NATURAL LANGUAGE PROCESSING SYSTEMS; OPTIMIZATION; RISK PERCEPTION;

SPEECH RECOGNITION;

EID: 70350437416     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2008.2008366     Document Type: Article

References (27)

1. L. Bahl, P. Brown, P. de Souza, and R. Mercer, "Maximum mutual information estimation of hidden Markov model parameters for speech recognition, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1986, vol. 11, pp. 49-52.
2. C. M. Bishop, Pattern Recognition and Machine Learning. New York: Springer Science, 2006.
3. C. Burges, T. Shaked, E. Renshaw, A. Lazier, M. Deeds, N. Hamilton, and G. Hullender, "Learning to rank using gradient descent, " in Proc. 22nd Int. Conf. Mach. Learn., 2005, pp. 89-96.
4. Y. Cao, J. Xu, T.-Y. Liu, H. Li, Y. Huang, and H.-W. Hon, "Adapting ranking SVM to document retrieval, " in Proc. 29th Annu. Int. ACM SIGIR Conf. Res. and Develop. Inf. Retrieval, 2006, pp. 186-193.
5. J.-T. Chien and M.-S. Wu, "Adaptive Bayesian latent semantic analysis, " IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 1, pp. 198-207, Jan. 2008.
6. J.-T. Chien, C.-H. Huang, K. Shinoda, and S. Furui, "Towards optimal Bayes decision for speech recognition, " in IEEE Proc. Int. Conf. Acoust., Speech, Signal Process., 2006, vol. 1, pp. 45-48.
7. C. Cortes and M. Mohri, "AUC optimization vs. error rate minimization, " Adv. in Neural Inf. Process. Syst., vol. 15, pp. 313-320, 2003.
8. Y. Freund, R. Iyer, R. E. Schapire, and Y. Singer, "An efficient boosting algorithm for combining preferences, " J. Mach. Learn. Res., vol. 4, no. 6, pp. 933-969, 2003.
9. J. Gao, H. Qi, X. Xia, and J.-Y. Nie, "Linear discriminant model for information retrieval, " in Proc. 28th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2005, pp. 290-297.
10. V. Goel, W. Byrne, and S. Khudanpur, "LVCSR rescoring with modified loss function: A decision theoretic perspective, " in IEEE Proc. Int. Conf. Acoust., Speech, Signal Process., 1998, pp. 425-428.
11. D. Hull, "Using statistical testing in the evaluation of retrieval experiments, " in Proc. 16th Annual Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 1993, pp. 329-338.
12. F. Jelinek and R. Mercer, "Interpolated estimation of Markov source parameters from sparse data, " Pattern Recognition in Practice, pp. 381-397, 1980.
13. T. Joachims, "Making large-scale support vector machine learning practical, " in Advances in Kernel Methods-Support Vector Learning. Cambridge, MA: MIT Press, 1999, pp. 169-184.
14. T. Jocachims, "Optimizing search engines using clickthrough data, " in Proc. ACM Conf. Knowledge Discovery and Data Mining, 2002, pp. 133-142.
15. B.-H. Juang, W. Chou, and C.-H. Lee, "Minimum classification error rate methods for speech recognition, " IEEE Trans. Speech Audio Process., vol. 5, no. 3, pp. 257-265, May 1997.
16. B.-H. Juang and S. Katagiri, "Discriminative learning for minimum error classification, " IEEE Trans. Signal Process., vol. 40, no. 12, pp. 3043-3054, Dec. 1992.
17. H.-K. J. Kuo, E. Fosler-Lussier, H. Jiang, and C.-H. Lee, "Discriminative training of language models for speech recognition, " in Proc. Int. Conf. Acoust., Speech, Signal Process., 2002, pp. 325-328.
18. D. R. H. Miller, T. Leek, and R. M. Schwartz, "A hidden Markov model information retrieval system, " in Proc. 22nd Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 1999, pp. 214-221.
19. J. M. Ponte and W. B. Croft, "A language modeling approach to information retrieval, " in Proc. 21st Annual Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 1998, pp. 275-281.
20. D. Povey and P. C.Woodland, "Minimum phone error and I-smoothing for improved discriminative training, " in IEEE Proc. Int. Conf. Acoust., Speech, Signal Process., 2002, vol. 1, pp. 105-108.
21. M. G. Rahim, C.-H. Lee, and B.-H. Juang, "Discriminative utterance verification for connected digit recognition, " IEEE Trans. Speech Audio Process., vol. 5, no. 3, pp. 266-277, Sep. 1997.
22. G. Salton and M. J. McGill, Introduction to Modern Information Retrieval. New York: McGraw-Hill, 1983.
23. E. M. Voorhees and D. K. Harman, TREC: Experiment and Evaluation in Information Retrieval. Cambridge, MA: MIT Press, 2005.
24. M.-S. Wu and J.-T. Chien, "Minimum rank error training for language modeling, " in Proc. Eur. Conf. Speech Commun. Technol., 2007, pp. 614-617.
25. Y. Yue, T. Finley, F. Radlinski, and T. Joachims, "A support vector method for optimizing average precision, " in Proc. 30th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2007, pp. 271-278.
26. C. Zhai and J. Lafferty, "A study of smoothing methods for language models applied to information retrieval, " ACM Trans. Inf. Syst., vol. 22, no. 2, pp. 179-214, 2004.
27. Z. Zhou and H. Meng, "Recasting the discriminative n-gram model as a pseudo-conventional n-gram model for LVCSR, " in IEEE Proc. Int. Conf. Acoust., Speech, Signal Process., 2008, pp. 4933-4936.