A Comparison of Human and Statistical Language Model Performance using Missing-Word Tests

Language and Speech

Volumn 40, Issue 4, 1997, Pages 377-389

  Owens, M ^a   O'Boyle, P ^b   McMahon, J ^b   Ming, J ^b   Smith, F J ^b  

^a Crossland Building   (United Kingdom)

^b NONE

Author keywords

Language model evaluation; Missing word tests; Statistical language modeling

Indexed keywords

EID: 0346507059     PISSN: 00238309     EISSN: None     Source Type: Journal    
DOI: 10.1177/002383099704000404     Document Type: Article

References (17)

1. ABORN, M., RUBENSTEIN H., & STERLING, T. D. (1959). Sources of contexual constraint upon words in sentences. Journal of Experimental Psychology, 57, 171-180.
2. BAHL, L. R., JELINEK, F., & MERCER, R. L. (1983). A maximum likelihood approach to continuous speech recognition. IEEE Transactions on Speech and Audio Processing, 1, 77-83.
3. BROWN, P., DELLA PIETRA, S., DELLA PIETRA, V., LAI, J., & MERCER, R. (1992). An estimate of an upper bound for the entropy of English. Computational Linguistics, 18, 1, 31-40.
4. FILLENBAUM, S., JONES, L. V., & RAPOPORT, A. (1963). The predictability of words and their grammatical classes as a function of rate of deletion from a speech transcript. Journal of Verbal Learning and Verbal Behavior, 2, 186-194.
5. GUPTA, V., LENNING, M., & MERMELSTEIN, P. (1992). A language model for very large vocabulary speech recognition. Computer Speech and Language, 6, 331-344.
6. JELINEK, F., MERCER, R. L., BAHL, L. R., & BAKER, J. K. (1977). Perplexity: A measure of difficulty of speech recognition tasks. Journal of the Acoustic Society of America, 62, 63.
7. JELINEK, F., & MERCER, R. L. (1980). Interpolated estimation of Markov source parameters from sparse data. In E. S. Gelsema & L. N. Kanal (Eds.), Pattern Recognition in Practice (pp.381-397). Amsterdam: North-Holland Publishing Company.
8. KUČERA, H., & FRANCIS, W. N. (1967). Computational analysis of present day American English. Providence, Rhode Island: Brown University Press.
9. McMAHON, J., & SMITH, F. J. (1996). Improving statistical language model performance with automatically generated word hierarchies, Computational Linguistics, 22, 217-247.
10. O'BOYLE, P. L., OWENS, M., & SMITH, F. J. (1994). A weighted average n-gram model of natural language, Computer Speech and Language, 8, 337-349.
11. ROSE, T. G., & LEE, M. J. (1994). Language modeling for large vocabulary speech recognition, IOA Meeting on Large Vocabulary Speech Recognition, Cambridge University, England.
12. SHANNON, C. E. (1951). Prediction and entropy of printed English. Bell System Technical Journal, 50-64.
13. SHILLCOCK, R. C., & BARD, E. G. (1993). Modularity and the processing of closed class words. In G. Altman & R. Shillcock (Eds.), Cognitive models of speech processing: The sperlonga meeting II (pp.163-185). Hillsdale, NJ: Erlbaum.
14. SMITH, F. J., & DEVINE, K. (1985). Storing and retrieving word phrases. Information Processing Management, 21, 215-224.
15. SUTCLIFFE, R. F. E., O'SULLIVAN, D., McELLIGOTT, A., & SHEAHAN, L. (1995). Creation of a semantic lexicon by traversal of a machine tractable concept taxonomy. Journal of Quantitative Linguistics, 2, 33-42.
16. TAYLOR, W. L. (1953). "Cloze procedure": A new tool for measuring readability. Journalism Quarterly, 30, 415-433.
17. UEBERLA, J. (1994). Analyzing a simple language model: Some general conclusions for language models for speech recognition. Computer Speech and Language, 8, 153-176.