MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment

Behavior Research Methods

Volumn 42, Issue 2, 2010, Pages 381-392

  McCarthy, Philip M ^a   Jarvis, Scoot ^b  

^a UNIVERSITY OF MEMPHIS   (United States)

^b OHIO UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COMPARATIVE STUDY; HUMAN; LANGUAGE TEST; METHODOLOGY; PSYCHOLOGY; REPRODUCIBILITY; STATISTICS; VALIDATION STUDY;

HUMANS; LANGUAGE TESTS; PSYCHOLOGY, EXPERIMENTAL; REPRODUCIBILITY OF RESULTS;

EID: 77955897943     PISSN: 1554351X     EISSN: None     Source Type: Journal    
DOI: 10.3758/BRM.42.2.381     Document Type: Article

References (47)

1. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
2. Best, R., Ozuru, Y., Floyd, R., & McNamara, D. S. (2006). Children's text comprehension: Effects of genre, knowledge, and text cohesion. In S. A. Barab, K. E. Hay, & D. T. Hickey (Eds.), Proceedings of the Seventh International Conference of the Learning Sciences (pp. 37-42). Mahwah, NJ: Erlbaum.
3. Biber, D. (1988). Variation across speech and writing. Cambridge: Cambridge University Press.
4. Biber, D. (1989). A typology of English texts. Linguistics, 27, 3-43.
5. Biggs, A., Daniel, L., Feather, R. M., Ortleb, E., Rillero, P., Sny-der, S. L., & Zike, D. (2003). Glencoe science: Science level green. New York: Glencoe/McGraw-Hill.
6. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.
7. Crossley, S. A., & McNamara, D. S. (2009). Computationally assessing lexical differences in L1 and L2 writing. Journal of Second Language Writing, 18, 119-135.
8. Crossley, S. A., & McNamara, D. S. (in press). Predicting second language writing proficiency: The role of cohesion, readability, and lexical difficulty. Journal of Research in Reading.
9. Crossley, S. A., Salsbury, T., & McNamara, D. S. (2009). Measuring second language lexical growth using hypernymic relationships. Language Learning, 59, 307-334.
10. Dempsey, K. B., McCarthy, P. M., & McNamara, D. S. (2007). Using phrasal verbs as an index to distinguish text genres. In D. Wilson & G. Sutcliffe (Eds.), Proceedings of the Twentieth International Florida Artificial Intelligence Research Society Conference (pp. 217-222). Menlo Park, CA: AAAI Press.
11. Dugast, D. (1978). Sur quoi se fonde la notion d'étendue théoretique du vocabulaire? Le Français Moderne, 46, 25-32.
12. Ertmer, P. A., Bai, H., Dong, C., Khalil, M., Park, S. H., & Wang, L. (2002). Online professional development: Building administrators' capacity for technology leadership. Journal in Computing Teacher Education, 19, 5-11.
13. Glaser, B. G., & Strauss, A. (1967). Discovery of grounded theory: Strategies for qualitative research. New York: Aldine.
14. Harris Wright, H., Silverman, S. W., & Newhoff, M. (2003). Measures of lexical diversity in aphasia. Aphasiology, 17, 443-452.
15. Herdan, G. (1964). Quantitative linguistics. London: Butterworths.
16. Hess, C. W., Sefton, K. M., & Landry, R. G. (1986). Sample size and type-token ratios for oral language of preschool children. Journal of Speech & Hearing Research, 29, 129-134.
17. Honoré, A. (1979). Some simple measures of richness of vocabulary. Association for Literary & Linguistic Computing Bulletin, 7, 172-177.
18. Jarvis, S. (2002). Short texts, best fitting curves, and new measures of lexical diversity. Language Testing, 19, 57-84.
19. Johansson, S., Leech, G., & Goodluck, H. (1978). Manual of information to accompany the Lancaster-Oslo/Bergen Corpus of British English, for use with digital computers. Oslo: University of Oslo, Department of English.
20. Johnson, W. (1944). Studies in language behavior: I. A program of research. Psychological Monographs, 56, 1-15.
21. Kučera, H., & Francis, W. N. (1967). Computational analysis of present- day American English. Providence, RI: Brown University Press.
22. Landauer, T. K., Laham, D., Rehder, B., & Schreiner, M. E. (1997). How well can passage meaning be derived without using word order? A comparison of latent semantic analysis and humans. In M. G. Shafto & P. Langley (Eds.), Proceedings of the 19th Annual Meeting of the Cognitive Science Society (pp. 412-417). Mahwah, NJ: Erlbaum.
23. Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. Beverly Hills, CA: Sage.
24. Louwerse, M. M., McCarthy, P. M., McNamara, D. S., & Graesser, A. C. (2004). Variation in language and cohesion across written and spoken registers. In K. Forbus, D. Gentner, & T. Regier (Eds.), Proceedings of the 26th Annual Conference of the Cognitive Science Society (pp. 843-848). Mahwah, NJ: Erlbaum.
25. Maas, H. D. (1972). Zusammenhang zwischen Wortschatzumfang und Länge eines Textes. Zeitschrift für Literaturwissenschaft und Linguis-tik, 8, 73-79.
26. Malvern, D. D., Richards, B. J., Chipere, N., & Durán, P. (2004). Lexical diversity and language development: Quantification and assessment. Houndmills, NH: Palgrave Macmillan.
27. McCarthy, P. M., Dufty, D., Hempelman, C., Cai, Z., Graesser, A. C., & McNamara, D. S. (in press). Evaluating givenness/newness. Discourse Processes.
28. McCarthy, P. M., & Jarvis, S. (2007). A theoretical and empirical evaluation of vocd. Language Testing, 24, 459-488.
29. McCarthy, P. M., Myers, J. C., Briner, S. W., Graesser, A. C., & McNamara, D. S. (2009). A psychological and computational study of genre recognition. Journal for Language Technology & Computational Linguistics, 24, 23-55.
30. McEnery, T. (2003). Corpus linguistics. In R. Mitkov (Ed.), Handbook of computational linguistics (pp. 448-463). Oxford: Oxford University Press.
31. McKee, G., Malvern, D., & Richards, B. (2000). Measuring vocabulary diversity using dedicated software. Literary & Linguistic Computing, 15, 323-337.
32. McNamara, D. S., Crossley, S. A., & McCarthy, P. M. (2010). Linguistic features of writing quality. Written Communication, 27, 57-86.
33. McNamara, D. S., Louwerse, M. M., McCarthy, P. M., & Graesser, A. C. (in press). Coh-Metrix: Capturing linguistic features of cohesion. Discourse Processes.
34. Miller, D. P. (1981). The depth/breadth trade-off in hierarchical computer menus. In Proceedings of the Human Factors Society 25th Annual Meeting (pp. 296-300). Santa Monica, CA: HFES.
35. Morse, J. M. (1995). The significance of saturation. Qualitative Health Research, 5, 147-149.
36. Olney, A. M. (2007). Latent semantic grammar induction: Context, projectivity, and prior distributions. In R. Dragomir & R. Mihalcea (Eds.), Proceedings of TextGraphs-2: Graph-based algorithms for natural language processing (pp. 45-52). Rochester, NY: Association for Computational Linguistics.
37. Ong, A. D., & van Dulmen, M. H. M. (2006). Oxford handbook of methods in positive psychology. Oxford: Oxford University Press.
38. Orlov, Y. K. (1983). Ein Model der Häufigekeitsstruktur des Voka-bulars. In H. Guiter & M. V. Arapov (Eds.), Studies on Zipf's law (pp. 154-233). Bochum: Brockmeyer.
39. Owen, A. J., & Leonard, L. B. (2002). Lexical diversity in the spontaneous speech of children with specific language impairment: Application of D. Journal of Speech & Hearing Research, 45, 927-937.
40. Silverman, S. W., & Bernstein Ratner, N. (2000). Word frequency distributions and type-token characteristics. Mathematical Scientist, 11, 45-72.
41. Somers, H. H. (1966). Statistical methods in literary analysis. In J. Leeds (Ed.), The computer and literary style (pp. 128-140). Kent, OH: Kent State University.
42. Templin, M. (1957). Certain language skills in children. Minneapolis: University of Minnesota Press.
43. Tuldava, J. (1993). The statistical structure of a text and its readability. In L. Hrebícek & G. Altmann (Eds.), Quantitative text analysis (pp. 215-227). Trier: Wissenschaftlicher Verlag.
44. Tweedie, F. J., & Baayen, R. H. (1998). How variable may a constant be? Measures of lexical richness in perspective. Computers & the Humanities, 32, 323-352.
45. Van Dijk, T. A., & Kintsch, W. (1983). Strategies of discourse comprehension. New York: Academic Press.
46. Wu, T. (1993). An accurate computation of the hypergeometric distribution function. ACM Transactions on Mathematical Software, 19, 33-43.
47. Yule, G. U. (1944). The statistical study of literary vocabulary. Cambridge: Cambridge University Press.