Assessing Lexical Proficiency Using Analytic Ratings: A Case for Collocation Accuracy

Applied Linguistics

Volumn 36, Issue 5, 2015, Pages 570-590

  Crossley, Scott A ^a   Salsbury, Tom ^b   McNamara, Danielle S ^c  

^a GEORGIA STATE UNIVERSITY   (United States)

^b WASHINGTON STATE UNIVERSITY   (United States)

^c ARIZONA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84950276932     PISSN: 01426001     EISSN: 1477450X     Source Type: Journal    
DOI: 10.1093/applin/amt056     Document Type: Article

References (64)

1. Baba, K. 2009. Aspects of lexical proficiency in writing summaries in a foreign language, Journal of Second Language Writing 18: 191-208.
2. Barcikowski, R. and J. P. Stevens. 1975. A Monte Carlo study of the stability of canonical correlations, canonical weights, and canonical variate-variable correlations, Multivariate Behavioral Research 10: 353-64.
3. Boers, F., J. Eyckmans, J. Kappel, H. Stengers, and M. Demecheleer. 2006. Formulaic sequences and perceived oral proficiency: Putting a lexical approach to the test, Language Teaching Research 10/3: 245-61.
4. Bulte, B., A. Housen, M. Pierrard, and S. van Daele. 2008. Investigating lexical proficiency development over time: The case of Dutchspeaking learners of French in Brussels, French Language Studies 18: 277-98.
5. Crossley, S. A., T. Salsbury, and D. S. McNamara. 2009. Measuring second language lexical growth using hypernymic relationships, Language Learning 59: 307-34.
6. Crossley, S. A., T. Salsbury, and D. S. McNamara. 2010a. The development of polysemy and frequency use in English second language speakers, Language Learning 60: 573-605.
7. Crossley, S. A., T. Salsbury, and D. S. McNamara. 2010b. The development of semantic relations in second language speakers: A case for Latent Semantic Analysis, Vigo International Journal of Applied Linguistics 7: 55-74.
8. Crossley, S. A., T. Salsbury, D. S. McNamara, and S. Jarvis. 2011a. What is lexical proficiency? Some answers from computational models of speech data, TESOL Quarterly 45: 182-93.
9. Crossley, S. A., T. Salsbury, D. S. McNamara, and S. Jarvis. 2011b. Predicting lexical proficiency in language learners using computational indices, Language Testing 28: 561-80.
10. Crossley, S. A. and T. Salsbury. 2011. The development of lexical bundle accuracy and production in English second language speakers, International Review of Applied Linguistics in Language Teaching 49: 1-26.
11. Crossley, S. A., T. Salsbury, and D. S. McNamara. 2012a. Predicting the proficiency level of language learners using lexical indices, Language Testing 29: 240-60.
12. Crossley, S. A., Z. Cai, and D. S. McNamara. 2012b. Syntagmatic, paradigmatic, and automatic n-gram approaches to assessing essay quality in P. M. McCarthy and G. M. Youngblood (eds): Proceedings of the 25th International Florida Artificial Intelligence Research Society (FLAIRS) Conference. The AAAI Press, pp. 214-19.
13. Cumming, A. 1990. Metalinguistic and ideational thinking in second language composing, Written Communication 7: 482-511.
14. Daller, H., R. van Hout, and J. Treffers-Daller. 2003. Lexical richness in the spontaneous speech of bilinguals, Applied Linguistics 24/2: 197-222.
15. Daller, H., J. Milton, and J. Treffers-Daller. 2007. Modelling and Assessing Vocabulary Knowledge. Cambridge University Press.
16. David, A. 2008. A developmental perspective on productive lexical knowledge in L2 oral interviews, French Language Studies 18: 315-31.
17. Davies, A. and H. Widdowson. 1974. Reading and writing in J. Allen and S. Corder (eds): Techniques in Applied Linguistics. Oxford University Press, pp. 154-201.
18. Ellis, N. 2002. Frequency effects in language processing, Studies in Second Language Acquisition 24/2: 143-88.
19. Ellis, N. and A. Beaton. 1993. Psycholinguistic determinants of foreign language vocabulary acquisition, Language Learning 43/4: 559-617.
20. Ellis, N. and L. Collins. 2009. Input and second language acquisition: The roles of frequency, form, and function introduction to the special issue, Modern Language Journal 93: 329-35.
21. Ellis, R. 1995. Modified oral input and the acquisition of word meanings, Applied Linguistics 16: 409-35.
22. Fellbaum, C. 1998. WordNet: An Electronic Lexical Database. MIT Press.
23. Field, A. 2005. Discovering Statistics Using SPSS. Sage Publications.
24. Gee, N. R., D. L. Nelson, and D. Krawczyk. 1999. Is the concreteness effect a result of underlying network interconnectivity?, Journal of Memory and Language 40: 479-97.
25. Gilhooly, K. J. and R. H. Logie. 1980. Age-ofacquisition, imagery, concreteness, familiarity, and ambiguity measures for 1, 944 words, Behavior Research Methods & Instrumentation 12/4: 395-427.
26. Godfrey, J. J. and E. Holliman. 1993. Switchboard-1 [CD-ROM]. Linguistic Data Consortium.
27. Graesser, A. C., D. S. McNamara, M. M. Louwerse, and Z. Cai. 2004. Coh-Metrix: Analysis of text on cohesion and language, Behavioral Research Methods, Instruments, and Computers 36: 193-202.
28. Henriksen, B. 1999. Three dimensions of vocabulary development, Studies in Second Language Acquisition 21: 303-17.
29. Higgins, D., X. Xi, K. Zechner, and D. Williamson. 2011. A three-stage approach to the automated scoring of spontaneous spoken responses, Computer Speech and Language 25/2: 282-306.
30. Hoey, M. 2005. Lexical Priming: A New Theory of words and Language. Routledge.
31. Jarvis, S. 2002. Short texts, best-fitting curves and new measures of lexical diversity, Language Testing 19: 57-84.
32. Kline, P. 1999. The Handbook of Psychological Testing. Routledge.
33. Landauer T. K., D. S. McNamara, S. Dennis, and W. Kintsch (eds). 2007. LSA: A Road to Meaning. Erlbaum.
34. Laufer, B. and P. Nation. 1995. Vocabulary size and use: Lexical richness in L2 written production, Applied Linguistics 16/3: 307-22.
35. Lennon, P. 1996. Getting easy verbs wrong at the advanced level, International Review of Applied Linguistics in Language Teaching 34/1: 23-36.
36. Levenston, E. and S. Blum. 1977. Aspects of lexical simplification in the speech and writing of advanced adult learners in P. S. Corder and E. Roulet (eds): The Notions of Simplification, Interlanguages and Pidgins and their Relation to Second Language Pedagogy. Librairie Droz, pp. 51-72.
37. Malvern, D., B. J. Richards, N. Chipere, and P. Duran. 2004. Lexical Diversity and Language Development. Quantification and Assessment. Palgrave Macmillan.
38. Manchon, R. M., L. Murphy, and J. Roca de Larios. 2007. Lexical retrieval processes and strategies in second language writing: A synthesis of empirical research, International Journal of English Studies 7: 147-72.
39. McCarthy, P. M. and S. Jarvis. 2010. MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment, Behavior Research Methods 42: 381-92.
40. Meara, P. 1996. The dimensions of lexical competence in G. Brown, K. Malmkjaer, and J. Williams (eds): Performance and Competence in Second Language Acquisition. Cambridge University Press, pp. 35-53.
41. Meara, P. 2005a. Designing vocabulary tests for English, Spanish and other languages in C. Butler, S. Christopher, M. Á . Gómez Gonzá lez, and S. M. Doval-Suárez (eds): The Dynamics of Language Use. John Benjamins Press, pp. 271-85.
42. Meara, P. M. 2005b. Lexical frequency profiles: A Monte Carlo analysis, Applied Linguistics 26/1: 32-47.
43. Moon, R. 1992. Textual aspects of fixed expressions in learners dictionaries in J. A. Pierre and B. Henri (eds): Vocabulary and Applied Linguistics. Macmillan, pp. 13-27.
44. Multon, K. 2010. Interrater reliability in N. Salkind (ed.): Encyclopedia of Research Design. Sage Publications, Inc, pp. 627-9.
45. Nation, I. S. P. 2001. Learning Vocabulary in Another Language. Cambridge University Press.
46. Nation, I. S. P. 2007. Fundamental issues in modelling and assessing vocabulary knowledge in H. Daller, J. Milton, and J. Treffers-Daller (eds): Modelling and Assessing Vocabulary Knowledge. Cambridge University Press, pp. 33-43.
47. Nesselhauf, N. 2003. The use of collocations by advanced learners of English and some implications for teaching, Applied Linguistics 24: 223-42.
48. Newman, M. L., C. J. Groom, L. D. Handelman, and J. W. Pennebaker. 2008. Gender difference in language use: An analysis of 14, 000 text samples, Discourse Processes 45: 211-36.
49. Paivio, A. 1991. Dual coding theory: Retrospect and current status, Canadian Journal of Psychology 45: 255-287.
50. Paivio, A., J. C. Yuille, and S. Madigan. 1968. Concreteness, imagery, and meaningfulness values for 925 nouns, Journal of Experimental Psychology Monograph Supplement 76: 1-25.
51. Qian, D. D. 1999. Assessing the roles of depth and breadth of vocabulary knowledge in reading comprehension, Canadian Modern Language Review 56: 282-308.
52. Read, J. 1998. Validating a test to measure depth of vocabulary knowledge in A. Kunnan (ed.): Validation in Language Assessment. Lawrence Erlbaum, pp. 41-60.
53. Read, J. 2000. Assessing Vocabulary. Cambridge University Press.
54. Rosch, E., C. Mervis, W. Gray, D. Johnson, and P. Boyes-Braem. 1976. Basic objects in natural categories, Cognitive Psychology 8: 573-605.
55. Salsbury, T., S. A. Crossley, and D. S. McNamara. 2011. Psycholinguistic word information in second language oral discourse, Second Language Research 27: 343-60.
56. Schmitt, N. 1998. Tracking the incremental acquisition of a second language vocabulary: A longitudinal study, Language Learning 48/2: 281-317.
57. Skehan, P. 1998. A Cognitive Approach to Language Learning. Oxford University Press.
58. Tabachnick, B. G. and L. S. Fidell. 2001. Using Multivariate Statistics, 4th edn. Allyn & Bacon.
59. Toglia, M. P. and W. F. Battig. 1978. Handbook of Semantic Word Norms. Lawrence Erlbaum Associates.
60. Whitten, I. A. and E. Frank. 2005. Data Mining. Elsevier.
61. Wray, A. 2002. Formulaic Language and the Lexicon. Cambridge University Press.
62. Wray, A. 2008. Formulaic Language: Pushing the Boundaries. Oxford University Press.
63. Zareva, A., P. Schwanenflugel, and Y. Nikolova. 2005. Relationship between lexical competence and language proficiency: Variable sensitivity, Studies in Second Language Acquisition 27: 567-95.
64. Zipf, G. K. 1935. The Psycho-biology of Language. Houghton-Mifflin.