Choosing the best tools for comparative analyses of texts

International Journal of Corpus Linguistics

Volumn 15, Issue 4, 2010, Pages 429-473

  Mollet, Eugène ^a   Wray, Alison ^c   Fitzpatrick, Tess ^a   Wray, Naomi R ^b   Wright, Margaret J ^b  

^a SWANSEA UNIVERSITY   (United Kingdom)

^b QIMR BERGHOFER MEDICAL RESEARCH INSTITUTE   (Australia)

^c CARDIFF UNIVERSITY   (United Kingdom)

Author keywords

Lexis; Profiling; Quantitative analysis; Text analysis; Variation

Indexed keywords

EID: 78149440659     PISSN: 13846655     EISSN: 15699811     Source Type: Journal    
DOI: 10.1075/ijcl.15.4.01mol     Document Type: Review

References (128)

1. Baayen, H. R. 1994a. "Derivational productivity and text typology". Journal of Quantitative Linguistics, 1 (1), 16-34.
2. Baayen, H. R. 1994b. "Productivity in language production". Language and Cognitive Processes, 9 (3), 447-469.
3. Baayen, H. R. 2001. Word Frequency Distributions. Dordrecht: Kluwer Academic.
4. Baayen, H. R. 2008. Analyzing Linguistic Data: A Practical Introduction to Linguistics Using R. Cambridge: Cambridge University Press.
5. Bane, M. 2008. "Quantifying and measuring morphological complexity". In C. B. Chang & H. J. Haynie (Eds.), Proceedings of the 26th West Coast Conference on Formal Linguistics. Cascadilla Proceedings Project, Somerville, MA, 69-76.
6. Bates, T. C., Castles, A., Luciano, M., Wright, M. J., Coltheart, M. & Martin, N. G. 2006. "Genetic and environmental bases of reading and spelling: A unified genetic dual route model". Reading and Writing, 20 (1-2), 147-171.
7. Bauer, L. & Nation, I. S. P. 1993. "Word families". International Journal of Lexicography, 6 (4), 253-279.
8. Bell, H. 2008. "Measuring the syntactic complexity of embedded clauses". Paper presented at the Annual Conference of the British Association for Applied Linguistics, Swansea, 11-13th September.
9. Biber, D. 1989. "A typology of English texts". Linguistics, 27, 3-43.
10. Botel, M. & Granowsky, A. 1972. "A formula for measuring syntactic complexity: A directional effort". Elementary English, 49 (5), 13-16.
11. Bowerman, M. 1979. "The acquisition of complex sentences". In P. Fletcher & M. Garman (Eds.), Language Acquisition. Cambridge: Cambridge University Press, 285-306.
12. Brown, C., Snodgrass, T., Kemper, S., Herman, R. & Covington, M. A. 2008. "Automatic measurement of propositional idea density from part-of-speech tagging". Behavior Research Methods, 40 (2), 540-545.
13. Brown, R. 1973. A First Language: The Early Stages. Cambridge, MA: Harvard University Press.
14. Burrows, J. F. 2002. "'Delta': A measure of stylistic difference and a guide to likely authorship". Literary and Linguistic Computing, 17 (3), 267-287.
15. Campbell, R. S. & Pennebaker, J. W. 2003. "The secret life of pronouns: Flexibility in writing style and physical health". Psychological Science, 14 (1), 60-65.
16. Carroll, J. B. 1968. "Word-frequency studies and the log-normal distribution". In G. M. Zale, (Ed.), Proceedings of the Conference on Language and Language Behavior, Ann Arbor 1966. New York: Appleton-Century- Croft, 213-235.
17. Cheung, H. & Kemper, S. 1992. "Competing complexity metrics and adults' production of complex sentences". Applied Psycholinguistics, 13 (1), 53-76.
18. Chipere, N. 2003. Understanding Complex Sentences. Basingstoke: Palgrave.
19. Covington, M. A. 2007: online. MATTR User Manual. University of Georgia, Artificial Intelligence Center, Athens, GA, CASPR Research Report 2007-05. Available at: http://www.ai.uga.edu/caspr/MATTR-Manual.pdf (accessed August 2010).
20. Covington, M. A., He, C., Brown, C., Naçi, L. & Brown, J. 2006: online. How Complex is that Sentence? A Proposed Revision of the Rosenberg and Abbeduto D-Level Scale. University of Georgia, Artificial Intelligence Center, Athens, Georgia, CASPR Research Report 2006-01. Available at: http://www.ai.uga.edu/caspr/2006-01-Covington.pdf (accessed August 2010).
21. Coxhead, A. 2000. "A new academic word list". TESOL Quarterly, 34 (2), 213-238.
22. Crystal, D., Fletcher, P. & Garman, M. 1976. The Grammatical Analysis of Language Disability. London: Edward Arnold.
23. Dale, P. S., Dionne, G., Eley, T. C. & Plomin, R. 2000. "Lexical and grammatical development: A behavioural genetic perspective". Journal of Child Language, 27 (3), 619-642.
24. Daller, H. & Phelan, D. 2007. "What is in a teacher's mind? The relation between teacher ratings of EFL essays and different aspects of lexical richness". In H. Daller, J. Milton & J. Treffers-Daller (Eds.), Modelling and Assessing Vocabulary Knowledge. Cambridge: Cambridge University Press, 234-244.
25. Daller, H. & Xue, H. 2007. "Lexical richness and the oral proficiency of Chinese EFL students". In H. Daller, J. Milton & J. Treffers-Daller (Eds.), Modelling and Assessing Vocabulary Knowledge. Cambridge: Cambridge University Press, 150-164.
26. Daller, H., van Hout, R. & Treffers-Daller, J. 2003. "Measuring lexical aspects of oral language proficiency among bilinguals: An analysis of different measurements". Applied Linguistics, 24 (2), 197-222.
27. Deerwester, S. S., Dumais, T., Furnas, G. W., Landauer, T. K. & Harshman, R. 1990. "Indexing by latent semantic analysis". Journal of the American Society for Information Science, 41 (6), 391-407.
28. Ellis, N. C. 2001. "Memory for language". In P. Robinson (Ed.), Cognition and Second Language Instruction. Cambridge: Cambridge University Press, 33-68.
29. Ellis, N. C. & Sinclair, S. 1996. "Working memory in the acquisition of vocabulary and syntax: Putting language in good order". Quarterly Journal of Experimental Psychology, 49A (1), 234-250.
30. Everett, D. 2005. "Cultural constraints on grammar and cognition in Pirahã". Current Anthropology, 46 (4), 621-634.
31. Evert, S. & Baroni, M. 2006. The zipfR Library: Words and Other Rare Events in R. Presentation at useR! 2006: The Second R User Conference, Vienna, Austria. Available at: http://www.r-project.org/user-2006/Slides/Evert+Baroni. pdf (accessed August 2010).
32. Fichtner, E. G. 1980. "Measuring syntactic complexity: The quantification of one factor in linguistic difficulty". Die Unterrichtspraxis, 13 (1), 67-75.
33. Fine, J. 1995. "Towards understanding and studying cohesion in schizophrenic speech". Applied Psycholinguistics, 16 (1), 25-41.
34. Forsyth, R. S. & Holmes, D. I. 1996. "Feature-finding for test classification". Literary and Linguistic Computing, 11 (4), 167-174.
35. Frattaroli, J. 2006. "Experimental disclosure and its moderators: A meta-analysis". Psychological Bulletin, 132 (6), 823-865.
36. Frazier, L. 1985. "Syntactic Complexity". In D. Dowty, L. Karttunen & A. Zwicky (Eds.), Natural Language Processing; Psychological, Computational and Theoretical Perspectives. Cambridge: Cambridge University Press, 129-189.
37. Goldberg, A. E. 2003. "Constructions: A new theoretical approach to language". Trends in Cognitive Sciences, 7 (5), 219-224.
38. Goldberg, A. E. 2006. Constructions at Work. Oxford: Oxford University Press.
39. Goldsmith, J. 2000. "Linguistica: An automatic morphological analyzer." In A. Okrent & J. Boyle (Eds.), Proceedings from the Main Session of the Chicago Linguistic Society's Thirty-sixth Meeting 36-1. Available at: http://linguistica.uchicago.edu/publications.html (accessed August 2010).
40. Good, I. J. 1953. "The population frequencies of species and the estimation of population parameters". Biometrika, 40 (3), 237-264.
41. Gottschalk, L. A. & Gleser, G. C. 1969. The Measurement of Psychological States through the Content Analysis of Verbal Behavior. Berkeley, CA: University of California Press.
42. Graesser, A. C., McNamara, D. S., Louwerse, M. M. & Cai, Z. 2004. "Coh-Metrix: Analysis of text on cohesion and language". Behavior Research Methods, Instruments, and Computers, 36 (2), 193-202.
43. Grant, T. 2007. "Quantifying evidence in forensic authorship analysis". International Journal of Speech, Language and the Law, 14 (1), 1-25.
44. Gupta, P. 2003. "Examining the relationship between word learning, nonword repetition, and immediate serial recall in adults". Quarterly Journal of Experimental Psychology (A), 56 (7), 1213-1236.
45. Hauser, M., Chomsky, N. & Fitch, W. T. 2002. "The faculty of language: What is it, who has it, and how did it evolve?". Science, 298 (22.11.02), 1569-1579.
46. He, C. 2006. Using Text Analysis Software in Schizophrenia Research. PhD Thesis, University of Georgia. Available as CASPR Research Report 2006-02 at: http://www.ai.uga.edu/caspr/ (accessed August 2010)
47. Heatley, A., Nation, I. S. P. & Coxhead, A. 2002. RANGE and FREQUENCY programs. Available at: http://www.victoria.ac.nz/lals/staff/paul-nation.aspx
48. Hickmann, M. 2002. Children's Discourse: Person, Space and Time Across Languages. Cambridge: Cambridge University Press.
49. Hunston, S. & Francis, G. 2000. Pattern Grammar. Amsterdam/ Philadelphia: John Benjamins.
50. Hunt, K. W. 1965. Grammatical Structures Written at Three Grade Levels. Champaign, IL: National Council of Teachers of English. Report No.3.
51. Hunt, K. W. 1970. Syntactic Maturity in School Children and Adults. Chicago: University of Chicago Press.
52. Hurford, J. R. 2008. The Origins of Meaning. Oxford: Oxford University Press.
53. Hux, K., Morris-Friehe, M. & Sanger, D. D. 1993. "Language sampling practices: A survey of nine states". Language, Speech, and Hearing Services in Schools, 24 (2), 84-91.
54. Kemp, K. & Klee, T. 1997. "Clinical language sampling practices: Results of a survey of speech-language pathologists in the United States". Child Language Teaching and Therapy, 13 (2), 161-176.
55. Kemper, S., Greiner, L. H., Marquis, J. G., Prenovost, K. & Mitzner, T. L. 2001. "Language decline across the life span: Findings from the Nun study". Psychology and Aging, 16 (2), 227-239.
56. Kintsch, W. 1974. The Representation of Meaning in Memory. Hillsdale, NJ: Lawrence Erlbaum Associates.
57. Kintsch, W. 2000. "Metaphor comprehension: A computational theory". Psychonomic Bulletin and Review, 7 (2), 257-266.
58. Kintsch, W. & Bowles, A. 2002. "Metaphor comprehension: What makes a metaphor difficult to understand?". Metaphor and Symbol, 17 (4), 249-262.
59. Kintsch, W. & Keenan, J. 1973. "Reading rate and retention as a function of the number of propositions in the base structure of sentences". Cognitive Psychology, 5 (3), 257-274.
60. Kučera, H. & Francis, W. N. 1967. Computational Analysis of Present-Day American English. Providence, RI: Brown University Press.
61. Landauer, T. K. & Dumais, S. T. 1997. "A solution to Plato's problem: The Latent Semantic Analysis theory of the acquisition, induction, and representation of knowledge". Psychological Review, 104 (2), 211-240.
62. Landauer, T. K., Foltz, P. W. & Laham, D. 1998. "An introduction to Latent Semantic Analysis". Discourse Processes, 25 (2-3), 259-284.
63. Lee, L. L. 1974. Developmental Sentence Analysis. Evanston: Northwestern University Press.
64. Lepore, S. & Smyth, J. (Eds.) 2002. The Writing Cure: How Expressive Writing Promotes Health and Emotional Well-Being. Washington DC: American Psychological Association Press.
65. Limber, J. 1973. "The genesis of complex sentences". In T. E. Moore (Ed.), Cognitive Development and the Acquisition of Language. New York: Academic Press, 169-185.
66. Long, S. H., Fey, M. E. & Channell, R. W. 2000. Computerized Profiling (CP) Version 9.2.7 (MS-DOS) [Computer software]. Department of Communication Sciences, Case Western Reserve University, Cleveland OH.
67. MacWhinney, B. 2000. The CHILDES Project: Tools for Analyzing Talk. Volume 1: Transcription Format and Programs. 3rd ed. Mahwah, NJ: Lawrence Erlbaum Associates.
68. Malvern, D. D. & Richards, B. J. 1997. "A new measure of lexical diversity". In A. Ryan & A. Wray (Eds.), Evolving Models of Language. Clevedon: Multilingual Matters, 58-71.
69. Malvern, D. D. & Richards, B. J. 2000. "Validation of a new measure of lexical diversity". In M. Beers, B. van den Bogaerde, G. Bol, J. de Jong & C. Rooijmans (Eds.), From Sound to Sentence: Studies on First Language Acquisition. Amsterdam/Philadelphia: John Benjamins, 81-96.
70. McKee, G., Malvern, D. & Richards, B. 2000. "Measuring vocabulary diversity using dedicated software". Literary and Linguistic Computing, 15 (3), 323-338.
71. Meara, P. & Bell, H. 2001. "P Lex: A simple and effective way of describing the lexical characteristics of short L2 texts". Prospect, 16 (3), 323-337.
72. Meara, P. M. & Miralpeix, I. 2004a. D-Tools. Swansea: Lognostics.
73. Meara, P. M. & Miralpeix, I. 2004b. V-Size. Swansea: Lognostics.
74. Meara, P. M. & Miralpeix, I. 2007. Vocabulary Size Estimator. Swansea: Lognostics.
75. Miller, J. F. 1981. Assessing Language Production in Children. Baltimore: University Park Press.
76. Miralpeix, I. & Meara, P. M. 2006. D-Tools v2.0. Swansea: Lognostics.
77. Nation, I. S. P. 1984. Vocabulary Lists. English Language Institute Occasional Publication No.12, University of Wellington, Victoria, New Zealand.
78. Nation, I. S. P. 1990. Teaching and Learning Vocabulary. Boston, MA: Heinle & Heinle.
79. Olson, J. 2004. Forensic Linguistics: An Introduction to Language, Crime and the Law. London: Continuum.
80. Ortega, L. 2003. "Syntactic complexity measures and their relationship to L2 proficiency: A research synthesis of college-level L2 writing". Applied Linguistics, 24 (4), 492-518.
81. Pennebaker, J. W. 1997. "Writing about emotional experiences as a therapeutic process". Psychological Science, 8 (3), 162-166.
82. Pennebaker, J. W., Francis, M. E. & Booth, R. J. 2001. Linguistic Inquiry and Word Count (LIWC): LIWC2001. Mahwah, NJ: Lawrence Erlbaum Associates.
83. Pennebaker, J. W., Mayne, T. & Francis, M. E. 1997. "Linguistic predictors of adaptive bereavement". Journal of Personality and Social Psychology, 72 (4), 863-871.
84. R Development Core Team 2008. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. Available at: http://www.R-project.org (accessed August 2010).
85. Read, J. 2000. Assessing Vocabulary. Cambridge: Cambridge University Press.
86. Reed, W. J. & Jorgensen, M. 2004. "The Double Pareto-Lognormal Distribution - A new parametric model for size distributions". Communications in Statistics: Theory and Methods, 33 (8), 1733-1753.
87. Riley, K., Snowdon, D., Desrosiers, M. F. & Markesbery, W. R. 2005. "Early life linguistic ability, late life cognitive function, and neuropathology: Findings from the Nun study". Neurobiology of Aging, 26 (3), 341-347.
88. Rosenberg, S. 1974. Linguistic Maturity and Language Development in Elementary School-Age Children. Chicago: Computer Psychometrics Affiliates.
89. Rosenberg, S. & Abbeduto, L. 1987. "Indicators of linguistic competence in the peer group conversational behavior of mildly retarded adults". Applied Psycholinguistics, 8 (1), 19-32.
90. Rosenberg, S. & Tucker, G. J. 1978. "Verbal behavior and schizophrenia: The semantic dimension". Archives of General Psychiatry, 36 (12), 1331-1337.
91. Sampson, G. R. 2001. Empirical Linguistics. London: Continuum.
92. Scarborough, H. S. 1990. "Index of Productive Syntax". Applied Psycholinguistics, 11 (1), 1-22.
93. Schlichting, J. & Lutje Spelberg, H. 2003. "A test for measuring syntactic development in young children". Language Testing, 20 (3), 241-266.
94. Shimizu, S. 2009: online. JACET 8000 level marker. Available at: http://www.tcp-ip.or.jp/~shim/J8LevelMarker/j8lm.cgi (accessed August 2010).
95. Sichel, H. S. 1986. "Word frequency distributions and type-token characteristics". Mathematical Scientist, 11, 45-72.
96. Sinclair, J. McH. (Ed.) 1987. Looking Up. London/Glasgow: Collins/COBUILD.
97. Sinclair, J. McH. 2004. Trust the Text. London: Routledge.
98. Snowdon, D. A., Greiner, L. H., Kemper, S. J., Nanayakkara, N. & Mortimer, J. A. 1999. "Linguistic ability in early life and longevity: Findings from the Nun study". In J.-M. Robine, B. Forette, C. Franceschi & M. Allard (Eds.), The Paradoxes of Longevity. Berlin: Springer Verlag, 103-113.
99. Snowdon, D. A., Greiner, L. H. & Markesbery, W. R. 2000. "Linguistic ability in early life and the neuropathology of Alzheimer's disease and cerebrovascular disease". Annals of the New York Academy of Sciences, 903, 34-38.
100. Snowdon, D. A., Greiner, L. H., Wekstein, D. R., Danner, D., Markesbery, W. R., Kemper, S. J. & Mortimer, J. A. 1996. "Linguistic ability in early life and Alzheimer disease in late life: Replies to comments by Massie and by Miranda". Journal of the American Medical Association, 275 (24), 1879.
101. Snowdon, D., Kemper, S., Mortimer, J. A., Greiner, L. H., Wekstein, D. R. & Markesbery, W. R. 1996. "Linguistic ability in early life and cognitive function and Alzheimer's disease in late life. Findings from the Nun study." Journal of the American Medical Association, 275 (7), 528-532.
102. Soto, R. 1999. "Learning and performing by Exploration: Label quality measured by Latent Semantic Analysis". Proceedings of CHI '99. Pittsburgh, PA: ACM, 418-425. Also available at: http://lsa.colorado.edu/ (accessed August 2010).
103. Stemmer, B. 2008. "Neuropragmatics". In M. J. Ball, M. R. Perkins, N. Müller & S. Howard (Eds.), The Handbook of Clinical Linguistics. Oxford: Blackwell, 61-78.
104. Stiles, W. B. 1992. Describing Talk: A Taxonomy of Verbal Response Modes. London: Sage.
105. Stromswold, K. 2001. "The heritability of language: A review and meta-analysis of twin, adoption and linkage studies". Language, 77 (4), 647-723.
106. Stromswold, K. 2006. "Why aren't identical twins linguistically identical? Genetic, prenatal and postnatal factors". Cognition, 101 (2), 333-384.
107. Szmrecsányi, B. 2004. "On operationalizing syntactic complexity". In G. Purnelle, C. Fairon & A. Dister (Eds.), Le Poids des Mots: Proceedings of the 7th International Conference on Textual Data Statistical Analysis. Louvain-la-Neuve, March 2004, Vol. 2. Louvain-la-Neuve: Presses Universitaires de Louvain, 1032-1039.
108. Tidball, F. & Treffers-Daller, J. 2007. "Exploring measures of vocabulary richness in semi-spontaneous speech of native and non-native speakers of French: A quest for the Holy Grail?". In H. Daller, J. Milton & J. Treffers-Daller (Eds.), Modelling and Assessing Vocabulary Knowledge. Cambridge: Cambridge University Press, 133-149.
109. Treffers-Daller, J. & van Hout, R. 1999. "De meting van woordenschatrijkdom in het Turks van Turks-Duits tweetaligen" [The measurement of vocabulary richness in Turkish as spoken by Turkish-German bilinguals]. In E. Huls & B. Weltens (Eds.), Artikelen van de Derde Sociolinguistische Conferentie [Papers from the Third Sociolinguistics Conference]. Eburon Delft, 429-440.
110. Turner, A. & Greene, E. 1977. The Construction and Use of a Propositional Text Base. Technical Report 63. Boulder, Colorado: University of Colorado, Psychology Dept.
111. Ure, J. 1971. "Lexical density and register differentiation". In G. E. Perren & I. L. M. Trim (Eds.), Applications of Linguistics. Cambridge: Cambridge University Press, 443-452.
112. Van Halteren, H., Baayen, R. H., Tweedie, F., Haverkort, M. & Neijt, A. 2005. "New machine learning methods demonstrate the existence of a human stylome". Journal of Quantitative Linguistics, 12 (1), 65-77.
113. Van Hout, R. & Vermeer, A. 2007. "Comparing measures of lexical richness". In H. Daller, J. Milton & J. Treffers-Daller (Eds.), Modelling and Assessing Vocabulary Knowledge. Cambridge: Cambridge University Press, 93-115.
114. Vavra, E. 2000: online. Definitions of the 'T-Unit'. Pennysylvania College of Technology. Available at: http://home.pct.edu/~evavra/ED498/Essay009- Def-TUnit.htm (accessed August 2010).
115. Wainwright, M. A., Wright, M. J., Geffen, G. M., Geffen, L. B., Luciano, M. & Martin, N. G. 2004. "Genetic and environmental sources of covariance between reading tests used in neuropsychological assessment and IQ subtests". Behavior Genetics, 34 (4), 365-376.
116. Wainwright, M. A., Wright, M. J., Luciano, M., Geffen, G. M. & Martin, N. G. 2005a. "Multivariate genetic analysis of academic skills of the Queensland Core Skills Test and IQ highlight the importance of genetic g". Twin Research and Human Genetics, 8 (6), 602-608.
117. Wainwright, M. A., Wright, M. J., Geffen, G. M., Luciano, M. & Martin, N. G. 2005b. "The genetic basis of academic achievement on the Queensland Core Skills Test and its shared genetic variance with IQ". Behavior Genetics, 35 (2), 133-145.
118. Wasow, T. 1997a. "End-weight from the speaker's perspective". Journal of Psycholinguistic Research, 26 (3), 347-361.
119. Wasow, T. 1997b. "Remarks on grammatical weight". Language Variation and Change, 9 (1), 81-105.
120. West, M. 1953. A General Service List of English Words: With Semantic Frequencies and a Supplementary Word-list for the Writing of Popular Science and Technology. London: Longman.
121. Wray, A. 1992. The Focusing Hypothesis: The Theory of Left Hemisphere Lateralised Language Reexamined. Amsterdam/Philadelphia: John Benjamins.
122. Wray, A. 2002. Formulaic Language and the Lexicon. Cambridge: Cambridge University Press.
123. Wray, A. 2008. Formulaic Language: Pushing the Boundaries. Oxford: Oxford University Press.
124. Wray, A. & Grace, G. W. 2007. "The consequences of talking to strangers: Evolutionary corollaries of socio-cultural influences on linguistic form". Lingua, 117 (3), 543-578.
125. Wray A. & Pegg, C. 2009. "The effect of memorized learning on the writing scores of Chinese IELTS test takers". IELTS Research Reports, 9, 191-216.
126. Wright, M., De Geus, E., Ando, J., Luciano, M., Posthuma, D., Ono, Y., Hansell, N., Van Baal, C., Hiraishi, K., Hasegawa, T., Smith, G., Geffen G., Geffen, L., Kanba, S., Miyake, A., Martin, M. & Boomsma, D. 2001. "Genetics of cognition: Outline of a collaborative twin study". Twin Research, 4 (1), 48-56.
127. Yamaguchi, T. 2006. "Vocabulary frequency in university entrance examination in Japan". Proceedings of 11th Conference of the Pan-Pacific Association of Applied Linguistics, 318-332. Also available at: http://www.paaljapan.org/resources/proceedings/PAAL11/pdfs/26.pdf (accessed August 2010).
128. Yngve, V. H. A. 1960. "A model and an hypothesis for language structure". Proceedings of the American Philosophical Society, 104 (5), 444-466.