Differences in written discourse in independent and integrated prototype tasks for next generation TOEFL

Assessing Writing

Volumn 10, Issue 1, 2005, Pages 5-43

  Cumming, Alister ^a   Kantor, Robert ^b   Baba, Kyoko ^a   Erdosy, Usman ^c   Eouanzoui, Keanre ^d   James, Mark ^e  

^a UNIVERSITY OF TORONTO   (Canada)

^b Educational Testing Service   (Canada)

^c CARLETON UNIVERSITY   (Canada)

^d NIAGARA UNIVERSITY   (United States)

^e UNIVERSITY OF PUERTO RICO   (Puerto Rico)

Author keywords

Discourse analysis; ESL writing; Integrated tasks; TOEFL; Writing assessment

Indexed keywords

EID: 18844439204     PISSN: 10752935     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asw.2005.02.001     Document Type: Article

References (66)

1. C. Alderson & L. Hamp-Lyons TOEFL preparation courses: A study of washback TESOL Quarterly 13 1996 280-297
2. Anderson, M. J. (1999). Non-parametric MANOVA: A computer program. Sydney, Australia: University of Sydney, Centre for Research on Ecological Impacts of Coastal Cities. Retrieved from http://www.stat.auckland.ac.nz/people/Marti.
3. M.J. Anderson A new method for non-parametric multivariate analysis of variance Austral Ecology 26 2001 32-46
4. Bailey, K. M. (1999). Washback in language testing. TOEFL Monograph Series, MS. 15. Princeton, NJ: Educational Testing Service.
5. K. Bardovi-Harlig & T. Bofman Attainment of syntactic and morphological accuracy by advanced language learners Studies in Second Language Acquisition 11 1989 17-34
6. D. Biber Variation across speech and writing 1988 Cambridge University Press Cambridge
7. M. Britt & C. Aglinskas Improving students' ability to identify and use source information Cognition and Instruction 20 2002 485-522
8. A. Brown & J.D. Day Macrorules for summarizing texts: The development of expertise Journal of Verbal Learning 22 1983 1-14
9. A. Chenoweth & J.R. Hayes Fluency in writing: Generating text in L1 and L2 Written Communication 18 2001 90-98
10. Chipere, N., Malvern, D., Duran, P., & Richards, B. (2003, March). Some quantifiable aspects of literacy development. Paper presented at the Annual Meeting of the American Association of Applied Linguistics, Washington, DC.
11. J. Cohen Statistical power analysis for the behavioral sciences 1969 Academic Press New York
12. U. Connor Linguistic/rhetorical measures for international persuasive student writing Research in the Teaching of English 24 1990 67-87
13. J. Crammond The uses and complexity of argument structures in student persuasive writing Written Communication 15 1998 230-268
14. Cumming, A. (1997). The testing of second-language writing. In: D. Corson (Series Ed.) & C. Clapham (Vol. Ed.), The encyclopedia of language and education: Vol. 7 Language assessment (pp. 51-63). Dordrecht, The Netherlands: Kluwer.
15. A. Cumming Learning to write in a second language: Two decades of research International Journal of English Studies 1 2001 1-23
16. A. Cumming Assessing L2 writing: Alternative constructs and ethical dilemmas Assessing Writing 8 2002 73-83
17. A. Cumming L. Grant P. Mulcahy-Ernt & D. Powers A teacher-verification study of speaking and writing prototype tasks for a new TOEFL Language Testing 21 2 2004 159-197
18. Cumming, A., Kantor, R., & Powers, D. (2001). Scoring TOEFL essays and TOEFL 2000 prototype tasks: An investigation into raters' decision making and development of a preliminary analytic framework. TOEFL Monograph Series, Report No. 22. Princeton, NJ: Educational Testing Service.
19. A. Cumming R. Kantor & D. Powers Decision making while scoring ESL/ EFL compositions: A descriptive model Modern Language Journal 86 2002 67-96
20. Cumming, A., Kantor, R. Powers, D., Santos, T., & Taylor, C. (2000). TOEFL 2000 writing framework: A working paper. TOEFL Monograph 18. Princeton, NJ: Educational Testing Service.
21. A. Cumming & D. Mellow An investigation into the validity of written indicators of second language proficiency In: A. Cumming R. Berwick (Eds.) Validation in language testing 1996 Multilingual Matters Clevedon, UK 72-93
22. A. Cumming J. Rebuffot & M. Ledwell Reading and summarizing challenging texts in first and second languages Reading and Writing 2 1989 201-219
23. J.D. Day Teaching summarization skills: Influences of student ability level and strategy difficulty Cognition and Instruction 3 1986 193-210
24. Educational Testing Service. (2002). LanguEdge courseware: Handbook for scoring speaking and writing. Princeton, NJ: Educational Testing Service.
25. C. Engber The relationship of lexical proficiency to the quality of ESL compositions Journal of Second Language Writing 4 1995 139-155
26. L. Faigley The influence of generative rhetoric on the syntactic maturity and writing effectiveness of college freshmen Research in the Teaching of English 13 1979 197-206
27. Frase, L., Faletti, J., Ginther, A., & Grant, L. (1999). Computer Analysis of the TOEFL Test of Written English (TOEFL Research Report No. 64). Princeton, NJ: Educational Testing Service.
28. L. Grant & A. Ginther Using computer-tagged linguistic features to describe L2 writing differences Journal of Second Language Writing 9 2000 123-145
29. L. Hamp-Lyons & G. Henning Communicative writing profiles: An investigation of the transferability of a multiple-trait scoring instrument across ESL writing assessment contexts Language Learning 41 1991 337-373
30. Hamp-Lyons, L., & Kroll, B. (1997). TOEFL 2000 - Writing: Composition, community, and assessment. TOEFL Monograph Report No. 5. Princeton, NJ: Educational Testing Service.
31. R.H. Haswell Error and change in college student writing Written Communication 5 1988 479-499
32. T.J. Homburg Holistic evaluation of ESL compositions: Can it be validated objectively? TESOL Quarterly 18 1984 87-107
33. B. Huot The literature of direct writing assessment: Major concerns and prevailing trends Review of Educational Research 60 1990 237-263
34. S. Ishikawa Objective measurement of low-proficiency EFL narrative writing Journal of Second Language Writing 4 1995 51-69
35. Jamieson, J., Jones, S., Kirsch, I., Mosenthal, P., & Taylor, C. (2000). TOEFL 2000 framework: A working paper. TOEFL Monograph Series Report No. 16. Princeton, NJ: Educational Testing Service.
36. E. Kintsch Macroprocesses and microprocesses in the development of summarization skill Cognition and instruction 7 1990 161-195
37. R. Knudson Analysis of argumentative writing at two grade levels Journal of Educational Research 85 1992 169-179
38. B. Laufer P. Nation Vocabulary size and use: Lexical richness in L2 written composition Applied Linguistics 16 1995 307-322
39. Lee, W., Kantor, R., & Mollaun, P. (2002). Score reliability as an essential prerequisite for validating new writing and speaking tasks for TOEFL. Paper presented at the Annual TESOL Convention, Salt Lake City.
40. P. Legendre & M.J. Anderson Distance-based redundancy analysis: Testing multispecies response in multifactorial ecological experiments Ecology Monographs 69 1999 1-24
41. P. Legendre L. Legendre Numerical ecology 2nd English ed. 1998 Elsevier Amsterdam
42. P. Lennon Error: Some problems of definition, identification, and distinction Applied Linguistics 12 1991 180-196
43. T.R. Levine & C.R. Hullett Eta squared, partial eta squared, and misreporting of effect size in communication research Human Communication Research 28 2002 612-625
44. T. McCann Student argumentative writing knowledge and ability at three grade levels Research in the Teaching of English 23 1989 62-76
45. K. McCarthy Young & G. Leinhardt Writing from primary documents: A way of knowing in history Written Communication 15 1998 25-68
46. A. Pennycook Borrowing others' words: Text, ownership, memory, and plagiarism TESOL Quarterly 30 1996 201-230
47. K. Perkins Using objective methods of attained writing proficiency to discriminate among holistic evaluations TESOL Quarterly 14 1980 61-69
48. V. Plungian The place of evidentiality within the universal grammatical space Journal of Pragmatics 33 2001 349-357
49. C. Polio Measures of linguistic accuracy in second language writing research Language Learning 47 1997 101-143
50. A. Purves Reflections on research and assessment in written composition Research in the Teaching of English 26 1992 109-123
51. A. Raimes The TOEFL Test of Written English: Causes for concern TESOL Quarterly 24 1990 427-442
52. B. Rifkin & F. Roberts Error gravity: A critical review of research design Language Learning 45 1995 511-537
53. Rosenfeld, M., Leung, S., & Oltman, P. (2001). The reading, writing, speaking, and listening tasks important for academic success at the undergraduate and graduate levels. TOEFL Monograph 21. Princeton, NJ: Educational Testing Service.
54. J. Rouet M. Favart D. Gaonach & N. Lacroix Writing from multiple documents: Argumentation strategies in novice and expert history students In: G. Rijlaarsdam H. Van den Bergh M. Couzija (Eds.) Theories models and methodology in writing research 1996 University of Amsterdam Press Amsterdam 44-60
55. R. Scollon As a matter of fact: The changing ideology of authorship and responsibility in discourse World Englishes 13 1994 33-46
56. M.D. Shermis J.C. Burstein (Eds.), Automated essay scoring: A cross-disciplinary perspective 2003 Erlbaum Mahway, NJ
57. L. Shi Textual borrowing in second-language writing Written Communication 21 2004 171-200
58. C. Stansfield J. Ross A long-term research agenda for the Test of Written English Language Testing 5 1988 160-186
59. H.I. Stromso I. Braten & M.S. Samuelstuen Students' strategic use of multiple sources during expository text reading: A longitudinal think-aloud study Cognition and Instruction 21 2003 113-147
60. G. Thompson Voices in the text: Discourse perspectives on language reports Applied Linguistics 17 1996 501-530
61. G. Thompson & Y. Yiyun Evaluation in the reporting verbs used in academic papers Applied Linguistics 12 1991 365-382
62. S.E. Toulmin The uses of argument 1958 Cambridge University Press Cambridge
63. S. Toulmin R. Rieke & A. Janik An introduction to reasoning 2nd ed. 1984 Macmillan New York
64. J. Wiley J. Voss Constructing arguments from multiple sources: Tasks that promote understanding and not just memory for text Journal of Educational Psychology 91 2 1999 301-311
65. P.N. Winograd Strategic difficulties in summarizing texts Reading Research Quarterly 19 4 1984 404-425
66. K. Wolfe-Quintero S. Inagaki & H.-Y. Kim Second language development in writing: Measures of fluency accuracy and complexity 1998 University of Hawai'i at Manoa Honolulu, HI