Bringing reading-to-write and writing-only assessment tasks together: A generalizability analysis

Assessing Writing

Volumn 15, Issue 2, 2010, Pages 100-117

  Gebril, Atta ^a  

^a UNITED ARAB EMIRATES UNIVERSITY   (United Arab Emirates)

Author keywords

Academic writing; Generalizability theory; Independent tasks; Integrated tasks; L2 writing assessment; Reading writing connections; Score reliability

Indexed keywords

EID: 77954458467     PISSN: 10752935     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asw.2010.05.002     Document Type: Article

References (35)

1. Bachman L. Statistical analyses for language assessment 2004, Cambridge University Press, Cambridge.
2. Bachman L., Palmer A. Language testing in practice 1996, Oxford University Press, Oxford.
3. Breland H.M., Camp R., Jones R.J., Morris M.M., Rock D.A. Assessing writing skills 1987, College Entrance Examination Board, New York.
4. Brennan R.L. Manual for mJENOVA (version 2.0) 1999, CASMA, Iowa City, IA.
5. Brennan R.L. Generalizability theory 2001, Springer, New York.
6. Brennan R.L. Coefficients and indices in generalizability theory. CASMA Research Report No. 1 2003, University of Iowa Center for Advanced Studies in Measurement and Assessment, Iowa City, Available on http://www.education.uiowa.edu/casma.
7. Brennan R., Goa X., Colton D. Generalizability analyses of WorkKeys listening and writing tests. Educational and Psychological Measurement 1995, 55(2):157-176.
8. Cho Y. Assessing writing: Are we bound by only one method?. Assessing Writing 2003, 8:165-191.
9. Cooper P.L. The assessment of writing ability: A review of research (GRE Board Research Report No. GREB 82-15R/ETS Research Report No. 84-12) 1984, Educational Testing Service, Princeton, NJ.
10. Cumming A., Kantor R., Baba K., Erdosy U., Eouanzoui K., James M. Differences in written discourse in independent and integrated prototype tasks for next generation TOEFL. Assessing Writing 2005, 10:5-43.
11. Dunbar S.B., Koretz D.M., Hoover H.D. Quality control in the development and use of performance assessments. Applied Psychological Measurement 1991, 4(4):289-303.
12. Feldt L.S., Brennan R.L. Reliability. Educational measurement 1989, 105-146. Macmillan, New York. 3rd ed. R.L. Linn (Ed.).
13. Gao X., Brennan R. Variability of estimated variance components and related statistics in a performance assessment. Applied Measurement in Education 2001, 14(2):191-203.
14. Gebril A. Score generalizability of academic writing tasks: Does one test method fit it all?. Language Testing 2009, 26:507-531.
15. Gebril A., Plakans L. Investigating source use, discourse features, and process in integrated writing tests. Spaan fellow working papers in second/foreign language assessment 7 2009, The University of Michigan, Ann Arbor, pp. 47-84.
16. Hale G., Taylor C., Bridgeman J., Carson J., Kroll B., Kantor R. A study of writing tasks assigned in academic degree programs 1996, Educational Testing Service, Princeton, NJ.
17. Hamp-Lyons L. Scoring procedures for ESL contexts. Assessing second language writing in academic contexts 1991, 241-276. Ablex Publishing Corp., Norwood, NJ. L. Hamp-Lyons (Ed.).
18. Hamp-Lyons L., Kroll B. Issues in ESL writing assessment: An overview. College ESL 1996, 6(1):52-72.
19. Hughes A. Testing for language teachers 2003, Cambridge University Press, Cambridge. 2nd ed.
20. Huot B.A. The literature of direct writing assessment: Major concerns and prevailing trends. Review of Educational Research 1990, 60:237-263.
21. Johnson S., Johnson R. Conceptualizing and interpreting reliability. Coventry: Qualifications and curriculum authority 2010, (Available on http://www.excellencegateway.org.uk/pdf/2010_02_01_Conceptualising%20and%20interpreting%20reliability.pdf).
22. Kane M., Crooks T., Cohen A. Validating measures of performance. Educational Measurement, Issues and Practice 1999, 18(2):5-17.
23. Lee Y. Dependability of scores for a new ESL speaking assessment consisting of integrated and independent tasks. Journal of Language Testing 2006, 23(2):131-166.
24. Lee Y., Kantor R. Dependability of new ESL writing test scores: Tasks and alternative rating schemes (TOEFL Monograph Series No. 31) 2005, ETS, Princeton, NJ.
25. Lewkowicz J. The integrated testing of a second language. Encyclopedia of language and education, Vol. 7. Language testing and assessment 1997, 121-130. Kluwer Academic Publishers, Dordrecht, The Netherlands. C. Clapham (Ed.).
26. Messick S. Validity. Educational measurement 1996, 13-103. Macmillan, New York. 3rd ed. R.L. Linn (Ed.).
27. Plakans, L. (2007). Second language writing and reading-to-write assessment tasks: A process study. Unpublished Doctoral Dissertation. Iowa City, IA: The University of Iowa.
28. Plakans L. Comparing composing processes in writing-only and reading-to-write test tasks. Assessing Writing 2008, 13:111-129.
29. Reckase M. Portfolio assessment: A theoretical estimate of score reliability. Educational Measurement: Issues and Practice 1995, 14(1):31. 12-14.
30. Schoonen R. Generalizability of writing scores: An application of structural equation modeling. Language Testing 2005, 22(1):1-30.
31. Shavelson R., Baxter G., Goa X. Sampling variability of performance assessments. Journal of Educational Measurement 1993, 30(3):215-232.
32. Shavelson R.J., Webb N.M. Generalizability theory: A primer 1991, Sage, Newbury Park, CA.
33. Stuhlmann J., Daniel K., Dellinger A., Denny R., Powers T. A generalizability study of the effects of training on teachers' ability to rate children's writing using a rubric. Journal of Reading Psychology 1999, 20:107-127.
34. Van Leeuwen D.M. Assessing reliability of measurements with generalizability theory: An application to inter-rater reliability. Journal of Agricultural Education 1997, 38:36-42.
35. Weigle S.C. Assessing writing 2002, Cambridge University Press, Cambridge.