Design and analysis in task-based language assessment

Language Testing

Volumn 19, Issue 4, 2002, Pages 477-496

  Mislevy, Robert J ^a   Steinberg, Linda S ^b   Almond, Russell G ^b  

^a UNIVERSITY OF MARYLAND   (United States)

^b EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84990359449     PISSN: 02655322     EISSN: None     Source Type: Journal    
DOI: 10.1191/0265532202lt241oa     Document Type: Article

References (42)

1. ACTFL (American Council on the Training of Foreign Languages) 1989: ACTFL proficiency guidelines. Yonkers, NY: Author.
2. ACTFL (American Council on the Training of Foreign Languages) 1999: ACTFL proficiency guidelines: speaking. Revised 1999. Hastings-on-Hudson: Author.
3. Adams, R., Wilson, M. R. and Wang, W.-C. 1997: The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement 21, 1-23.
4. Almond, R. G. and Mislevy, R. J. 1999: Graphical models and computerized adaptive testing. Applied Psychological Measurement 23, 223-237.
5. Almond, R. G., Steinberg, L. S. and Mislevy, R. J. 2001: A sample assessment using the four process framework. CSE Technical Report 543. Los Angeles, CA: The National Center for Research on Evaluation, Standards, Student Testing (CRESST), Center for Studies in Education, UCLA.
6. Bachman, L. F. 1990: Fundamental considerations in language testing. Oxford: Oxford University Press.
7. Bachman, L. F. and Palmer, A. S. 1996: Language testing in practice. Oxford: Oxford University Press.
8. Berger, M. P. F. and Veerkamp, W. J. J. 1996: A review of selection methods for optimal test design. In Engelhard, G. and Wilson, M., editors, Objective measurement: theory into practice, Volume 3. Norwood, NJ: Ablex.
9. Bradlow, E. T., Wainer, H. and Wang, X. 1999: A Bayesian random effects model for testlets. Psychometrika 64, 153-168.
10. Brindley, G. 1994: Task-centred assessment in language learning: the promise and the challenge. In Bird, N., Falvey, P., Tsui, A., Allison, D. and McNeill, A., editors, Language and learning: papers presented at the Annual International Language in Education Conference (Hong Kong, 1993). Hong Kong: Hong Kong Education Department, 73-94.
11. Brindley, G. editor, 2000: Studies in immigrant English language assessment. Sydney: Macquarie University Sydney, National Centre for English Language Teaching and Research.
12. Brown, J. D., Hudson, T. D., Norris, J. M. and Bonk, W. in press: Investigating task-based second language performance assessment. Honolulu: University of Hawaii Press.
13. Cronbach, L. J., Gleser, G. C., Nanda, H. and Rajaratnam, N. 1972: The dependability of behavioral measurements: theory of generalizability for scores and profiles. New York: Wiley.
14. DeSmedt, W. 1995: Herr Kommissar: an ICALL conversation simulator for intermediate German. In Holland, V. M., Kaplan, J. and Sams, M., editors, Intelligent language tutors: theory shaping technology. Hillsdale, NJ: Lawrence Erlbaum, 153-174.
15. Duran, R. P., Canale, M., Penfield, J., Stansfield, C. S. and Liskin-Gasparro, J. E. 1985: TOEFL from a communicative viewpoint on language proficiency: a working paper. TOEFL Research Report No. 17. Princeton, NJ: Educational Testing Service.
16. Embretson, S. E., editor, 1985: Test design: developments in psychology and psychometrics. Orlando, FL: Academic Press.
17. Embretson, S. E. 1998: A cognitive design systems approach to generating valid tests: application to abstract reasoning. Psychological Methods 3, 380-396.
18. Fischer, G. H. 1973: The linear logistic test model as an instrument in educational research. Acta Psychologica 37, 359-374.
19. Frase, L. T., Chudorow, M., Almond, R. G., Burstein, J., Kukich, K., Mislevy, R. J., Steinberg, L. S. and Singley, K. in press: Technology and assessment. In O”Neil, H. F. and Perez, R., editors, Technology applications in assessment: a learning view.
20. Frederiksen, J. R. and Collins, A. 1989: A systems approach to educational testing. Educational Researcher 18, 27-32.
21. Green, B. 1978: In defense of measurement. American Psychologist 33, 664-670.
22. Kirsch, I. S. and Jungeblut, A. 1986: Literacy: profiles of America's young adults. Princeton, NJ: National Assessment of Educational Progress/Educational Testing Service.
23. Linacre, J. M. 1989: Multi-faceted Rasch measurement. Chicago, IL: MESA Press.
24. Linn, R. L. 1994: Performance assessment: policy promises and technical measurement standards. Educational Researcher 23, 4-14.
25. Long, M. H. and Norris, J. M. 2000: Task-based language teaching and assessment. In Byram, M., editor, Encyclopedia of language teaching. London: Routledge, 597-603.
26. McNamara, T. 1996: Measuring second language performance. Harlow
27. Messick, S. 1994: The interplay of evidence and consequences in the validation of performance assessments. Education Researcher 32, 13-23.
28. Mislevy, R. J. and Gitomer, D. H. 1996: The role of probability-based inference in an intelligent tutoring system. User-Modeling and User-Adapted Interaction 5, 253-282.
29. Mislevy, R. J., Steinberg, L. S., Breyer, F. J., Almond, R. G. and Johnson, L. 1999: A cognitive task analysis, with implications for designing a simulation-based assessment system. Computers and Human Behavior 15, 335-374.
30. Mislevy, R. J., Steinberg, L. S. and Almond, R. G. in press: On the structure of educational assessments. Measurement.
31. Mislevy, R. J., Steinberg, L. S., Breyer, F. J., Almond, R. G. and Johnson, L. in press: Making sense of data from complex assessment. Applied Measurement in Education.
32. Mosenthal, P. B. 1985: Defining the expository discourse continuum. Poetics 15, 387-414.
33. Muthén, B. 1988: Some uses of structural equation modeling in validity studies: extending IRT to external variables. In Wainer, H. and Braun, H., editors, Test validity. Hillsdale, NJ: Erlbaum.
34. Norris, J. M., Brown, J. D., Hudson, T. D. and Yoshioka, J. K. 1998: Designing second language performance assessment. Honolulu: University of Hawaii Press.
35. Patz, R. J. and Junker, B. W. 1999: Applications and extensions of MCMC in IRT: multiple item types, missing data, and rated responses. Journal of Educational and Behavioral Statistics 24, 342-366.
36. Robinson, P. 2001: Task complexity, task difficulty, and task production: exploring interactions in a componential framework. Applied Linguistics 22, 27-57.
37. Selinker, L., Tarone, E. and Hanzeli, V., editors, 1981: English for technical and academic purposes: studies in honor of Louis Trimble. Rowley, MA: Newbury House.
38. Shavelson, R. J., Baxter, G. P. and Pine, J. 1992: Performance assessments: political rhetoric and measurement reality. Educational Researcher 21, 22-27.
39. Sheingold, K. and Frederiksen, J. R. 1994: Using technology to support innovative assessment. In Means, B., editor, Technology and education reform. San Francisco, CA: Jossey-Bass, 111-131.
40. Skehan, P. 1998: A cognitive approach to language learning. Oxford: Oxford University Press.
41. Wiggins, G. 1993: Assessing student performance. San Francisco, CA: Jossey Bass.
42. Wolf, D., Bixby, J., Glenn, J. and Gardner, H. 1991: To use their minds well: investigating new forms of student assessment. In Grant, G., editor, Review of educational research, Volume 17. Washington, DC: American Educational Research Association 31-74.