Does an argument-based approach to validity make a difference?

Educational Measurement: Issues and Practice

Volumn 29, Issue 1, 2010, Pages 3-13

  Chapelle, Carol A ^a   Enright, Mary K ^b   Jamieson, Joan ^c  

^a IOWA STATE UNIVERSITY   (United States)

^b EDUCATIONAL TESTING SERVICE   (United States)

^c NORTHERN ARIZONA UNIVERSITY   (United States)

Author keywords

Claim; Construct; High stakes; Inference; Interpretive argument; Standards; TOEFL; Validity argument

Indexed keywords

EID: 77952507895     PISSN: 07311745     EISSN: 17453992     Source Type: Journal    
DOI: 10.1111/j.1745-3992.2009.00165.x     Document Type: Article

References (44)

1. Standards for educational and psychological testing 1999, AERA, APA, & NCME, Washington, DC, AERA
2. Alderson J C, Clapham C, Wall D. Language testing construction and evaluation 1995, Cambridge, Cambridge University Press
3. Bachman L F. Fundamental considerations in language testing 1990, Oxford, Oxford University Press
4. Alternative interpretations of alternative assessments: Some validity issues in educational performance assessments. Educational Measurement: Issues and Practice 2002, 21(3):5-18. Bachman, L. F.
5. Building and supporting a case for test use. Language Assessment Quarterly 2005, 2(1):1-34. Bachman, L. F.
6. Bachman L F. What is the construct? The dialectic of abilities and contexts in defining constructs in language assessment. What are we measuring? Language testing reconsidered 2007, 41-71. Fox JWesche MBayliss D. In, Eds., pp, Ottawa, University of Ottawa Press
7. Bachman L F, Palmer A S. Language testing in practice. 1996, Oxford, Oxford University Press
8. Borsboom D. The attack of the psychometricians. Psychometrika 2006, 71(3):425-440.
9. Perspectives on the evolution and future of educational measurement. Educational Measurement 2006, 1-16. Brennan R L. Ed., In, R.Brennan, Ed., 4th ed., pp, Westport, CT, Greenwood Publishing
10. Briggs D C. Comment: Making an argument for design validity before interpretive validity. Measurement: Interdisciplinary Research and Perspectives 2004, 2(3):171-174.
11. Canale M, Swain M. Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics 1980, 1:1-47.
12. Chapelle C A. The TOEFL validity argument. Building a validity argument for the Test of English as a Foreign Language 2008, 319-352. Chapelle C AEnright M KJamieson J. In, Eds., pp, London, Routledge
13. Building a validity argument for the Test of English as a Foreign Language 2008, Chapelle C AEnright M KJamieson J. Eds., London, Routledge
14. Chalhoub-Deville M. Task-based assessments: Characteristics and validity evidence. Researching pedagogical tasks: Second language learning, teaching and testing 2001, 210-228. Bygate MSkehan PSwain M. In, Eds., pp, Harlow, UK, Longman
15. Cronbach L. Five perspectives on validity argument. Test validity 1988, 3-17. Wainer HBraun H. In, Eds., pp, Hillsdale, NJ, Lawrence Erlbaum
16. Cronbach L J, Meehl P E. Construct validity in psychological tests. Psychological Bulletin 1955, 52:281-302.
17. Cummins J P. Language proficiency and academic achievement. Issues in language testing research 1983, 108-126. Oller J. In, Ed., pp, Rowley, MA, Newbury House
18. Reliability and comparability of TOEFL® iBT scores. 2008, http://www.ets.org/Media/Tests/TOEFL/pdf/TOEFL_iBT_Reliability.pdf, Educational Testing Service, Retrieved October 2, 2008, from
19. Embretson S. Construct validity: Construct representation versus nomothetic span. Psychological Bulletin 1983, 93(1):179-197.
20. Kane M T. An argument-based approach to validity. Psychological Bulletin 1992, 112:527-535.
21. Kane M T. Current concerns in validity theory. Journal of Educational Measurement 2001, 38:319-342.
22. Kane M T. Validating high-stakes testing programs. Educational Measurement: Issues and Practice 2002, 21:31-41.
23. Kane M. Certification testing as an illustration of argument-based validation. Measurement 2004, 2(3):135-170.
24. Kane M. Validation. Educational Measurement 2006, 17-64. Brennan R. In, Ed., 4th ed., pp, Westport, CT, Greenwood Publishing
25. Kane M, Crooks T, Cohen A. Validating measures of performance. Educational Measurement: Issues and Practice 1999, 18(2):5-17.
26. Educational measurement 1989, Linn R L. Ed., 3rd ed., New York, Macmillan
27. McNamara T. Measuring second language performance 1996, London, Longman
28. Messick S. Validity. Educational measurement 1989, 13-103. Linn RL. In, Ed., 3rd ed., pp, New York, Macmillan
29. Messick S. The interplay of evidence and consequences in the validation of performance assessments. Educational Researcher 1994, 23(2):13-23.
30. Norris J M, Brown J D, Hudson T D, Bonk W. Examinee abilities and task difficulty in task-based second language performance assessment. Language Testing 2002, 19:395-418.
31. Oller J. Language tests at school 1979, London, Longman
32. Shepard L A. Evaluating test validity. Review of Research in Education 1993, 19:405-450.
33. Skehan P. A cognitive approach to language learning 1998, Oxford, Oxford University Press
34. Toward communicative competence testing: Proceedings of the second TOEFL invitational conference 1986, Stansfield C W. Ed., TOEFL Research Reports, No. 21, Princeton, NJ, Educational Testing Service
35. Toulmin S E. The uses of argument 2003, updated ed., Cambridge, UK, Cambridge University Press
36. Toulmin S E, Rieke R, Janik A. An introduction to reasoning 1984, New York, Macmillan
37. Wall D, Horák T. The impact of changes in the TOEFL examination on teaching: Phase I, The baseline study 2006, TOEFL-Monograph Series Report No. 34, Princeton, NJ, Educational Testing Service
38. Wall D, Horák T. The impact of changes in the TOEFL examination on teaching and learning in Central and Eastern Europe: Phase 2, Coping with change 2008, TOEFL iBT Report No. TOEFLiBT-05, Princeton, NJ, Educational Testing Service
39. Wall D, Horák T. The impact of changes in the TOEFL® examination on teaching and learning in a sample of countries in Europe: Phase 3, The role of the course book, and Phase 4, Describing change submitted for publication, Princeton, NJ, Educational Testing Service
40. Weir C J. Language testing and validation: An evidence-based approach 2005, Basingstoke, UK, Palgrave Macmillan
41. Theoretical models, assessment frameworks, and test construction. Language Testing 1997, 14:3-22. Chalhoub-Deville, M.
42. Construct definition and validity inquiry in SLA research. Interfaces between second language acquisition and language testing research 1998, 32-70. Bachman L FCohen A D. Chapelle, C. A., In, Eds, pp, Cambridge, UK, Cambridge University Press
43. TOEFL research: Ensuring test quality 2007, http://www.ets.org/Media/Research/pdf/Framework_Recent_TOEFL_Research.pdf, Educational Testing Service, Retrieved August 13, 2008, from
44. On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives 2003, 1:3-62. Mislevy, R. J., Steinberg, L. S., &, Almond, R. G.