Validating score interpretations and uses: Messick Lecture, Language Testing Research Colloquium, Cambridge, April 2010

Language Testing

Volumn 29, Issue 1, 2012, Pages 3-17

  Kane, Michael ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

argument based approach; consequences; construct validity; validation; validity

Indexed keywords

EID: 84856259567     PISSN: 02655322     EISSN: 14770946     Source Type: Journal    
DOI: 10.1177/0265532211417210     Document Type: Article

References (42)

1. Anastasi A.Evolving concepts of test validation.Annual Review of Psychology. 1986;37:1-15.
2. Bachman L. F.Building and supporting a case for test use.Language Assessment Quarterly. 2005;2 (1): 1-34.
3. Bachman L.,Palmer A.Language assessment in practice. Oxford: Oxford University Press; 2010:.
4. Blair J.Reasoning in evaluation: Inferential links and leaps. Fournier D., ed. San Francisco, CA: Jossey Bass; 1995:71-80.
5. Camilli, G. (2006). Test fairness. In R. Brennan (Ed.), Educational measurement, 4th ed. (pp. 221-256), Westport, CT: American Council on Education and Praeger.
6. Chapelle C. A.Validity in language assessment.Annual Review of Applied Linguistics. 1999;19:254-272.
7. Chapelle C. A.,Enright M. K.,Jamieson J.Does an argument-based approach to validity make a difference?.Educational Measurement: Issues and Practice. 2010;29 (1): 3-13.
8. Building a validity argument for the test of English as a foreign language. Chapelle C. A.Enright M. K.Jamieson J., ed. New York: Routledge; 2008.
9. Crooks T.,Kane M.,Cohen A.Threats to the valid use of assessment.Assessment in Education. 1996;3:265-285.
10. Cronbach, L. J. (1971). Test validation. In R. L. Thorndike (Ed.), Educational measurement, 2nd ed. (pp. 443-507). Washington, DC: American Council on Education.
11. Cronbach L. J. Five perspectives on validity argument. Test validity. Wainer H.Braun H., ed. Hillsdale, NJ: Lawrence Erlbaum; 1988:3-17.
12. Cronbach L. J. Construct validation after thirty years. Intelligence: Measurement, theory, and public policy. Linn R. E., ed. Urbana, IL: University of Illinois Press; 1989:147-171.
13. Cronbach L. J.,Gleser G. C.Psychological tests and personnel decisions. Urbana, IL: University of Illinois Press; 1965:.
14. Cronbach L. J.,Gleser G. C.,Nanda H.,Rajaratnam N.The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: Wiley; 1972:.
15. Cronbach L. J.,Meehl P. E.Construct validity in psychological tests.Psychological Bulletin. 1955;52:281-302.
16. Crooks T.,Kane M.,Cohen A.Threats to the valid use of assessments.Assessment in Education. 1996;3:265-285.
17. Cureton E. E. Validity. Educational measurement. Lindquist E. F., ed. Washington, DC: American Council on Education; 1951:.
18. Ebel R.Must all tests be valid?.American Psychologist. 1961;16:640-647.
19. Guion R.Content validity: The source of my discontent.Applied Psychological Measurement. 1977;1:1-10.
20. Guion R. M.On trinitarian conceptions of validity.Professional Psychology. 1980;11:385-398.
21. Guion R.Assessment, measurement, and prediction for personnel decisions. Mahwah, NJ: Lawrence Erlbaum; 1998:.
22. Hambleton, R., & Pitoniak, M. (2006). Setting performance standards. In R. Brennan (Ed.), Educational measurement, 4th ed. (pp. 433-470). Westport, CT: American Council on Education and Praeger.
23. House E. R.Evaluating with validity. Beverly Hills, CA: Sage Publications; 1980:.
24. Jones D.Sayings for cynics. Calgary: Detselig Enterprises; 1999:.
25. Kane M.Educational measurement. 2006). Validation. In BrennanR. (Ed.), Educational measurement, 4th ed. (pp. 17-64), Westport, CT: American Council on Education and Praeger.Brennan R., ed. Westport, CT: American Council on Education and Praeger; 2006:17-64.
26. Kane M.An argument-based approach to validation.Psychological Bulletin. 1992;112:527-535.
27. Kane M. T.Validating the performance standards associated with passing scores.Review of Educational Research. 1994;64 (3): 425-461.
28. Kane M. T.Criterion bias in examinee-centered standard setting: Some thought experiments.Educational Measurement, Issues and Practice. 1998;17:23-30.
29. Kane M. T.Practice-based standard setting.The Bar Examiner. 2002;71 (3): 14-24.
30. Kane M. T.,Crooks T. J.,Cohen A. S.Validating measures of performance.Educational Measurement: Issues and Practice. 1999;18 (2): 5-17.
31. Loevinger J.Objective tests as instruments of psychological theory.Psychological Reports, Monograph Supplement. 1957;3:635-694.
32. Lord F. M.,Novick M. R.Statistical theories of mental test scores. Reading, MA: Addison-Wesley; 1968:.
33. Messick S.Test validity and the ethics of assessment.American Psychologist. 1980;35:1012-1027.
34. Messick S.Test validity. Wainer H.Braun H., ed. Hillsdale, NJ: Lawrence Erlbaum; 1988:33-45.
35. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational Measurement, 3rd ed. (pp. 13-103). New York: American Council on Education and Macmillan.
36. Messick S.The interplay of evidence and consequences in the validation of performance assessments.Educational Researcher. 1994;23:13-23.
37. Pinto R.Argument, inference and dialectic. Kluwer Academic: Dordrecht, the Netherlands; 2001:.
38. Ryan K.Assessment validation in the context of high-stakes testing assessment.Educational Measurement: Issues and Practice. 2002;21 (1): 7-15.
39. Shepard L. A. Evaluating test validity. Review of Research in Education. Darling-Hammond L., ed. Washington, DC: American Educational Research Association; 1993:405-450.
40. Toulmin S.The uses of argument. Cambridge: Cambridge University Press; 1958:.
41. Walton D.Informal logic: A handbook for critical argumentation. Cambridge: Cambridge University Press; 1989:.
42. Xi, X. (2008). Methods of test validation.' In E. Shohamy & N. Hornberger (Eds.), Encyclopedia of language and Education, 2nd ed., Vol. 7: Language Testing and Assessment. New York: Springer.