Validating test score meaning and defending test score use: different aims, different methods

Assessment in Education: Principles, Policy and Practice

Volumn 23, Issue 2, 2016, Pages 212-225

  Cizek, Gregory J ^a  

^a UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

justification; validation; validity

Indexed keywords

EID: 84939486974     PISSN: 0969594X     EISSN: 1465329X     Source Type: Journal    
DOI: 10.1080/0969594X.2015.1063479     Document Type: Article

References (41)

1. American Educational Research Association, American Psychological Association, National Council on Measurement in Education [AERA, APA, NCME]. (2014). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
2. American Psychological Association. (1954). Technical recommendations for psychological tests and diagnostic techniques. Washington, DC: Author.
3. D.Borsboom,, A.O.J.Craver,, R.A.Kievit,, A.Z.Scholter,, & S.Franic, (2009). The end of construct validity. In R.W.Lissitz (Ed.), The concept of validity: Revisions, new directions, and applications (pp. 135–172). Charlotte, NC: Information Age.
4. D.Borsboom,, & G.J.Mellenbergh, (2007). Test validity in cognitive assessment. In J.P.Leighton & M.J.Gierl (Eds.), Cognitive diagnostic assessment for education (pp. 85–116). Cambridge: Cambridge University Press.10.1017/CBO9780511611186
5. D.Borsboom,, G.J.Mellenbergh,, & J.van Heerden, (2004). The concept of validity. Psychological Review, 111, 1061–1071.10.1037/0033-295X.111.4.1061
6. R.L.Brennan, (2006). Perspectives on the evolution and future of educational measurement. In R.L.Brennan (Ed.), Educational measurement (4th ed., pp. 1–16). Westport, CT: Praeger.
7. G.Camilli, (2006). Test fairness. In R.L.Brennan (Ed.), Educational measurement (4th ed., pp. 221–256). Westport, CT: Praeger.
8. Centers for Disease Control and Prevention. (1999, September 17). Framework for program evaluation in public health. (Morbidity and Mortality Weekly Report (RR No. 11)). pp. 1–58. Atlanta, GA: Author.
9. G.J.Cizek, (2011, April). Error of measurement: Reconsidering validity theory and the place of consequences. Paper presented at the annual meeting of the National Council on Measurement in Education, New Orleans, LA.
10. G.J.Cizek, (2012). Defining and distinguishing validity: Interpretations of score meaning and justifications of test use. Psychological Methods, 17, 31–43.10.1037/a0026975
11. J.D.Cone,, & S.L.Foster, (1991). Training in measurement: Always the bridesmaid. American Psychologist, 46, 653–654.10.1037/0003-066X.46.6.653
12. L.J.Cronbach, (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.10.1007/BF02310555
13. L.J.Cronbach, (1971). Test validation. In R.L.Thorndike (Ed.), Educational measurement (2nd ed., pp. 443–507). Washington, DC: American Council on Education.
14. S.I.Donaldson,, C.A.Christie,, & M.M.Mark, (Eds.). (2009). What counts as credible evidence in applied research and evaluation practice? Thousand Oaks, CA: Sage.
15. R.L.Ebel, (1961). Must all tests be valid? American Psychologist, 16, 640–647.10.1037/h0045478
16. P.B.Elmore,, & G.Camilli, (Eds.). (2007). Special issue on validity. Educational Researcher, 36, 185–241.
17. J.P.Guilford, (1946). New standards for test evaluation. Educational and Psychological Measurement, 6, 427–439.
18. R.M.Guion, (1980). On Trinitarian doctrines of validity. Professional Psychology, 11, 385–398.10.1037/0735-7028.11.3.385
19. J.Haidt, (2012). The righteous mind: Why good people are divided by politics and religion. New York, NY: Random House.
20. S.B.Hood, (2009). Validity in psychological testing and scientific realism. Theory and Psychology, 19, 451–473.10.1177/0959354309336320
21. P.N.Johnson-Laird,, & P.C.Wason, (1977). Thinking: Readings in cognitive science. Oxford: Cambridge University Press.
22. M.T.Kane, (2006). Validation. In R.Brennan (Ed.), Educational measurement (4th ed., pp. 17–64). Westport, CT: Praeger.
23. M.T.Kane, (2009). Validating the interpretations and uses of test scores. In R.W.Lissitz (Ed.), The concept of validity (pp. 39–64). Charlotte, NC: Information Age.
24. T.S.Kuhn, (1962). The structure of scientific revolutions. Chicago, IL: University of Chicago Press.
25. R.W.Lissitz,, & K.Samuelsen, (2007). A suggested change in terminology and emphasis regarding validity and education. Educational Researcher, 36, 437–448.10.3102/0013189X07311286
26. H.E.Longino, (1990). Science as social knowledge: Values and objectivity in scientific inquiry. Princeton, NJ: Princeton University Press.
27. W.A.Mehrens, (1997). The consequences of consequential validity. Educational Measurement: Issues and Practice, 16, 16–19.
28. S.Messick, (1975). The standard problem: Meaning and values in measurement and evaluation. American Psychologist, 30, 955–966.10.1037/0003-066X.30.10.955
29. S.Messick, (1989). Validity. In R.L.Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). New York, NY: Macmillan.
30. S.Messick, (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749.10.1037/0003-066X.50.9.741
31. S.Messick, (1998). Test validity: A matter of consequence. Social Indicators Research, 45, 35–44.10.1023/A:1006964925094
32. P.E.Newton,, & S.D.Shaw, (2013). Standards for talking and thinking about validity. Psychological Methods, 18, 301–319.10.1037/a0032969
33. M.Q.Patton, (2008). Utilization-focused evaluation (4th ed.). Newbury Park, CA: Sage.
34. M.Scriven, (1995). The logic of evaluation and evaluation practice. New Directions for Evaluation, 1995, 49–70.10.1002/ev.v1995:68
35. W.R.Shadish,, T.D.Cook,, & L.C.Leviton, (1991). Foundations of program evaluation: Theories of practices. Newbury Park, CA: Sage.
36. L.A.Shepard, (1993). Evaluating test validity. Review of Research in Education, 19, 405–450.
37. R.E.Stake, (2004). Standards-based and responsive evaluation. Thousand Oaks, CA: Sage.
38. M.L.Tenopyr, (1975, July). Content-construct confusion. Paper presented at the Content Validity II Conference, Bowling Green State University, Bowling Green, OH.
39. H.Wainer,, & H.I.Braun, (Eds.). (1988). Test validity. Hillsdale, NJ: Erlbaum.
40. D.B.Yarbrough,, L.M.Shulha,, R.K.Hopson,, & F.A.Caruthers, (2011). The program evaluation standards: A guide for evaluators and evaluation users (3rd ed.). Thousand Oaks, CA: Sage.
41. B.D.Zumbo, (2007). Validity: Foundational issues and statistical methodology. In C.R.Rao & S.Sinharay (Eds.), Psychometrics (pp. 45–79). Amsterdam: Elsevier Science.