Clarifying the Consensus Definition of Validity

Measurement

Volumn 10, Issue 1-2, 2012, Pages 1-29

  Newton, Paul E ^a  

^a University of Cambridge Local Examinations Syndicate   (United Kingdom)

Author keywords

construct validity; measurement; validation; validity

Indexed keywords

EID: 84861980764     PISSN: 15366367     EISSN: 15366359     Source Type: Journal    
DOI: 10.1080/15366367.2012.669666     Document Type: Article

References (75)

1. American Psychological Association, American Educational Research Association, & National Council on Measurement in Education. 1966. Standards for educational and psychological testing, Washington, DC: American Psychological Association.
2. American Psychological Association, American Educational Research Association, & National Council on Measurement in Education. 1974. Standards for educational and psychological testing, Washington, DC: American Psychological Association.
3. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. 1985. Standards for educational and psychological testing, Washington, DC: American Psychological Association.
4. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. 1999. Standards for educational and psychological testing, Washington, DC: American Educational Research Association.
5. American Psychological Association, American Educational Research Association, & National Council on Measurements Used in Education. 1954. Technical recommendations for psychological tests and diagnostic techniques. Psychological Bulletin, 51(2) Supplement
6. th, New York, NY: Macmillan.
7. th, Upper Saddle River, NJ: Prentice Hall.
8. Bennett, R. E., Kane, M. and Bridgeman, B. 2011. Theory of action and validity argument in the context of through-course summative assessment, Princeton, NJ: Educational Testing Service.
9. Borsboom, D. 2005. Measuring the mind: Conceptual issues in contemporary psychometrics, Cambridge, UK: Cambridge University Press.
10. Borsboom, D. 2008. Psychometric perspectives on diagnostic systems. Journal of Clinical Psychology, 64(9): 1089-1109.
11. Borsboom, D., Cramer, A. O. J., Keivit, R. A., Scholten, A. Z. and Franic, S. 2009. "The end of construct validity". In The concept of validity: Revisions, new directions, and applications, Edited by: Lissitz, R. W. 135-170. Charlotte, NC: Information Age Publishing.
12. Borsboom, D. and Mellenbergh, G. J. 2007. "Test validity in cognitive assessment". In Cognitive diagnostic assessment for education: Theory and applications, Edited by: Leighton, J. P. and Gierl, M. J. 85-115. New York, NY: Cambridge University Press.
13. Borsboom, D., Mellenbergh, G. J. and van Heerden, J. 2004. The concept of validity. Psychological Review, 111(4): 1061-1071.
14. Briggs, D. C. 2004. Comment: Making an argument for design validity before interpretive validity. Measurement: Interdisciplinary Research & Perspectives, 2(3): 171-174.
15. Buckingham, B. R., McCall, W. A., Otis, A. S., Rugg, H. O., Trabue, M. R. and Courtis, S. A. 1921. Report of the Standardization Committee. Journal of Educational Research, 4(1): 78-80.
16. Cizek, G. J. Reconceptualizing validity and the place of consequences. Paper presented at the Annual Meeting of the National Council on Measurement in Education. New Orleans, LA. April.
17. Clauser, B. E., Kane, M. T. and Swanson, D. B. 2002. Validity issues for performance-based tests scored with computer-automated scoring systems. Applied Measurement in Education, 15(4): 413-432.
18. Cronbach, L. J. 1949. Essentials of psychological testing, New York, NY: Harper & Brothers.
19. Cronbach, L. J. 1969. "Validation of educational measures". In Proceedings of the 1969 Invitational Conference on Testing Problems, 35-52. Princeton, NJ: Educational Testing Service.
20. Cronbach, L. J. 1971. "Test validation". In Educational measurement, 2nd, Edited by: Thorndike, R. L. 443-507. Washington, DC: American Council on Education.
21. Cronbach, L. J. 1980. "Validity on parole: How can we go straight?". In Measuring achievement: Progress over a decade. Proceedings of the 1980 ETS Invitational Conference, Edited by: Schrader, W. B. 99-108. San Francisco, CA: Jossey-Bass.
22. th, New York, NY: Harper and Row.
23. Cronbach, L. J. 1988. "Five perspectives on validity argument". In Test validity, Edited by: Wainer, H. and Braun, H. I. 3-17. Hillsdale, NJ: Lawrence Erlbaum.
24. Cronbach, L. J. and Meehl, P. E. 1955. Construct validity in psychological tests. Psychological Bulletin, 52(4): 281-302.
25. Cureton, E. E. 1951. "Validity". In Educational measurement, Edited by: Lindquist, E. F. 621-694. Washington, DC: American Council on Education.
26. Dunnette, M. D. and Borman, W. C. 1979. Personnel selection and classification systems. Annual Review of Psychology, 30: 477-525.
27. Ellis, M. V. and Blustein, D. L. 1991. Developing and using educational and psychological tests and measures: The unificationist perspective. Journal of Counseling and Development, 69: 550-555.
28. th, Fort Worth, TX: Harcourt.
29. Guilford, J. P. 1946. New standards for test evaluation. Educational and psychological measurement, 6(4): 427-439.
30. Guion, R. M. 1974. Open a new window: Validities and values in psychological measurement. American Psychologist, 29(5): 287-296.
31. Guion, R. M. 1976. "Recruiting, selection, and job placement". In Handbook of industrial and organizational psychology, Edited by: Dunnette, M. D. 777-828. Chicago, IL: Rand McNally.
32. Guion, R. M. 1978a. Scoring of content domain samples: The problem of fairness. Journal of Applied Psychology, 63(4): 499-506.
33. Guion, R. M. 1978b. Content validity" in moderation. Personnel Psychology, 31: 205-213.
34. Guion, R. M. 1980. On Trinitarian doctrines of validity. Professional Psychology, 11(3): 385-398.
35. Hartog, P. J. 1918. Examinations and their relation to culture and efficiency, London, UK: Constable.
36. Hood, S. B. 2009. Validity in psychological testing and scientific realism. Theory & Psychology, 19(4): 451-473.
37. Jenkins, J. G. 1946. Validity for what?. Journal of Consulting Psychology, 10(2): 93-98.
38. Kane, M. T. 1982. A sampling model for validity. Applied Psychological Measurement, 6(2): 125-160.
39. Kane, M. T. 1992. An argument-based approach to validity. Psychological Bulletin, 112(3): 527-535.
40. Kane, M. T. 2006. "Validation". In Educational Measurement, 4th, Edited by: Brennan, R. L. 17-64. Washington, DC: American Council on Education/Praeger.
41. Kane, M. T. 2009. "Validating the interpretations and uses of test scores". In The concept of validity: Revisions, new directions, and applications, Edited by: Lissitz, R. W. 39-64. Charlotte, NC: Information Age Publishing.
42. Kane, M. T. 2011. The error of our ways. Journal of Educational Measurement, 48(1): 12-30.
43. Kline, P. 1998. The new psychometrics: Science, psychology and measurement, London, UK: Routledge.
44. Lennon, R. T. 1956. Assumptions underlying the use of content validity. Educational and Psychological Measurement, 16: 294-304.
45. Lindquist, E. F. 1936. "The theory of test construction". In The construction and use of achievement examinations: A manual for secondary school teachers, Edited by: Hawkes, H. E., Lindquist, E. F. and Mann, C. R. 17-106. Cambridge, MA: Riverside Press.
46. Loevinger, J. 1957. Objective tests as instruments of psychological theory. Psychological Reports, 3: 635-694.
47. Markus, K. A. 1998. Validity, facts, and values sans closure: Reply to Messick, Reckase, Moss, and Zimmerman. Social Indicators Research, 45(1-3): 73-82.
48. McIntire, S. A. and Miller, L. A. 2007. Foundations of psychological testing: A practical approach, 2nd, Thousand Oaks, CA: Sage.
49. Messick, S. 1975. The standard problem: Meaning and values in measurement and evaluation. American Psychologist, 30: 955-966.
50. rd, Edited by: Linn, R. 13-100. Washington, DC: American Council on Education.
51. th, Edited by: Alkin, M. C. Vol. 4, 1487-1495. New York, NY: Macmillan.
52. Michell, J. 2009. "Invalidity in validity". In The concept of validity: Revisions, new directions, and applications, Edited by: Lissitz, R. W. 111-133. Charlotte, NC: Information Age Publishing.
53. Miller, M. D., Linn, R. L. and Gronlund, N. E. 2009. Measurement and assessment in teaching, 10th, Upper Saddle River, NJ: Pearson Education.
54. Mislevy, R. J. 2003. "Argument substance and argument structure in educational assessment (CSE Report 605)". Los Angeles: University of California, LA, National Center for Research on Evaluation, Standards, and Student Testing.
55. Mislevy, R. J. 2009. "Validity from the perspective of model-based reasoning". In The concept of validity: Revisions, new directions, and applications, Edited by: Lissitz, R. W. 83-108. Charlotte, NC: Information Age Publishing.
56. Moss, P. A. 1992. Shifting conceptions of validity in educational measurement: Implications for performance assessment. Review of Educational Research, 62(3): 229-258.
57. Moss, P. A., Girard, B. J. and Haniford, L. C. 2006. Validity in educational assessment. Review of Research in Education, 30: 109-162.
58. Newton, P. E. 2007. Clarifying the purposes of educational assessment. Assessment in education: Principles, Policy & Practice, 14(2): 149-170.
59. Osterlind, S. J. 2009. Modern measurement: Theory, principles, and applications of mental appraisal, 2nd, Boston, MA: Pearson/Allyn & Bacon.
60. Reynolds, C. R., Livingston, R. B. and Willson, V. 2010. Measurement and assessment in education, 2nd, Upper Saddle River, NJ: Pearson.
61. Ruch, G. M. and Stoddard, G. D. 1927. Tests and measurements in high school instruction, New York, NY: Yonkers-on-Hudson.
62. Ruch, G. M. 1924. The improvement of the written examination, Chicago, IL: Scott, Foresman.
63. Scriven, M. 2002. "Assessing six assumptions in assessment". In The role of constructs in psychological and educational measurement, Edited by: Braun, H. I., Jackson, D. N. and Wiley, D. E. 255-275. Mahwah, NJ: Lawrence Erlbaum.
64. Shepard, L. A. 1990. Readiness testing in local school districts: An analysis of backdoor policies. Journal of Education Policy, 5(5): 159-179.
65. Shepard, L. A. 1993. Evaluating test validity. Review of Research in Education, 19: 405-450.
66. Shepard, L. A. 1997. The centrality of test use and consequences for test validity. Educational Measurement: Issues and Practice, 16(2): 5-8.
67. Sireci, S. G. 2007. On validity theory and test validation. Educational Researcher, 36(8): 477-481.
68. Starch, D. 1916. Educational measurements, New York, NY: Macmillan.
69. Tenopyr, M. L. 1977. Content-construct confusion. Personnel Psychology, 30: 47-54.
70. Terman, L. M., Lyman, G., Ordahl, G., Ordahl, L., Galbreath, N. and Talbert, W. 1915. The Stanford revision of the Binet-Simon scale and some results from its application to 1000 non-selected children. Journal of Educational Psychology, 6(9): 551-562.
71. Thorndike, E. L. 1916. An introduction to the theory of mental and social measurements, 2nd, New York, NY: Teachers College, Columbia University.
72. Thorndike, R. M. and Thorndike-Christ, T. 2010. Measurement and Evaluation in Psychology and Education, 8th, Boston: Pearson Education Inc.
73. Thurstone, L. L. 1931. The reliability and validity of tests: Derivation and interpretation of fundamental formulae concerned with reliability and validity of tests and illustrative problems, Ann Arbor, MI: Edwards Brothers.
74. Turney, A. H. 1934. The concept of validity in mental and achievement testing. Journal of Educational Psychology, 25(2): 81-95.
75. Zumbo, B. D. 2009. "Validity as contextualized and pragmatic explanation, and its implications for validation practice". In The concept of validity: Revisions, new directions, and applications, Edited by: Lissitz, R. W. 65-82. Charlotte, NC: Information Age Publishing.