Validating the Interpretations and Uses of Test Scores

Journal of Educational Measurement

Volumn 50, Issue 1, 2013, Pages 1-73

  Kane, Michael T ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84875066975     PISSN: 00220655     EISSN: 17453984     Source Type: Journal    
DOI: 10.1111/jedm.12000     Document Type: Article

References (172)

1. Alderson, J., & Wall, D. (1993). Does washback exist? Applied Linguistics, 14(2), 115-129.
2. American Psychological Association, American Educational Research Association, & National Council on Measurement in Education (1966). Standards for educational and psychological tests and manuals. Washington, DC: American Educational Research Association.
3. American Psychological Association, American Educational Research Association, & National Council on Measurement in Education (1974). Standards for educational and psychological tests and manuals. Washington, DC: American Educational Research Association.
4. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (1985). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
5. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
6. Anastasi, A. (1986). Evolving concepts of test validation. Annual Review of Psychology, 37, 1-15.
7. Angoff, W. H. (1988). Validity: An evolving concept. In H. Wainer & H. Braun (Eds.), Test validity (pp. 9-13). Hillsdale, NJ: Lawrence Erlbaum.
8. Bachman, L. (2002). Alternative interpretations of alternative assessments: Some validity issues in educational performance assessments. Educational Measurement: Issues and Practice, 21(3), 5-18.
9. Bachman, L. (2005). Building and supporting a case for test use. Language Assessment Quarterly, 2, 1-34.
10. Bachman, L., & Palmer, A. (2010). Language assessment in practice: Developing language assessments and justifying their use in the real world. Oxford, UK: Oxford University Press.
11. Blair, J. (1995). Informal logic and reasoning in evaluation. In D. Fournier (Ed.), Reasoning in evaluation: Inferential links and leaps (pp. 71-80). San Francisco, CA: Jossey-Bass.
12. Bonner, S. (2005, April). Investigating the cognitive processes in responding to MBE questions. Paper presented at the meeting of the National Council on Measurement in Education, Montreal, Canada.
13. Boorstin, D. (1983). The discoverers. New York, NY: Random House.
14. Borsboom, D., Cramer, A., Kievit, R., Zand Scholten, A., & Franic, S. (2009). The end of construct validity. In R. Lissitz (Ed.), The concept of validity (pp. 135-170). Charlotte, NC: Information Age Publishers.
15. Borsboom, D., Mellenbergh, G., & van Heerden, J. (2004). The concept of validity. Psychological Review, 111, 1061-1071.
16. Brennan, R. (2001a). An essay on the history and future of reliability from the perspective of replications. Journal of Educational Measurement, 36, 295-317.
17. Brennan, R. (2001b). Generalizability theory. New York, NY: Springer-Verlag.
18. Bridgeman, P. (1927). The logic of modern physics. New York, NY: Macmillan.
19. Brogden, H. E. (1946). On the interpretation of the correlation coefficient as a measure of predictive efficiency. Journal of Educational Psychology, 37, 65-76.
20. Brogden, H. E. (1949). When testing pays off. Personnel Psychology, 2, 171-183.
21. Camilli, G. (2006). Test fairness. In R. Brennan (Ed.), Educational measurement (4th ed., pp. 221-256). Westport, CT: American Council on Education and Praeger.
22. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
23. Campion, M. (1983). Personnel selection for physically demanding jobs: Review and recommendations. Personnel Psychology, 36, 527-550.
24. Carroll, L. (2010). Through the looking glass. (Original work published 1871.) Retrieved March 26, 2010, from www.literature.org/authors/carroll-lewis/through-the-looking-glass
25. Cascio, W. (1993). Assessing the utility of selection decisions: Theoretical and practical considerations. In N. Schmitt & W. Borman (Eds.), Personnel selection in organizations (pp. 310-340). San Francisco, CA: Jossey-Bass.
26. Cascio, W., Jacobs, R., & Silva, J. (2010). Validity, utility, and adverse impact: Practical implications from 30 years of data. In J. Outtz (Ed.), Adverse impact: Implications for organizational staffing and high stakes selection (pp. 271-288). New York, NY: Routledge.
27. Chapelle, C. A. (1999). Validation in language assessment. Annual Review of Applied Linguistics, 19, 254-272.
28. Chapelle, C. A., Enright, M. K., & Jamieson, J. (2008). Building a validity argument for the test of English as a foreign language. New York, NY: Routledge.
29. Chapelle, C. A., Enright, M. K., & Jamieson, J. (2010). Does an argument-based approach to validity make a difference? Educational Measurement: Issues and Practice, 29(1), 3-13.
30. Cizek, G. (2012). Defining and distinguishing validity: Interpretations of score meaning and justifications of test use. Psychological Methods, 17(1), 31-43
31. Clauser, B. (2000). Recurrent issues and recent advances in scoring performance assessments. Applied Psychological Measurement, 24, 310-324.
32. Clauser, B., Margolis, M., & Case, S. (2006). Testing for licensure and certification in the professions. In R. Brennan (Ed.), Educational measurement (4th ed., pp. 701-731). Westport, CT: American Council on Education and Praeger.
33. Cole, N. S., & Moss, P. A. (1989). Bias in test use. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 201-219). New York, NY: American Council on Education and Macmillan.
34. Cook, T., & Campbell, D. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston, MA: Houghton Mifflin.
35. Cronbach, L. J. (1971). Test validation. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 443-507). Washington, DC: American Council on Education.
36. Cronbach, L. J. (1980). Validity on parole: How can we go straight? New Directions for Testing and Measurement: Measuring Achievement Over a Decade, 5, 99-108.
37. Cronbach, L. J. (1982). Designing evaluations of educational and social programs. San Francisco, CA: Jossey-Bass.
38. Cronbach, L. J. (1988). Five perspectives on validity argument. In H. Wainer & H. Braun (Eds.), Test validity (pp. 3-17). Hillsdale, NJ: Lawrence Erlbaum.
39. Cronbach, L. J. (1989). Construct validation after thirty years. In R. E. Linn (Ed.), Intelligence: Measurement, theory, and public policy (pp. 147-171). Urbana: University of Illinois Press.
40. Cronbach, L. J., & Gleser, G. C. (1965). Psychological tests and personnel decisions. Urbana: University of Illinois Press.
41. Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York, NY: Wiley.
42. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302.
43. Cronbach, L. J., & Snow, R. E. (1977). Aptitudes and instructional methods: A handbook for research on interactions. New York, NY: Irvington.
44. Crooks, T. J. (1988). The impact of classroom evaluation practices on students. Review of Educational Research, 58, 438-481.
45. Crooks, T., Kane, M., & Cohen, A. (1996). Threats to the valid use of assessments. Assessment in Education, 3, 265-285.
46. Cureton, E. E. (1951). Validity. In E. F. Lindquist (Ed.), Educational measurement (pp. 621-694). Washington, DC: American Council on Education.
47. Debra P. v. Turlington (1981). 644 F. 2d 397 (5th Cir. ) 564 F. Supp. 177 (M. D. Fla. 1983).
48. De Corte, W., Lievens, F., & Sackett, P. R. (2007). Combining predictors to achieve optimal trade-offs between selection quality and adverse impact. Journal of Applied Psychology, 92, 1380-1393.
49. Ebel, R. (1961). Must all tests be valid? American Psychologist, 16, 640-647.
50. Ebel, R. (1966). The social consequences of educational testing. In A. Anastasi (Ed.), Testing problems in perspective: Twenty-fifth anniversary volume of topical readings from the invitational conference in testing problems (pp. 18-28). Washington, DC: American Council on Education.
51. Embretson, S. (1983). Construct validity: Construct representation versus nomothetic span. Psychological Bulletin, 93, 179-197.
52. Embretson, S. (1984). A general multicomponent latent trait model for measuring learning and change. Psychometrika, 49, 175-186.
53. Embretson, S. (1998). A cognitive design system approach to generating valid tests: Application to abstract reasoning. Psychological Methods, 3, 380-396.
54. Embretson, S., & McCollam, K. (2000). Psychometric approaches to understanding and measuring intelligence. In R. Sternberg (Ed.), Handbook of intelligence (pp. 423-444). Cambridge, UK: Cambridge University Press.
55. Ennis, R. H. (1973). Operational definitions. In H. Brody, R. Ennis, & L. Krimerman (Eds.), Philosophy of educational research (pp. 650-669). New York, NY: Wiley.
56. Equal Employment Opportunity Commission (EEOC), Civil Service Commission, Department of Labor, & Department of Justice (1979). Adoption by four agencies of Uniform Guidelines on employee selection procedures. Federal Register, 43, 38290-38315.
57. Feest, U. (2005). Operationism in psychology: What the debate is about, what the debate should be about. Journal of the History of the Behavioral Sciences, 49(2), 131-149.
58. Feldt, L. S., & Brennan, R. L. (1989). Reliability. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 105-146). New York, NY: American Council on Education and Macmillan.
59. Flockton, L., & Crooks, T. (2002). Social studies assessment results 2001. Dunedin, New Zealand: Educational Assessment Research Unit, University of Otago.
60. Frederiksen, N. (1984). The real test bias. American Psychologist, 39, 193-202.
61. Frederiksen, J. R., & Collins, A. (1989). A systems approach to educational testing. Educational Researcher, 18(9), 27-32
62. Fulcher, G., & Davidson, F. (2007). Language testing and assessment: An advanced resource book. New York, NY: Routledge.
63. Galison, P. (1987). How do experiments end? Chicago, IL: University of Chicago Press.
64. Green, D. (1998). Consequential aspects of the validity of achievement tests: A publisher's point of view. Educational Measurement: Issues and Practice, 17(2), 16-19.
65. Griggs v. Duke Power Company (1971). 401 U.S. 424.
66. Guion, R. (1974). Open a window: Validities and values in psychological measurement. American Psychologist, 29, 287-296.
67. Guion, R. (1977). Content validity: The source of my discontent. Applied Psychological Measurement, 1, 1-10.
68. Guion, R. (1980). On trinitarian conceptions of validity. Professional Psychology, 11, 385-398.
69. Guion, R. (1998). Assessment, measurement, and prediction for personnel decisions. Mahwah, NJ: Lawrence Erlbaum.
70. Gulliksen, H. (1950). Theory of mental tests. New York, NY: Wiley.
71. Gutman, A. (2005). Adverse impact: Judicial, regulatory, and statutory authority. In F. L. Landy (Ed.) Employment discrimination litigation (pp. 20-46). San Francisco, CA: Jossey-Bass.
72. Haertel, E. H. (1999). Validity arguments for high-stakes testing: In search of the evidence. Educational Measurement: Issues and Practice, 18(4), 5-9.
73. Haertel, E. H. (2006). Reliability. In R. Brennan (Ed.), Educational measurement (4th ed., pp. 65-110). Westport, CT: American Council on Education and Praeger.
74. Hamilton, L. (2003). Assessment as a policy tool. Review of Research in Education, 27, 25-68.
75. Hansen, H., & Pinto, R. (1995). Fallacies, classical and contemporary readings. University Park: Pennsylvania State University Press.
76. Herman, J. L., & Golan, S. (1993). The effects of standardized testing on teaching and schools. Educational Measurement: Issues and Practice, 12(4), 20-25.
77. Hershey, J., & Asch, D. (2001). A change of heart: Unexpected responses to medical testing. In S. Hoch, H. Kumreuthen, & R. Gunther (Eds.), Wharton on making decisions (pp. 225-242). New York, NY: Wiley.
78. Heubert, J. P., & Hauser, M. H. (1999). High stakes: Testing for tracking, promotion, and graduation. Washington, DC: National Academies Press.
79. House, E. R. (1980). Evaluating with validity. Beverly Hills, CA: Sage.
80. Jackson, A. S. (1994). Pre-employment physical evaluation. Exercise and Sport Science Review, 22, 53-90.
81. Jaeger, R. (1989). Certification of student competence. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 485-534). New York, NY: American Council on Education and Macmillan.
82. Kane, M. (1982). A sampling model for validity. Applied Psychological Measurement, 6, 125-160.
83. Kane, M. (1986). The future of testing for licensure and certification examinations. In B. Plake & J. Will (Eds.), The future of testing (pp. 145-181). Hillsdale, NJ: Lawrence Erlbaum.
84. Kane, M. (1992). An argument-based approach to validation. Psychological Bulletin, 112, 527-535.
85. Kane, M. (1996). The precision of measurements. Applied Measurement in Education, 9, 355-379.
86. Kane, M. (2002a). Inferences about variance components and reliability-generalizability coefficients in the absence of random sampling. Journal of Educational Measurement, 32, 165-181.
87. Kane, M. (2002b). Validating high-stakes testing programs. Educational Measurement: Issues and Practice, 21(1), 31-41.
88. Kane, M. (2006). Validation. In R. Brennan (Ed.), Educational measurement (4th ed., pp. 17-64). Westport, CT: American Council on Education and Praeger.
89. Kane, M. (2010). Errors of measurement, theory, and public policy. Princeton, NJ: Educational Testing Service.
90. Kane, M. (2011). The errors of our ways. Journal of Educational Measurement, 48, 12-30.
91. Kane, M., Crooks, T., & Cohen, A. (1999). Validating measures of performance. Educational Measurement: Issues and Practice, 18(2), 5-17.
92. Kelley, T. (1927). Interpretation of educational measurements. Yonkers, NY: World Book Co.
93. Kolen, M. (2006). Scaling and norming. In R. Brennan (Ed.), Educational measurement (4th ed., pp. 155-220). Westport, CT: American Council on Education and Praeger.
94. Koretz, D. M., & Hamilton, L. S. (2006). Testing for accountability in K-12. In R. Brennan (Ed.), Educational measurement (4th ed., pp. 531-578). Westport, CT: American Council on Education and Praeger.
95. Lakatos, I. (1970). Falsification and the methodology of scientific research programs. In I. Lakatos & A. Musgrave (Eds.), Criticism and the growth of knowledge (pp. 91-196). London, UK: Cambridge University Press.
96. Lane, S., Parke, C., & Stone, C. (1998). A framework for evaluating the consequences of assessment programs. Educational Measurement: Issues and Practice, 17(2), 24-28.
97. Lane, S., & Stone, C. (2002). Strategies for examining the consequences of assessment and accountability programs. Educational Measurement: Issues and Practice, 21(1), 23-30.
98. Lane, S., & Stone, C. (2006). Performance assessment. In R. Brennan (Ed.), Educational measurement (4th ed., pp. 387-431). Westport, CT: American Council on Education and Praeger.
99. Linn, R. L. (1997). Evaluating the validity of assessments: The consequences of use. Educational Measurement: Issues and Practice, 16(2), 14-16.
100. Linn, R. L. (1998). Partitioning responsibility for the evaluation of the consequences of assessment programs. Educational Measurement: Issues and Practice, 17(2), 28-30.
101. Linn, R. L. (2005). Conflicting demands of No Child Left Behind and state systems: Mixed messages about school performance. Education Policy Analysis Archives, 13(33), (http://epaa.asu.edu/epaa/v13n33/, accessed June 28, 2005).
102. Linn, R. L. (2009). The concept of validity in the context of NCLB. In R. Lissitz (Ed.), The concept of validity (pp. 195-212). Charlotte, NC: Information Age Publishers.
103. Lissitz, R., & Samuelsen, K. (2007). A suggested change in terminology and emphasis regarding validity and education. Educational Researcher, 36, 437-448.
104. Loevinger, J. (1957). Objective tests as instruments of psychological theory. Psychological Reports, Monograph Supplement, 3, 635-694.
105. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
106. Madaus, G. F. (1988). The influences of testing on the curriculum. In L. N. Tanner (Ed.), Critical issues in curriculum (pp. 83-121). Chicago, IL: University of Chicago Press.
107. Maguire, T., Hattie, J., & Brian, H. (1994). Construct validity and achievement assessment. The Alberta Journal of Educational Research, 40(2), 109-126.
108. Marion, S., & Perie, M. (2009). In introduction to validity arguments in alternate assessments. In W. D. Schaeffer & R. W. Lissitz (Eds), Alternate assessment: Proceedings from the 8th Annual MARCES Conference (pp. 113-126). Baltimore, MD: Brookes Publishing.
109. McNeil, L. (2005). Faking equity: High-stakes testing and the education of Latino youth. In A. Valenzuela (Ed.), Leaving children behind: How "Texas-style" accountability fails Latino youth (pp. 57-111). Albany: State University of New York Press.
110. Meehl, P. (1950). On the circularity of the law of effect. Psychological Bulletin, 47, 52-75.
111. Meehl, P. (1954). Clinical versus statistical prediction: A theoretical analysis and a review of the evidence. Minneapolis: University of Minnesota.
112. Mehrens, W. A. (1997). The consequences of consequential validity. Educational Measurement: Issues and Practice, 16(2), 16-18.
113. Messick, S. (1975). The standard problem: Meaning and values in measurement and evaluation. American Psychologist, 30, 955-966.
114. Messick, S. (1980). Test validity and the ethics of assessment. American Psychologist, 35, 1012-1027.
115. Messick, S. (1981). Evidence and ethics in the evaluation of tests. Educational Researcher, 10(9), 9-20.
116. Messick, S. (1982). The values of ability testing: Implications of multiple perspectives about criteria and standards. Educational Measurement: Issues and Practice, 1(3), 9-12.
117. Messick, S. (1988). The once and future issues of validity: Assessing the meaning and consequences of measurement. In H. Wainer & H. Braun (Eds.), Test validity (pp. 33-45). Hillsdale, NJ: Lawrence Erlbaum.
118. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). New York, NY: American Council on Education and Macmillan.
119. Messick, S. (1994). The interplay of evidence and consequences in the validation of performance assessments. Educational Researcher, 23, 13-23.
120. Mill, J. S. (2002 [1843]). A system of logic. Honolulu, HI: University Press of the Pacific.
121. Mislevy, R. (1996). Test theory reconceived. Journal of Educational Measurement, 33, 379-416.
122. Mislevy, R. (2004). Can there be reliability without "reliability?" Journal of Educational and Behavioral Statistics, 29, 241-244.
123. Mislevy, R. (2006). Cognitive psychology and educational assessment. In R. Brennan (Ed.), Educational measurement (4th ed., pp. 257-305). Westport, CT: American Council on Education and Praeger.
124. Mislevy, R. (2009). Validity from the perspective of model-based reasoning. In R. Lissitz (Ed.), The concept of validity (pp. 83-108). Charlotte, NC: Information Age Publishers.
125. Mislevy, R., Steinberg, L., & Almond, R. (2003). On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives, 1, 3-62.
126. Moss, P. (1992). Shifting conceptions of validity in educational measurement: Implications for performance assessment. Review of Educational Research, 62, 229-258.
127. Moss, P. (1994). Can there be validity without reliability? Educational Researcher, 23, 5-12.
128. Moss, P. (1995). Themes and variations in validity theory. Educational Measurement: Issues and Practice, 4(2), 5-13.
129. Moss, P. (1998). The role of consequences in validity theory. Educational Measurement: Issues and Practice, 17(2), 6-12.
130. Moss, P. (2007). Reconstructing validity. Educational Researcher, 36, 470-476.
131. National Research Council (2001). Knowing what students know: The science and design of educational assessment. J. Pellegrino, N. Chudowski, & R. Glaser (Eds.), Committee on the Foundations of Assessment. Board on Testing and Assessment, Center for Education. Division of Behavioral and Social Sciences and Education. Washington, DC: The National Academies Press.
132. National Research Council (2007). Lessons learned about testing: Ten years of work at the National Research Council. [Booklet.] Board on Testing and Assessment, Division of Behavioral and Social Sciences and Education. Washington, DC: The National Academies Press. Retrieved January 28, 2013, from http://www7.nationalacademies.org/dbasse/Lessons_Learned_Brochure_pdf.pdf
133. No Child Left Behind (NCLB) Act (2002). Pub. L. No. 107-110, 115 Stat. 1435.
134. Pellegrino, J. W., Baxter, G. P., & Glaser, R. (1999). Addressing the "two disciplines" problem: Linking theories of cognition and learning with assessment and instructional practice. In A. Iran-Nejad & P. Pearson (Eds.), Review of Research on Education (Vol. 24, pp. 307-353). Washington, DC: American Educational Research Association.
135. Petersen, N. (2007). Equating: Best practices and challenges to best practices. In N. Dorans, M. Pommerich, & P. Holland (Eds.), Linking and aligning scores and scales (pp. 59-72). New York, NY: Springer-Verlag.
136. Peterson, M. (2009). An introduction to decision theory. Cambridge, UK: Cambridge University Press.
137. Phillips, D. (2007). Adding complexity: Philosophical perspectives on the relationship between evidence and policy. In P. Moss (Ed.), Evidence and decision making (pp. 376-402). Malden, MA: Blackwell.
138. Pinto, R. (2001). Argument, inference and dialectic. Dordrect, The Netherlands: Kluwer Academic Publishers.
139. Popham, W. J. (1997). Consequential validity: Right concern - Wrong concept. Educational Measurement: Issues and Practice, 16(2), 9-13.
140. Popper, K. R. (1962). Conjecture and refutation: The growth of scientific knowledge. New York, NY: Basic Books.
141. Pyburn, K., Ployhart, R., & Kravitz, D. (2008). The diversity-validity dilemma: Overview and legal context. Personnel Psychology, 61, 143-151.
142. Reckase, M. (1998). Consequential validity for the test developer's perspective. Educational Measurement: Issues and Practice, 17(2), 13-16.
143. Ryan, K. (2002). Assessment validation in the context of high-stakes testing assessment. Educational Measurement: Issues and Practice, 21(1), 7-15.
144. Sackett, P. R. (1998). Performance assessment in education and professional certification: Lessons for personnel selection? In M. D. Hakel (Ed.), Beyond multiple choice: Evaluating alternatives for traditional testing for selection (pp. 113-129). Mahwah, NJ: Lawrence Erlbaum.
145. Sackett, P., De Corte, W., & Lievens, F. (2010). Decision aids for addressing the validity-adverse impact trade-off. In J. Outtz (Ed.), Adverse impact: Implications for organizational staffing and high stakes selection (pp. 453-472). New York, NY: Routledge.
146. Scriven, M. (1987). Validity in personnel evaluation. Journal of Personnel Evaluation in Education, 1, 9-23.
147. Scriven, M. (2002). Assessing six assumptions in assessment. In H. Braun, D. Jackson, & D. Wiley (Eds.), The role of constructs in psychological and educational measurement (pp. 255-275). Mahwah, NJ: Lawrence Erlbaum.
148. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
149. Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage.
150. Shepard, L. (1993). Evaluating test validity. In L. Darling-Hammond (Ed.), Review of research in education (pp. 405-450). Washington, DC: American Educational Research Association.
151. Shepard, L. (1997). The centrality of test use and consequences for test validity. Educational Measurement: Issues and Practice, 16(2), 5-24.
152. Sireci, S. (1998). The construct of content validity. Social Indicators Research, 45, 83-117.
153. Sireci, S. (2009). Packing and unpacking sources of validity evidence: History repeats itself again. In R. Lissitz (Ed.), The concept of validity (pp. 19-38). Charlotte, NC: Information Age Publishers.
154. Sireci, S. G., & Green, P. C. (2000). Legal and psychometric criteria for evaluating teacher certification tests. Educational Measurement: Issues and Practice, 19(1), 22-31.
155. Sireci, S. G., & Parker, P. (2006). Validity on trial: Psychometric and legal conceptualizations of validity. Educational Measurement: Issues and Practice, 2(3), 27-34.
156. Sireci, S., Scarpati, S., & Li, S. (2005). Test accommodations for students with disabilities: An analysis of the interaction hypothesis. Review of Educational Research, 75, 457-490.
157. Spearman, C. (1904). "General intelligence" objectively determined and measured. American Journal of Psychology, 15, 201-292.
158. Taleporos, E. (1998). Consequential validity: A practitioner's perspective. Educational Measurement: Issues and Practice, 17(2), 20-23.
159. Taylor, H., & Russell, J. (1939). The relationship of validity coefficients to the practical effectiveness of tests in selection: Discussion and tables. Journal of Applied Psychology, 23, 565-578.
160. Tenopyr, M. L. (1977). Content-construct confusion. Personnel Psychology, 30, 47-54.
161. Thorndike, E. L. (1918). Individual differences. Psychological Bulletin, 15, 148-159.
162. Toulmin, S. (1958). The uses of argument. Cambridge, UK: Cambridge University Press.
163. Toulmin, S. (2001). Return to reason. Cambridge, MA: Harvard University Press.
164. von Mayrhauser, R. T. (1992). The mental testing community and validity: A prehistory. American Psychologist, 47, 244-253.
165. Walton, D. (1989). Informal logic: A handbook for critical argumentation. Cambridge, UK: Cambridge University Press.
166. Wigdor, A., & Garner, W. (1982). Ability testing: Uses, consequences, and controversies. Washington, DC: National Academies Press.
167. Wiley, D. (1991). Test validity and invalidity reconsidered. In R. Snow & D. Wiley (Eds.), Improving inquiry in social science (pp. 75-107). Hillsdale, NJ: Lawrence Erlbaum.
168. Willingham, W., & Cole, N. (1997). Gender and fair assessment. Mahwah, NJ: Lawrence Erlbaum.
169. Xi, X. (2010). How do we go about investigating test fairness? Language Testing, 27(2), 147-170.
170. Yen, W., & Fitzpatrick, A. (2006). Item response theory. In R. Brennan (Ed.), Educational measurement (4th ed., pp. 111-153). Westport, CT: American Council on Education and Praeger.
171. Zumbo, B. (2007). Validity: Foundational issues and statistical methodology. In C. R. Rao & S. Sinharay (Eds.), Handbook of statistics, Vol. 26: Psychometrics (pp. 45-79). Amsterdam, The Netherlands: Elsevier Science.
172. Zumbo, B. (2009). Validity as contextualized and pragmatic explanation, and its implications for validation practice. In R. Lissitz (Ed.), The concept of validity (pp. 65-82). Charlotte, NC: Information Age Publishers.